Class QuantBackendOverride

java.lang.Object
smile.llm.quant.QuantBackendOverride

public final class QuantBackendOverride extends Object
Thread-local override for smile.chat.quantization during model load.
  • Method Details

    • set

      public static void set(String backend)
      Sets the override for the current thread (auto/dense/…).
      Parameters:
      backend - backend override string.
    • get

      public static String get()
      Returns the current override.
      Returns:
      current override, or null.
    • clear

      public static void clear()
      Clears the override.