OLLMchat.Call.Create.quantize – ollmchat Reference Manual

quantize

Description:

public string quantize { get; set; }

Quantization level to apply.

Examples: "q4_K_M", "q8_0", etc. Equivalent to "QUANTIZE" in a Modelfile.


Generated by valadoc