Options

Object Hierarchy:

Description:

var call = new Call.Chat(client, "llama3.2");
call.options = new Call.Options() {
    temperature = 0.7,
    top_p = 0.9,
    num_predict = 100
};

// Or modify existing options
call.options.temperature = 0.5;
call.options.stop = "\n\n";

Content:

Properties:

• public double frequency_penalty { get; set; }
• public double min_p { get; set; }
• public int num_ctx { get; set; }
• public int num_predict { get; set; }
• public double presence_penalty { get; set; }
• public int repeat_last_n { get; set; }
• public double repeat_penalty { get; set; }
• public int seed { get; set; }
• public string stop { get; set; }
• public double temperature { get; set; }
• public int top_k { get; set; }
• public double top_p { get; set; }
• public double typical_p { get; set; }

Creation methods:

• public Options ()

Methods:

• public Options clone ()
  Creates a clone of this Options object with all properties copied.
• public virtual bool deserialize_property (string property_name, out Value value, ParamSpec pspec, Node property_node)
• public void fill_from_model (Model model)
  Fills this Options object with values parsed from model parameters string.
• public unowned ParamSpec? find_property (string name)
• public Value get_property (ParamSpec pspec)
• public bool has_values ()
  Checks if any options have valid values set.
• public virtual Node serialize_property (string property_name, Value value, ParamSpec pspec)
• public void set_property (ParamSpec pspec, Value value)

Inherited Members: