ModelUsage

---

Object Hierarchy:

Description:

Content:

Properties:

• public string connection { get; set; }
  Connection URL key (references a connection from the connections map)
• public string model { get; set; }
  Model name to use
• public Options options { get; set; }
  Optional runtime options (temperature, top_p, top_k, num_ctx, etc.)

Creation methods:

• public ModelUsage ()

Methods:

• public ModelUsage clone ()
  Creates a clone of this ModelUsage.
• public string context_size ()
  Returns a pretty string for context size (e.g. "128K ctx"), or "" if none. Uses options.num_ctx when set, else model_obj.context_length.
• public override bool deserialize_property (string property_name, out Value value, ParamSpec pspec, Node property_node)
• public string display_name ()
  Returns the display name for this model (just the model name).
• public string display_name_with_size ()
  Returns the display name with size (and optional context from this usage). Uses model_obj.display_name when available, plus context_size() when set.
• public unowned ParamSpec? find_property (string name)
• public Value get_property (ParamSpec pspec)
• public override Node serialize_property (string property_name, Value value, ParamSpec pspec)
• public void set_property (ParamSpec pspec, Value value)
• public string to_string ()
  Returns a string representation of this ModelUsage.
• public async bool verify_model (Config2 config)
  Verifies that the model specified in this ModelUsage is available on the connection.

Fields:

• public bool is_valid
  Whether this ModelUsage is valid (connection exists, model is available).
• public Model? model_obj
  Response.Model object for display names and filling in details later. Not serialized - runtime only.

Inherited Members: