Cri::Provider
Generic provider runtime. Provider identity/configuration comes from the registration; wire semantics come from the selected APIClient.
Constructors
new(registration : ProviderRegistration, client : APIClient)
Sourcenew
The no-argument initializer keeps the public Provider seam usable for custom/native implementations that override complete.
Instance methods
client
Sourcecomplete(messages : Array(Message), tools : Array(ToolSpec), settings : ModelSettings) : AssistantResponse
Sourcecomplete_stream(messages : Array(Message), tools : Array(ToolSpec), settings : ModelSettings = ModelSettings.new, &on_text : String -> Nil) : AssistantResponse
Sourceregistration
Sourcesupports_streaming?
Source