struct

Smith::LLM::Usage

Inherits JSON::Serializable < Struct < Value < Object

Constructors

new(pull : JSON::PullParser)

new(prompt_tokens : Int32 = 0, completion_tokens : Int32 = 0, total_tokens : Int32 = 0, cache_creation_tokens : Int32 = 0, cache_read_tokens : Int32 = 0)

Source

new(*, __pull_for_json_serializable pull : JSON::PullParser)

Source

Instance methods

+(other : Usage) : Usage

Source

billed_prompt_tokens

How big the prompt actually was. Anthropic reports the cached part separately, so prompt_tokens alone is the uncached remainder — a few hundred tokens on a cache hit, which is not the size of anything. Callers measuring context usage want this; callers pricing a request do not, because the parts are billed at different rates.

Source

cache_creation_tokens

Anthropic prompt caching. Defaulted here as well as in the constructor, so sessions saved before these fields existed still deserialize.

Source

cache_read_tokens

Source

cached_tokens

Everything that went through the cache, written or read.

completion_tokens

prompt_tokens

total_tokens