class

OpenAI::RealtimeServerEventInputAudioBufferTimeoutTriggered

Inherits JSON::Serializable < Reference < Object

Returned when the Server VAD timeout is triggered for the input audio buffer. This is configured with idle_timeout_ms in the turn_detection settings of the session, and it indicates that there hasn't been any speech detected for the configured duration.

The audio_start_ms and audio_end_ms fields indicate the segment of audio after the last model response up to the triggering time, as an offset from the beginning of audio written to the input audio buffer. This means it demarcates the segment of audio that was silent and the difference between the start and end values will roughly match the configured timeout.

The empty audio will be committed to the conversation as an input_audio item (there will be a input_audio_buffer.committed event) and a model response will be generated. There may be speech that didn't trigger VAD but is still detected by the model, so the model may respond with something relevant to the conversation or a prompt to continue speaking.

Constructors

new(event_id : String = "", type_value : Hash(String, JSON::Any) = Hash(String, JSON::Any).new, audio_start_ms : Int64 = 0, audio_end_ms : Int64 = 0, item_id : String = "")
Source
new(*, __pull_for_json_serializable pull : JSON::PullParser)
Source

Instance methods

audio_end_ms

Millisecond offset of audio written to the input audio buffer at the time the timeout was triggered.

Source
audio_end_ms=(audio_end_ms : Int64)

Millisecond offset of audio written to the input audio buffer at the time the timeout was triggered.

Source
audio_start_ms

Millisecond offset of audio written to the input audio buffer that was after the playback time of the last model response.

Source
audio_start_ms=(audio_start_ms : Int64)

Millisecond offset of audio written to the input audio buffer that was after the playback time of the last model response.

Source
event_id

The unique ID of the server event.

Source
event_id=(event_id : String)

The unique ID of the server event.

Source
item_id

The ID of the item associated with this segment.

Source
item_id=(item_id : String)

The ID of the item associated with this segment.

Source
type_value

The event type, must be input_audio_buffer.timeout_triggered.

Source
type_value=(type_value : Hash(String, JSON::Any))

The event type, must be input_audio_buffer.timeout_triggered.

Source