class

OnnxRuntime::IoBinding

Inherits Reference / Object

IoBinding class provides zero-copy inference and advanced input/output binding. This is a placeholder for future implementation.

Constructors

new(session : InferenceSession)

Creates a new IoBinding instance.

Source

Instance methods

bind_input(name : String, tensor_ptr : Pointer(LibOnnxRuntime::OrtValue))

Bind input to a tensor

Source
bind_output(name : String, tensor_ptr : Pointer(LibOnnxRuntime::OrtValue))

Bind output to a tensor

Source
finalize

Finalizer to release resources

Source
release

Explicitly release resources

Source
to_unsafe

Get the underlying OrtIoBinding pointer

Source