class

OnnxRuntime::CudaProviderOptions

Inherits OnnxRuntime::ProviderOptions / Reference / Object

CUDA provider options

Constructors

new(session : InferenceSession, device_id = 0, gpu_mem_limit = 0_u64, arena_extend_strategy = 0, cudnn_conv_algo_search = 0, do_copy_in_default_stream = true)
Source

Instance methods

finalize

Finalizer to release resources

Source
release

Explicitly release resources

Source
to_unsafe

Get the underlying OrtCUDAProviderOptionsV2 pointer

Source