Function torch_tensorrt::torchscript::convert_method_to_trt_engine

Function Documentation

TORCHTRT_API std::string torch_tensorrt::torchscript::convert_method_to_trt_engine(const torch::jit::Module &module, std::string method_name, CompileSpec info)

Compile a TorchScript method for NVIDIA GPUs using TensorRT.

Takes a existing TorchScript module and a set of settings to configure the compiler and will convert selected method to a serialized TensorRT engine which can be run with TensorRT

Parameters

• module, : – torch::jit::Module - Existing TorchScript module

• method_name, : – std::string - Name of method to compile

• info, : – torch_tensorrt::CompileSpec - Compilation settings

Returns

: std::string: Serialized TensorRT engine equivilant to the method graph