ts.utils package

Submodules

ts.utils.timeit_decorator module

timeit decorator

ts.utils.timeit_decorator.timeit(func)

Use this decorator on a method to find it’s execution time. :param func: :return:

ts.utils.util module

Utility functions for TorchServe

class ts.utils.util.PT2Backend(value)

Bases: str, enum.Enum

An enumeration.

AOT_CUDAGRAPHS = 'aot_cudagraphs'

AOT_EAGER = 'aot_eager'

AOT_NVFUSER = 'aot_nvfuser'

EAGER = 'eager'

FX2TRT = 'fx2trt'

INDUCTOR = 'inductor'

IPEX = 'ipex'

NVFUSER = 'nvfuser'

OFI = 'ofi'

ONNXRT = 'onnxrt'

exception ts.utils.util.PredictionException(message, error_code=500)

Bases: Exception

ts.utils.util.list_classes_from_module(module, parent_class=None)

Parse user defined module to get all model service classes in it.

Parameters

• module –

• parent_class –

Returns

List of model service class definitions

ts.utils.util.load_compiler_config(config_file_path)

Load a compiler {compiler_name -> compiler } Can be extended to also support kwargs for ONNX and TensorRT

ts.utils.util.load_label_mapping(mapping_file_path)

Load a JSON mapping { class ID -> friendly class name }. Used in BaseHandler.

ts.utils.util.map_class_to_label(probs, mapping=None, lbl_classes=None)

Given a list of classes & probabilities, return a dictionary of { friendly class name -> probability }

Module contents

Util files for TorchServe