ts.utils package

Submodules

ts.utils.timeit_decorator module

timeit decorator

ts.utils.timeit_decorator.timeit(func)

Use this decorator on a method to find it’s execution time. :param func: :return:

ts.utils.util module

Utility functions for TorchServe

class ts.utils.util.PT2Backend(value)

Bases: str, Enum

An enumeration.

AOT_CUDAGRAPHS = 'aot_cudagraphs'

AOT_EAGER = 'aot_eager'

AOT_NVFUSER = 'aot_nvfuser'

EAGER = 'eager'

FX2TRT = 'fx2trt'

HPU_BACKEND = 'hpu_backend'

INDUCTOR = 'inductor'

IPEX = 'ipex'

NVFUSER = 'nvfuser'

OFI = 'ofi'

ONNXRT = 'onnxrt'

OPENVINO = 'openvino'

TENSORRT = 'tensorrt'

TORCHXLA_TRACE_ONCE = 'torchxla_trace_once'

exception ts.utils.util.PredictionException(message, error_code=500)

Bases: Exception

ts.utils.util.check_valid_pt2_backend(backend: str) → bool

ts.utils.util.deprecated(version, replacement='', klass=<class 'PendingDeprecationWarning'>)

This is a decorator which can be used to mark functions as deprecated. It will result in a warning being emitted when the function is used.

Parameters:

• version – The version in which the function will be removed.

• replacement – The replacement function, if any.

• klass – The category of warning

ts.utils.util.get_yaml_config(yaml_file_path)

ts.utils.util.list_classes_from_module(module, parent_class=None)

Parse user defined module to get all model service classes in it.

Parameters:

• module –

• parent_class –

Returns:

List of model service class definitions

ts.utils.util.load_label_mapping(mapping_file_path)

Load a JSON mapping { class ID -> friendly class name }. Used in BaseHandler.

ts.utils.util.map_class_to_label(probs, mapping=None, lbl_classes=None)

Given a list of classes & probabilities, return a dictionary of { friendly class name -> probability }

Module contents

Util files for TorchServe