Shortcuts

Class Device::DeviceType

Nested Relationships

This class is a nested type of Struct Device.

Class Documentation

class torch_tensorrt::Device::DeviceType

Supported Device Types that can be used with TensorRT engines

This class is compatable with c10::DeviceTypes (but will check for TRT support) but the only applicable value is at::kCUDA, which maps to DeviceType::kGPU

To use the DataType class itself, interface using the enum vs. normal instatination

ex. torch_tensorrt::DeviceType type = DeviceType::kGPU;

Public Types

enum Value

Underlying enum class to support the DeviceType Class

In the case that you need to use the DeviceType class itself, interface using this enum vs. normal instatination

ex. torch_tensorrt::DeviceType type = DeviceType::kGPU;

Values:

enumerator kGPU

Target GPU to run engine.

enumerator kDLA

Target DLA to run engine.

Public Functions

DeviceType() = default

Construct a new Device Type object.

inline constexpr DeviceType(Value t)

Construct a new Device Type object from internal enum.

DeviceType(c10::DeviceType t)

Construct a new Device Type object from torch device enums Note: The only valid value is torch::kCUDA (torch::kCPU is not supported)

Parameters

t

inline operator Value() const

Get the internal value from the Device object.

Returns

Value

explicit operator bool() = delete
inline constexpr bool operator==(DeviceType other) const

Comparison operator for DeviceType.

Parameters

other

Returns

true

Returns

false

inline constexpr bool operator!=(DeviceType other) const

Comparison operator for DeviceType.

Parameters

other

Returns

true

Returns

false

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources