Shortcuts

ts.protocol package

Submodules

ts.protocol.otf_message_handler module

OTF Codec

ts.protocol.otf_message_handler.create_load_model_response(code, message)[source]

Create load model response.

Parameters:
  • code

  • message

Returns:

ts.protocol.otf_message_handler.create_predict_response(ret, req_id_map, message, code, context=None, ts_stream_next=False)[source]

Create inference response.

Parameters:
  • context

  • ret

  • req_id_map

  • message

  • code

Returns:

ts.protocol.otf_message_handler.encode_response_headers(resp_hdr_map)[source]
ts.protocol.otf_message_handler.retrieve_msg(conn)[source]

Retrieve a message from the socket channel.

Parameters:

conn

Returns:

ts.protocol.otf_message_handler.send_intermediate_predict_response(ret, req_id_map, message, code, context=None)[source]

Module contents

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources