Shortcuts

llama3_1_405b

torchtune.models.llama3_1.llama3_1_405b() TransformerDecoder[source]

Builder for creating a Llama3.1 model initialized w/ the default 405B parameter values.

Returns:

Instantiation of Llama3.1 405B model

Return type:

TransformerDecoder

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources