Shortcuts

llama3_2_3b

torchtune.models.llama3_2.llama3_2_3b(tie_word_embeddings: bool = True) TransformerDecoder[source]

Builder for creating a Llama3.2 model initialized w/ the default 3b parameter values.

Parameters:

tie_word_embeddings (bool) – whether the model’s input and output word embeddings should be tied.

Returns:

Instantiation of Llama3.2 3B model

Return type:

TransformerDecoder

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources