llama3_2_1b
- torchtune.models.llama3_2.llama3_2_1b(tie_word_embeddings: bool = True) TransformerDecoder [source]
Builder for creating a Llama3.2 model initialized w/ the default 1b parameter values.
- Parameters:
tie_word_embeddings (bool) – whether the model’s input and output word embeddings should be tied.
- Returns:
Instantiation of Llama3.2 1B model
- Return type: