qwen2_5_14b_base¶
- torchtune.models.qwen2_5.qwen2_5_14b_base() TransformerDecoder[source]¶
Builder for creating a Qwen2.5 base model initialized w/ the default 14B parameter values from https://huggingface.co/Qwen/Qwen2.5-14B
- Returns:
Instantiation of Qwen2.5 14B model
- Return type:
Note
The base and instruct versions have slightly different architectures for all Qwen2.5 model sizes except 0.5B and 3B. Make sure to select the correct model builder for the weights.
