qwen2_5_7b_base

torchtune.models.qwen2_5.qwen2_5_7b_base() → TransformerDecoder

Builder for creating a Qwen2.5 base model initialized w/ the default 7B parameter values from https://huggingface.co/Qwen/Qwen2.5-7B

Returns:

Instantiation of Qwen2.5 7B model

Return type:

TransformerDecoder

Note

The base and instruct versions have slightly different architectures for all Qwen2.5 model sizes except 0.5B and 3B. Make sure to select the correct model builder for the weights.