lora_llama3_1_70b¶
- torchtune.models.llama3_1.lora_llama3_1_70b(lora_attn_modules: List[Literal['q_proj', 'k_proj', 'v_proj', 'output_proj']], apply_lora_to_mlp: bool = False, apply_lora_to_output: bool = False, lora_rank: int = 8, lora_alpha: float = 16, lora_dropout: float = 0.0, use_dora: bool = False, quantize_base: bool = False) TransformerDecoder[source]¶
Builder for creating a Llama3.3 70B model with LoRA enabled. Please see lora_llama3_1_70b for full API arguments.
