qlora_gemma_7b

torchtune.models.gemma.qlora_gemma_7b(lora_attn_modules: List[Literal['q_proj', 'k_proj', 'v_proj', 'output_proj']], apply_lora_to_mlp: bool = False, lora_rank: int = 8, lora_alpha: float = 16, *, quantize_base: bool = True) → GemmaTransformerDecoder

Builder for creating a Gemma model with QLoRA enabled. Base model weights in linear layers that LoRA is applied to are quantized per the QLoRA paper: https://arxiv.org/abs/2305.14314. Please see lora_gemma_7b for full API arguments.