Shortcuts

get_fusion_params

torchtune.modules.model_fusion.get_fusion_params(model: Module) Dict[str, Parameter][source]

Return the subset of parameters from a model that correspond to fused modules. Assumes that any fusion class has defined the fusion_params() method.

Parameters:

model (nn.Module) – Instance of model class containing some fusion params.

Returns:

the subset of model’s state dict containing

only adapter parameters.

Return type:

Dict[str, nn.Parameter]

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources