Table of Contents

Shortcuts

gemma_tokenizer¶

torchtune.models.gemma.gemma_tokenizer(path: str) → GemmaTokenizer[source]¶

Tokenizer for Gemma.

Parameters:: path (str) – path to the tokenizer
Returns:: Instantiation of the Gemma tokenizer
Return type:: GemmaTokenizer

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources