Table of Contents

Shortcuts

llama2_tokenizer¶

torchtune.models.llama2.llama2_tokenizer(path: str) → Llama2Tokenizer[source]¶

Tokenizer for Llama2.

Parameters:: path (str) – path to the tokenizer
Returns:: Instantiation of the Llama2 tokenizer
Return type:: Llama2Tokenizer

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources