Shortcuts

mistral_tokenizer

torchtune.models.mistral.mistral_tokenizer(path: str) MistralTokenizer[source]

Tokenizer for Mistral models.

Parameters:

path (str) – path to the tokenizer

Returns:

Instantiation of the Mistral tokenizer

Return type:

MistralTokenizer

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources