.. role:: hidden :class: hidden-section .. currentmodule:: torchtune.modules.transforms.tokenizers SentencePieceBaseTokenizer ========================== .. autoclass:: SentencePieceBaseTokenizer :members: