Source Package: python-tiktoken (0.13.0-1.3)
Fast BPE tokeniser for use with OpenAI's models
The following binary packages are built from this source package:
- python313-tiktoken
Fast BPE tokeniser for use with OpenAI's models
- python314-tiktoken
Fast BPE tokeniser for use with OpenAI's models
