Upstream software project

tiktoken

Fast BPE tokeniser for use with OpenAI's models

About tiktoken

Fast BPE tokeniser for use with OpenAI's models

This project links 3 native package records across 2 recorded operating-system releases. Compare the retained versions and architectures below, then open the package for your own release.

These are catalog observations, not a guarantee of installation, compatibility, or upstream support.

Project pictures and package coverage

tiktoken repository preview from GitHub
Project repository preview, supplied by GitHub. Open source repository
Debian 13 (Trixie): 1 package records; openSUSE Tumbleweed: 2 package records. Catalog coverage diagram, not an application screenshot.tiktoken: recorded package coverageDebian 13 (Trixie)1 recordsopenSUSE Tumbleweed2 records
OpenFactory diagram of linked package records. It is not an application screenshot.

Project identity

Project
tiktoken
Publisher
Not authoritatively mapped
Native package records
3
Operating systems
debian-13, opensuse-tumbleweed
License expression
MIT
Source repository
Open source repository

Source-reported description

The fullest retained description is shown with its source. Distribution packaging descriptions may include downstream details.

Fast Byte Pair Encoding (BPE) tokeniser for use with OpenAI's models.

Description source

Packages by operating system

Compare recorded versions, then open a package for dependency, file, checksum, and repository evidence. Version strings are distribution-specific, not a ranking of newer software.

Debian 13 (Trixie)

  1. Package python3-tiktoken

    trixie (Debian 13 (Trixie)) (python): fast BPE tokeniser for use with OpenAI's models

    0.9.0-1+b1: amd64 arm64

    Source: tiktoken

openSUSE Tumbleweed

  1. Package python313-tiktoken

    tumbleweed (openSUSE Tumbleweed) (Unspecified): Fast BPE tokeniser for use with OpenAI's models

    0.13.0-1.3: x86_64

    Source: python-tiktoken

  2. Package python314-tiktoken

    tumbleweed (openSUSE Tumbleweed) (Unspecified): Fast BPE tokeniser for use with OpenAI's models

    0.13.0-1.3: x86_64

    Source: python-tiktoken

Project resources and further reading

Mapping provenance

Only source-backed identity signals create public cross-OS links. A reviewer can later approve or dispute an inferred relationship without rewriting native package history.

No field-level source record is published yet.