Linux workstation

Upstream software project

sentencepiece

Unsupervised text tokenizer and detokenizer

About sentencepiece

Unsupervised text tokenizer and detokenizer

This project links 18 native package records across 5 recorded operating-system releases. Compare the retained versions and architectures below, then open the package for your own release.

These are catalog observations, not a guarantee of installation, compatibility, or upstream support.

Visit project website

Project pictures and package coverage

sentencepiece repository preview from GitHub
Project repository preview, supplied by GitHub. Open source repository
Debian 12 (Bookworm): 4 package records; Debian 13 (Trixie): 4 package records; Fedora 43: 4 package records; Fedora 44: 4 package records; openSUSE Tumbleweed: 2 package records. Catalog coverage diagram, not an application screenshot.sentencepiece: recorded package coverageDebian 12 (Bookworm)4 recordsDebian 13 (Trixie)4 recordsFedora 434 recordsFedora 444 recordsopenSUSE Tumbleweed2 records
OpenFactory diagram of linked package records. It is not an application screenshot.

Project identity

Project
sentencepiece
Publisher
Not authoritatively mapped
Native package records
18
Operating systems
debian-12, debian-13, fedora-43, fedora-44, opensuse-tumbleweed
License expression
Apache-2.0
Metadata completeness
100/100 (not a software quality rating)
Homepage
Visit upstream site
Source repository
Open source repository

Source-reported description

The fullest retained description is shown with its source. Distribution packaging descriptions may include downstream details.

SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g. byte-pair-encoding and unigram language model) with the extension of direct training from raw sentences. This package provides the Python bindings for SentencePiece.

Description source

Packages by operating system

Compare recorded versions, then open a package for dependency, file, checksum, and repository evidence. Version strings are distribution-specific, not a ranking of newer software.

Debian 12 (Bookworm)

  1. libsentencepiece0

    Debian 12 (Bookworm) / libs / source sentencepiece

    0.1.97-3+b1

    Library files of SentencePiece

    amd64arm64bookworm
  2. libsentencepiece-dev

    Debian 12 (Bookworm) / libdevel / source sentencepiece

    0.1.97-3+b1

    Header files of SentencePiece

    amd64arm64bookworm
  3. python3-sentencepiece

    Debian 12 (Bookworm) / python / source sentencepiece

    0.1.97-3+b1

    SentencePiece binding for Python3

    amd64arm64bookworm
  4. sentencepiece

    Debian 12 (Bookworm) / science / source sentencepiece

    0.1.97-3+b1

    Unsupervised text tokenizer and detokenizer

    amd64arm64bookworm

Debian 13 (Trixie)

  1. libsentencepiece0

    Debian 13 (Trixie) / libs / source sentencepiece

    0.2.0-1+b4

    Library files of SentencePiece

    amd64arm64trixie
  2. libsentencepiece-dev

    Debian 13 (Trixie) / libdevel / source sentencepiece

    0.2.0-1+b4

    Header files of SentencePiece

    amd64arm64trixie
  3. python3-sentencepiece

    Debian 13 (Trixie) / python / source sentencepiece

    0.2.0-1+b4

    SentencePiece binding for Python3

    amd64arm64trixie
  4. sentencepiece

    Debian 13 (Trixie) / science / source sentencepiece

    0.2.0-1+b4

    Unsupervised text tokenizer and detokenizer

    amd64arm64trixie

Fedora 43

  1. python3-sentencepiece

    Fedora 43 / Unspecified / source sentencepiece

    0.2.0-8.fc43

    Python module for SentencePiece

    aarch64x86_6443
  2. sentencepiece-devel

    Fedora 43 / Unspecified / source sentencepiece

    0.2.0-8.fc43

    Libraries and header files for SentencePiece

    aarch64i686x86_6443
  3. sentencepiece-libs

    Fedora 43 / Unspecified / source sentencepiece

    0.2.0-8.fc43

    Runtime libraries for SentencePiece

    aarch64i686x86_6443
  4. sentencepiece-tools

    Fedora 43 / Unspecified / source sentencepiece

    0.2.0-8.fc43

    Tools for SentencePiece

    aarch64x86_6443

Fedora 44

  1. python3-sentencepiece

    Fedora 44 / Unspecified / source sentencepiece

    0.2.1-1.fc44

    Python module for SentencePiece

    aarch64x86_6444
  2. sentencepiece-devel

    Fedora 44 / Unspecified / source sentencepiece

    0.2.1-1.fc44

    Libraries and header files for SentencePiece

    aarch64i686x86_6444
  3. sentencepiece-libs

    Fedora 44 / Unspecified / source sentencepiece

    0.2.1-1.fc44

    Runtime libraries for SentencePiece

    aarch64i686x86_6444
  4. sentencepiece-tools

    Fedora 44 / Unspecified / source sentencepiece

    0.2.1-1.fc44

    Tools for SentencePiece

    aarch64x86_6444

openSUSE Tumbleweed

  1. python313-sentencepiece

    openSUSE Tumbleweed / Unspecified / source python-sentencepiece

    0.2.2-1.2

    Unsupervised text tokenizer and detokenizer

    x86_64tumbleweed
  2. python314-sentencepiece

    openSUSE Tumbleweed / Unspecified / source python-sentencepiece

    0.2.2-1.2

    Unsupervised text tokenizer and detokenizer

    x86_64tumbleweed

Project resources and further reading

Mapping provenance

Only source-backed identity signals create public cross-OS links. A reviewer can later approve or dispute an inferred relationship without rewriting native package history.

No field-level source record is published yet.