Index index by Group index by Distribution index by Vendor index by creation date index by Name Mirrors Help Search

python313-sentencepiece-0.2.3-1.1 RPM for x86_64

From OpenSuSE Tumbleweed for x86_64

Name: python313-sentencepiece Distribution: openSUSE Tumbleweed
Version: 0.2.3 Vendor: openSUSE
Release: 1.1 Build date: Sat Nov 7 13:48:59 2026
Group: Unspecified Build host: reproducible
Size: 3406228 Source RPM: python-sentencepiece-0.2.3-1.1.src.rpm
Packager: https://bugs.opensuse.org
Url: https://github.com/google/sentencepiece
Summary: Unsupervised text tokenizer and detokenizer
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for
Neural Network-based text generation systems where the vocabulary size is
predetermined prior to the neural model training. SentencePiece implements
subword units (e.g. byte-pair-encoding and unigram language model) with the
extension of direct training from raw sentences.

This package provides the Python bindings for SentencePiece.

Provides

Requires

License

Apache-2.0

Changelog

* Sat Nov 07 2026 Martin Pluskal <mpluskal@suse.com>
  - Update to 0.2.3:
    * New SentencePiece Lite zero-dependency C++20 runtime
      (header-only here; lite/ itself stays disabled)
    * Training: auto character coverage, sparse L1 Unigram pruning,
      custom pretokenizer callback, unk_id=-1 with byte fallback
    * Python: pickling preserves encode options, normalizer flag
      fixes, decode/encode edge cases, buffer-protocol inputs,
      free-threaded fixes; requires Python >= 3.10
    * Performance work plus OSS-Fuzz robustness fixes (bounds checks,
      fuzzer-timeout and input-validation hardening)
    * Removed long-deprecated APIs: SetVocabulary/ResetVocabulary/
      LoadVocabulary, SampleEncodeAndScore*, CalculateEntropy,
    * AsSerializedProto variants, OverrideNormalizerSpec and
      __getstate_for_pickle__; several TrainerSpec fields dropped
      from the spm_train flags
    * C++20 baseline; build against system protobuf 36.2 and flatc
  - Packaging: upstream no longer bundles abseil-cpp, so drop
    sentencepiece-use-bundled-abseil.patch (no longer applies) and
    vendor abseil-cpp 20260817.0, the exact upstream pin, for the
    offline FetchContent build instead
  - Add sentencepiece-system-flatc.patch (schema header from the
    system flatc, no flatbuffers clone) and
    sentencepiece-link-system-protobuf-lite.patch (link the system
    protobuf-lite into the extension)
  - Raise pybind11 floor to >= 2.13 per upstream (built against 3.1;
    upstream caps < 3.1 over a batch-decode slowdown)
* Sun Jul 12 2026 Martin Pluskal <mpluskal@suse.com>
  - Initial package python-sentencepiece 0.2.2
    * Python bindings for the SentencePiece unsupervised text tokenizer
      and detokenizer for Neural Network-based text generation
    * Add sentencepiece-use-bundled-abseil.patch to build the bundled
      abseil-cpp directly instead of git-cloning it during the build

Files

/usr/lib64/python3.13/site-packages/sentencepiece
/usr/lib64/python3.13/site-packages/sentencepiece-0.2.3.dist-info
/usr/lib64/python3.13/site-packages/sentencepiece-0.2.3.dist-info/INSTALLER
/usr/lib64/python3.13/site-packages/sentencepiece-0.2.3.dist-info/METADATA
/usr/lib64/python3.13/site-packages/sentencepiece-0.2.3.dist-info/RECORD
/usr/lib64/python3.13/site-packages/sentencepiece-0.2.3.dist-info/REQUESTED
/usr/lib64/python3.13/site-packages/sentencepiece-0.2.3.dist-info/WHEEL
/usr/lib64/python3.13/site-packages/sentencepiece-0.2.3.dist-info/top_level.txt
/usr/lib64/python3.13/site-packages/sentencepiece/__init__.py
/usr/lib64/python3.13/site-packages/sentencepiece/__init__.pyi
/usr/lib64/python3.13/site-packages/sentencepiece/__pycache__
/usr/lib64/python3.13/site-packages/sentencepiece/__pycache__/__init__.cpython-313.opt-1.pyc
/usr/lib64/python3.13/site-packages/sentencepiece/__pycache__/__init__.cpython-313.pyc
/usr/lib64/python3.13/site-packages/sentencepiece/__pycache__/_version.cpython-313.opt-1.pyc
/usr/lib64/python3.13/site-packages/sentencepiece/__pycache__/_version.cpython-313.pyc
/usr/lib64/python3.13/site-packages/sentencepiece/__pycache__/sentencepiece_model_pb2.cpython-313.opt-1.pyc
/usr/lib64/python3.13/site-packages/sentencepiece/__pycache__/sentencepiece_model_pb2.cpython-313.pyc
/usr/lib64/python3.13/site-packages/sentencepiece/__pycache__/sentencepiece_pb2.cpython-313.opt-1.pyc
/usr/lib64/python3.13/site-packages/sentencepiece/__pycache__/sentencepiece_pb2.cpython-313.pyc
/usr/lib64/python3.13/site-packages/sentencepiece/_sentencepiece.cpython-313-x86_64-linux-gnu.so
/usr/lib64/python3.13/site-packages/sentencepiece/_version.py
/usr/lib64/python3.13/site-packages/sentencepiece/package_data
/usr/lib64/python3.13/site-packages/sentencepiece/package_data/nfkc.bin
/usr/lib64/python3.13/site-packages/sentencepiece/package_data/nfkc_cf.bin
/usr/lib64/python3.13/site-packages/sentencepiece/package_data/nmt_nfkc.bin
/usr/lib64/python3.13/site-packages/sentencepiece/package_data/nmt_nfkc_cf.bin
/usr/lib64/python3.13/site-packages/sentencepiece/py.typed
/usr/lib64/python3.13/site-packages/sentencepiece/sentencepiece_model_pb2.py
/usr/lib64/python3.13/site-packages/sentencepiece/sentencepiece_pb2.py
/usr/lib64/python3.13/site-packages/sentencepiece/sentencepiece_pybind.cc
/usr/share/doc/packages/python313-sentencepiece
/usr/share/doc/packages/python313-sentencepiece/README.md
/usr/share/licenses/python313-sentencepiece
/usr/share/licenses/python313-sentencepiece/LICENSE


Generated by rpm2html 1.8.1

Fabrice Bellet, Mon Nov 9 22:58:56 2026