| Index | index by Group | index by Distribution | index by Vendor | index by creation date | index by Name | Mirrors | Help | Search |
| Name: python314-sentencepiece | Distribution: openSUSE Tumbleweed |
| Version: 0.2.3 | Vendor: openSUSE |
| Release: 1.1 | Build date: Sat Nov 7 13:48:59 2026 |
| Group: Unspecified | Build host: reproducible |
| Size: 3407095 | Source RPM: python-sentencepiece-0.2.3-1.1.src.rpm |
| Packager: https://bugs.opensuse.org | |
| Url: https://github.com/google/sentencepiece | |
| Summary: Unsupervised text tokenizer and detokenizer | |
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g. byte-pair-encoding and unigram language model) with the extension of direct training from raw sentences. This package provides the Python bindings for SentencePiece.
Apache-2.0
* Sat Nov 07 2026 Martin Pluskal <mpluskal@suse.com>
- Update to 0.2.3:
* New SentencePiece Lite zero-dependency C++20 runtime
(header-only here; lite/ itself stays disabled)
* Training: auto character coverage, sparse L1 Unigram pruning,
custom pretokenizer callback, unk_id=-1 with byte fallback
* Python: pickling preserves encode options, normalizer flag
fixes, decode/encode edge cases, buffer-protocol inputs,
free-threaded fixes; requires Python >= 3.10
* Performance work plus OSS-Fuzz robustness fixes (bounds checks,
fuzzer-timeout and input-validation hardening)
* Removed long-deprecated APIs: SetVocabulary/ResetVocabulary/
LoadVocabulary, SampleEncodeAndScore*, CalculateEntropy,
* AsSerializedProto variants, OverrideNormalizerSpec and
__getstate_for_pickle__; several TrainerSpec fields dropped
from the spm_train flags
* C++20 baseline; build against system protobuf 36.2 and flatc
- Packaging: upstream no longer bundles abseil-cpp, so drop
sentencepiece-use-bundled-abseil.patch (no longer applies) and
vendor abseil-cpp 20260817.0, the exact upstream pin, for the
offline FetchContent build instead
- Add sentencepiece-system-flatc.patch (schema header from the
system flatc, no flatbuffers clone) and
sentencepiece-link-system-protobuf-lite.patch (link the system
protobuf-lite into the extension)
- Raise pybind11 floor to >= 2.13 per upstream (built against 3.1;
upstream caps < 3.1 over a batch-decode slowdown)
* Sun Jul 12 2026 Martin Pluskal <mpluskal@suse.com>
- Initial package python-sentencepiece 0.2.2
* Python bindings for the SentencePiece unsupervised text tokenizer
and detokenizer for Neural Network-based text generation
* Add sentencepiece-use-bundled-abseil.patch to build the bundled
abseil-cpp directly instead of git-cloning it during the build
/usr/lib64/python3.14/site-packages/sentencepiece /usr/lib64/python3.14/site-packages/sentencepiece-0.2.3.dist-info /usr/lib64/python3.14/site-packages/sentencepiece-0.2.3.dist-info/INSTALLER /usr/lib64/python3.14/site-packages/sentencepiece-0.2.3.dist-info/METADATA /usr/lib64/python3.14/site-packages/sentencepiece-0.2.3.dist-info/RECORD /usr/lib64/python3.14/site-packages/sentencepiece-0.2.3.dist-info/REQUESTED /usr/lib64/python3.14/site-packages/sentencepiece-0.2.3.dist-info/WHEEL /usr/lib64/python3.14/site-packages/sentencepiece-0.2.3.dist-info/top_level.txt /usr/lib64/python3.14/site-packages/sentencepiece/__init__.py /usr/lib64/python3.14/site-packages/sentencepiece/__init__.pyi /usr/lib64/python3.14/site-packages/sentencepiece/__pycache__ /usr/lib64/python3.14/site-packages/sentencepiece/__pycache__/__init__.cpython-314.opt-1.pyc /usr/lib64/python3.14/site-packages/sentencepiece/__pycache__/__init__.cpython-314.pyc /usr/lib64/python3.14/site-packages/sentencepiece/__pycache__/_version.cpython-314.opt-1.pyc /usr/lib64/python3.14/site-packages/sentencepiece/__pycache__/_version.cpython-314.pyc /usr/lib64/python3.14/site-packages/sentencepiece/__pycache__/sentencepiece_model_pb2.cpython-314.opt-1.pyc /usr/lib64/python3.14/site-packages/sentencepiece/__pycache__/sentencepiece_model_pb2.cpython-314.pyc /usr/lib64/python3.14/site-packages/sentencepiece/__pycache__/sentencepiece_pb2.cpython-314.opt-1.pyc /usr/lib64/python3.14/site-packages/sentencepiece/__pycache__/sentencepiece_pb2.cpython-314.pyc /usr/lib64/python3.14/site-packages/sentencepiece/_sentencepiece.cpython-314-x86_64-linux-gnu.so /usr/lib64/python3.14/site-packages/sentencepiece/_version.py /usr/lib64/python3.14/site-packages/sentencepiece/package_data /usr/lib64/python3.14/site-packages/sentencepiece/package_data/nfkc.bin /usr/lib64/python3.14/site-packages/sentencepiece/package_data/nfkc_cf.bin /usr/lib64/python3.14/site-packages/sentencepiece/package_data/nmt_nfkc.bin /usr/lib64/python3.14/site-packages/sentencepiece/package_data/nmt_nfkc_cf.bin /usr/lib64/python3.14/site-packages/sentencepiece/py.typed /usr/lib64/python3.14/site-packages/sentencepiece/sentencepiece_model_pb2.py /usr/lib64/python3.14/site-packages/sentencepiece/sentencepiece_pb2.py /usr/lib64/python3.14/site-packages/sentencepiece/sentencepiece_pybind.cc /usr/share/doc/packages/python314-sentencepiece /usr/share/doc/packages/python314-sentencepiece/README.md /usr/share/licenses/python314-sentencepiece /usr/share/licenses/python314-sentencepiece/LICENSE
Generated by rpm2html 1.8.1
Fabrice Bellet, Mon Nov 9 22:58:56 2026