tokenizers 1.0.0rc5Source: pypi.orgPublished Nov 20, 2026 (UTC)Read original sourceAt a glanceReworked tokenizers Python bindings, over the pipeline encode path (not for release yet)