openteamsinc
pypi/tokenizers
Risk Profile
Package
Source
Risk Profile
Maturity:
Mature
Health:
Healthy
Legal:
Caution Needed
License includes a patent grant clause
Security:
Healthy
Package
pypi
tokenizers
Version
0.21.2
Last Release Date
23 days ago
License
Apache
Dependencies
huggingface-hub
<1.0, >=0.16.4
testing:
pytest
requests
numpy
datasets
black
==22.3
ruff
docs:
sphinx
sphinx-rtd-theme
setuptools-rust
dev:
tokenizers
[testing]
Source
Location
huggingface/tokenizers
Last Source Update
13 days ago
Licenses
Apache License 2.0
Apache License 2.0
MIT License
Distribution Destinations
pypi/tokenizers
npm/tokenizers
npm/tokenizers-darwin-x64
npm/tokenizers-freebsd-x64
npm/tokenizers-darwin-arm64
npm/tokenizers-android-arm64
npm/tokenizers-linux-x64-gnu
npm/tokenizers-linux-x64-musl
npm/tokenizers-win32-x64-msvc
npm/tokenizers-linux-arm64-gnu
npm/tokenizers-win32-ia32-msvc
npm/tokenizers-android-arm-eabi
npm/tokenizers-linux-arm64-musl
npm/tokenizers-win32-arm64-msvc
npm/tokenizers-linux-arm-gnueabihf
npm/create-wasm-app
