openteamsinc
pypi/lighteval
Risk Profile
Package
Source
Risk Profile
Maturity:
Mature
Health:
Healthy
Legal:
Healthy
Security:
Healthy
Package
pypi
lighteval
Version
0.13.0
Last Release Date
7 days ago
License
MIT
Dependencies
transformers
>=4.54.0
inspect-ai
>=0.3.140
openai
accelerate
huggingface_hub
[hf_xet]
>=0.30.2
torch
<3.0, >=2.0
GitPython
>=3.1.41
datasets
>=4.0.0
pydantic
numpy
>=2
hf-xet
>=1.1.8
typer
>=0.20.0
termcolor
==2.3.0
pytablewriter
rich
colorlog
aenum
==3.1.15
nltk
==3.9.1
scikit-learn
sacrebleu
rouge_score
==0.1.2
sentencepiece
>=0.1.99
protobuf
pycountry
fsspec
>=2023.12.2
httpx
>=0.27.2
latex2sympy2_extended
==1.0.6
langcodes
litellm:
litellm
[caching]
>=1.66.0
diskcache
tgi:
text-generation
>=0.7.0
optimum:
optimum
==1.12.0
quantization:
bitsandbytes
>=0.41.0
auto-gptq
>=0.4.2
adapters:
peft
==0.3.0
nanotron:
nanotron
tensorboardX
tensorboardx:
tensorboardX
vllm:
vllm
<0.10.2, >=0.10.0
ray
more_itertools
sglang:
sglang
quality:
ruff
>=v0.11.0
pre-commit
tests:
pytest
>=7.4.0
deepdiff
pip
>=25.2
dev:
lighteval
[accelerate,extended_tasks,math,multilingual,quality,tests,vllm]
docs:
hf-doc-builder
watchdog
extended-tasks:
langdetect
openai
>1.87
tiktoken
emoji
spacy
syllapy
evaluate
s3:
s3fs
multilingual:
stanza
spacy
[ja,ko,th]
>=3.8.0
jieba
pyvi
math:
latex2sympy2_extended
==1.0.6
wandb:
wandb
trackio:
trackio
Source
Location
huggingface/lighteval
Last Source Update
3 days ago
Licenses
MIT License
Distribution Destinations
pypi/lighteval
