openteamsinc
pypi/tensorrt-llm
Risk Profile
Package
Source
Risk Profile
Maturity:
Mature
Health:
Healthy
Legal:
Caution Needed
License has additional text that may require review before use
License includes a patent grant clause
Security:
Healthy
Package
pypi
tensorrt-llm
Version
1.1.0
Last Release Date
about 1 month ago
License
Apache
Dependencies
accelerate
>=1.7.0
build
colored
cuda-python
>=13
diffusers
>=0.27.0
lark
mpi4py
numpy
<2
onnx
<1.20.0, >=1.18.0
onnx_graphsurgeon
>=0.5.2
openai
polygraphy
psutil
nvidia-ml-py
>=13
pulp
pandas
h5py
==3.12.1
StrEnum
sentencepiece
>=0.1.99
tensorrt
~=10.13.3
torch
<=2.9.0, >=2.9.0a0
torchvision
nvidia-modelopt
[torch]
~=0.37.0
nvidia-nccl-cu13
==2.27.7
nvidia-cuda-nvrtc
transformers
==4.56.0
prometheus_client
prometheus_fastapi_instrumentator
pydantic
>=2.9.1
pydantic-settings
[yaml]
omegaconf
pillow
wheel
<=0.45.1
optimum
datasets
==3.1.0
evaluate
mpmath
>=1.3.0
click
click_option_group
aenum
pyzmq
fastapi
<=0.121.3, >=0.120.1
starlette
>=0.49.1
uvicorn
setuptools
<80
ordered-set
peft
patchelf
==0.18.0
einops
flashinfer-python
<0.4.0, >=0.3.0
opencv-python-headless
xgrammar
==0.1.25
llguidance
==0.7.29
jsonschema
backoff
nvtx
matplotlib
meson
ninja
etcd3
blake3
soundfile
triton
==3.5.0
tiktoken
blobfile
openai-harmony
==0.0.4
nvidia-cutlass-dsl
==4.2.1
numexpr
<2.14.0
urllib3
>=2.6.0
devel:
einops
graphviz
mypy
mako
oyaml
parameterized
pre-commit
pybind11
pybind11-stubgen
pytest
pytest-asyncio
pytest-cov
pytest-csv
pytest-env
pytest-forked
pytest-xdist
pytest-timeout
pytest-split
pytest-mock
pytest-threadleak
rouge_score
cloudpickle
typing-extensions
==4.12.2
bandit
==1.7.7
jsonlines
==4.0.0
jieba
==0.42.1
rouge
==1.0.1
pytest-rerunfailures
ruff
==0.9.4
lm_eval
[api]
==0.4.8
docstring_parser
genai-perf
==0.0.13
Source
Location
NVIDIA/TensorRT-LLM
Last Source Update
about 3 hours ago
Licenses
Apache License 2.0
(text added)
Distribution Destinations
pypi/tensorrt-llm
pypi/docs
pypi/apps-examples
pypi/eagle-examples
pypi/ngram-examples
pypi/serve-examples
pypi/triton-backend
pypi/medusa-examples
pypi/tensorrt-llm-bench
pypi/e2b
pypi/longbench-examples
pypi/lookahead-examples
pypi/redrafter-examples
pypi/unknown-package
pypi/auto-deploy-examples
pypi/trtllm-eval-examples
pypi/quantization-examples
pypi/mcp
pypi/websearch
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/ray-orchestrator-examples
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/draft-target-model-examples
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/tavilymcp
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package