openteamsinc
pypi/tensorrt-llm
Risk Profile
Package
Source
Risk Profile
Maturity:
Mature
Health:
Healthy
Legal:
Moderate Risk
License may have been modified from the original
License is not listed in the SPDX license list
License includes a patent grant clause
License has additional text that may require review before use
Security:
Healthy
Package
pypi
tensorrt-llm
Version
1.2.1
Last Release Date
2 days ago
License
Apache
Dependencies
accelerate
>=1.7.0
build
colored
cuda-python
>=13
diffusers
>=0.27.0
lark
mpi4py
numpy
<2
onnx
<1.20.0, >=1.18.0
onnx_graphsurgeon
>=0.5.2
openai
polygraphy
psutil
nvidia-ml-py
>=13
pulp
pandas
h5py
==3.12.1
StrEnum
sentencepiece
>=0.1.99
tensorrt
~=10.14.1
torch
<=2.10.0a0, >=2.9.1
torchvision
nvidia-modelopt
[torch]
~=0.37.0
nvidia-nccl-cu13
<=2.28.9, >=2.27.7
nvidia-cuda-nvrtc
transformers
==4.57.3
prometheus_client
prometheus_fastapi_instrumentator
pydantic
>=2.9.1
pydantic-settings
[yaml]
omegaconf
pillow
optimum
datasets
==3.1.0
evaluate
mpmath
>=1.3.0
click
click_option_group
aenum
pyzmq
fastapi
<=0.121.3, >=0.120.1
starlette
>=0.49.1
uvicorn
setuptools
<80
ordered-set
peft
patchelf
einops
flashinfer-python
==0.6.4
opencv-python-headless
xgrammar
==0.1.32
llguidance
==0.7.29
jsonschema
backoff
nvtx
matplotlib
meson
ninja
blake3
soundfile
triton
==3.5.1
tiktoken
blobfile
openai-harmony
==0.0.4
nvidia-cutlass-dsl
==4.3.4
plotly
numexpr
<2.14.0
partial_json_parser
apache-tvm-ffi
==0.1.6
torch-c-dlpack-ext
==0.1.3
mistral-common
==1.8.6
torchao
<0.16.0, >=0.14.1
etcd-sdk-python
==0.0.7
urllib3
>=2.6.3
wheel
>=0.46.2
protobuf
>=6.33.5
aiohttp
>=3.13.3
tornado
>=6.5.5
black
>=26.3.1
devel:
einops
graphviz
mypy
mako
oyaml
parameterized
pre-commit
pybind11
pybind11-stubgen
pytest
pytest-asyncio
pytest-cov
pytest-csv
pytest-env
pytest-forked
pytest-xdist
pytest-timeout
pytest-split
pytest-mock
pytest-threadleak
rouge_score
cloudpickle
typing-extensions
==4.12.2
bandit
==1.7.7
jsonlines
==4.0.0
jieba
==0.42.1
rouge
==1.0.1
pytest-rerunfailures
ruff
==0.9.4
lm_eval
[api]
==0.4.9.1
docstring_parser
genai-perf
==0.0.13
opentelemetry-sdk
>=1.26.0
opentelemetry-api
>=1.26.0
opentelemetry-exporter-otlp
>=1.26.0
opentelemetry-semantic-conventions-ai
>=0.4.1
fuzzywuzzy
==0.18.0
aiperf
==0.4.0
nanobind
>=2.9.0
Source
Location
NVIDIA/TensorRT-LLM
Last Source Update
about 5 hours ago
Licenses
Apache License 2.0
(text added)
MIT
(modified)
BSD 3-Clause "New" or "Revised" License
Distribution Destinations
pypi/tensorrt-llm
pypi/docs
pypi/trtllm-sbom
pypi/apps-examples
pypi/eagle-examples
pypi/ngram-examples
pypi/serve-examples
pypi/triton-backend
pypi/medusa-examples
pypi/tensorrt-llm-bench
pypi/e2b
pypi/longbench-examples
pypi/lookahead-examples
pypi/redrafter-examples
pypi/unknown-package
pypi/auto-deploy-examples
pypi/trtllm-eval-examples
pypi/quantization-examples
pypi/mcp
pypi/websearch
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/ray-orchestrator-examples
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/draft-target-model-examples
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/tavilymcp
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/unknown-package
pypi/flash-attn-cute
