Nvidia Releases TensorRT-LLM (github.com)

2 points by hkab 2y ago ↗ HN

1 comment

[ 5.9 ms ] story [ 9.8 ms ] thread

hkab 2y ago ↗

Performance: https://github.com/NVIDIA/TensorRT-LLM/blob/release/0.5.0/do...