1 comment

[ 7.0 ms ] story [ 20.9 ms ] thread
Try it out and see how fast inference can be for agentic workflows. Works on CUDA and ROCm. Feedback appreciated!