1 comment

[ 1.6 ms ] story [ 12.4 ms ] thread
Try it out and see how fast inference can be for agentic workflows. Works on CUDA and ROCm. Feedback appreciated!