Ask HN: How do we reduce latency for AI applications? 4 points by MrAR 1y ago ↗ HN I am connecting 3-4 AI models serially, such that output of one model is fed as input of another model. I am getting a lot of latency, even after using GPUs, how to reduce it?
1 comment
[ 2.7 ms ] story [ 11.2 ms ] thread