HN Explorer

InkCanon

↗ HN profile [ 1852 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. Ask HN: How to increase LLM inference speed?

    Hi HN, I'm building software that has a very tight feedback loop with the user. One part involves a short (few hundred tokens) response from an LLM. By far this is the biggest UX problem - currently DeepSeek's total…

    3 points 1