EmptyDrum

↗ HN profile [ 27.2 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. 6 months ago a few people [https://news.ycombinator.com/item?id=44940089] agreed that LLMs are very good at translating Pseudo-code to real code. I agree. Also, writing pseudo code somewhat makes me feel a similar state…

  2. agents. Not a custom truncation strategy, not a sliding window, not dropping old messages and hoping for the best. The failure mode is well-understood: your context window fills up, you truncate from the top, and the…

  3. I think in-process key management is the right abstraction for multi-key LLM setups. Not LiteLLM, not a Redis queue, not a custom load balancer. The failure modes are well-understood: a key gets rate-limited, you wait,…