Show HN: Incremental JSON parser for streaming LLM tool calls in Ruby (aha.io)

13 points by hotk ↗ HN
Built this for streaming AI tool calls. LLMs stream function arguments as JSON character-by-character. Most parsers reparse from scratch each time - O(n²) behavior that causes UI lag.

This maintains parsing state, processing only new characters. True O(n) performance that stays imperceptible throughout the entire response.

Ruby gem, MIT licensed. Would love feedback.

0 comments

[ 1.0 ms ] story [ 7.2 ms ] thread

No comments yet.