Show HN: SynapseKit – Async-native Python framework for LLM pipelines and agents (github.com) 4 points by aminau 5mo ago ↗ HN
[–] grimmai143 5mo ago ↗ Async is definitely the right approach for this, but how are you handling the event loop blocking if a local model takes way too long to generate a heavy sequence?
3 comments
[ 3.1 ms ] story [ 18.8 ms ] thread