spruce_tips

I've tried it, and wasn't really impressed. Curious if and how teams/individuals here are actually using it, and why!

Like many of you, I'm streaming responses token by token from LLMs using server sent events (SSEs). What's the best way to maintain the SSE connection through a page refresh? I haven't seen a lot of documentation or…

Like many of you, I'm streaming responses token by token from LLMs using server sent events (SSEs). What's the best way to maintain the SSE connection through a page refresh? I haven't seen a lot of documentation or…

I've worked a good bit with embedding strategies for RAG. But they've only been for documents that are identical in structure i.e. interview transcripts. I'm curious how others have thought about handling embeddings for…

My project has a multi step LLM flow using gpt-4o. While developing new features/testing locally, the LLM flow frequently runs, and I use a bunch of tokens. My openAI bill spikes. I've made some efforts to stub LLM…

Hey HN! I’m excited to show off a small project I’ve been tinkering with called redecibel. redecibel lets you listen to text to speech content in your podcast player. Your audio gets published to your own private RSS…