retrovrv
- Karma
- 0
- Created
- ()
- Submissions
- 0
-
Hey HN! Long-time reader, occasional commenter here. I wanted to share something my team and I have been building to solve our own frustrations. We've all seen the explosion of prompt engineering tools lately. While…
- GPT-4 is Getting Faster (portkey.ai)
- Open Source AI Gateway (github.com)
-
There's ollama/ggml etc for local setup, but other than Replicate, what are the other options for hosting Llama 2?
-
Once we accept that LLMs can sometimes hallucinate, we're left with other integration hurdles when incorporating them into apps: - Inconsistent APIs across different LLMs - Not entirely reliable - Higher latencies - The…
- Neat implementation of semantic cache for GPT4 (portkey.ai)