Ask HN: What RAG setup gets me 95% of the way there? 6 points by uptownfunk 2y ago ↗ HN Alternatively what is your RAG set up?
[–] cmcollier 2y ago ↗ This will get you the first 80%:* Any solid search engine (bm25 + embeddings and hnsw)* Any api to a model (gpt3.5, gpt4, claude, etc)* Some middleware to call search then build the promptThen the remaining:* Create an eval dataset, then tune the search and the prompt as needed
[–] softwaredoug 2y ago ↗ Couldn’t put it better than this posthttps://www.linkedin.com/posts/softwaredoug_absolutely-kille...
5 comments
[ 2.8 ms ] story [ 25.1 ms ] thread* Any solid search engine (bm25 + embeddings and hnsw)
* Any api to a model (gpt3.5, gpt4, claude, etc)
* Some middleware to call search then build the prompt
Then the remaining:
* Create an eval dataset, then tune the search and the prompt as needed
https://www.linkedin.com/posts/softwaredoug_absolutely-kille...