2 comments

[ 3.6 ms ] story [ 18.3 ms ] thread
(comment deleted)
> Limit additional context in retrieval-augmented generation (RAG): When providing additional context or documents, include only the most relevant information to prevent the model from overcomplicating its response.

This databricks blog/paper seemingly contradicts this:

> OpenAI o1 models show a consistent improvement over Anthropic and Google models on our long context RAG Benchmark up to 128k tokens.

https://www.databricks.com/blog/long-context-rag-capabilitie...