2 comments

[ 3.1 ms ] story [ 13.5 ms ] thread
(comment deleted)
> Limit additional context in retrieval-augmented generation (RAG): When providing additional context or documents, include only the most relevant information to prevent the model from overcomplicating its response.

This databricks blog/paper seemingly contradicts this:

> OpenAI o1 models show a consistent improvement over Anthropic and Google models on our long context RAG Benchmark up to 128k tokens.

https://www.databricks.com/blog/long-context-rag-capabilitie...