Yes! https://github.com/deepset-ai/haystack
Haystack Agents are designed in a way so that you can easily use them with different LLM providers. You just need to implement one standardized wrapper class for your modelprovider of choice…
That's right. If you want to ask questions about "general public knowledge", a plain LLM will know anyway and would not need tools. However, for many use cases you need data from your private CRM / a SQL db / a private…
Haystack's agent is indeed using the approach suggested in the ReAct paper
The demo corpus there just contains documents about countries and capital cities. So you could try asking questions like "What's the climate of Beijing?" or "How many people live in the capital of the US?".
Semantic document search is one of the core use cases we see in the community (besides Question Answering) and Haystack was pretty much started because we saw that you need much more than just models. It's so much pain…
Yep, you want a GPU for many of the models. However, then subsecond queries are easy to achieve. See benchmarks: https://haystack.deepset.ai/benchmarks/latest
Yes! https://github.com/deepset-ai/haystack
Haystack Agents are designed in a way so that you can easily use them with different LLM providers. You just need to implement one standardized wrapper class for your modelprovider of choice…
That's right. If you want to ask questions about "general public knowledge", a plain LLM will know anyway and would not need tools. However, for many use cases you need data from your private CRM / a SQL db / a private…
Haystack's agent is indeed using the approach suggested in the ReAct paper
The demo corpus there just contains documents about countries and capital cities. So you could try asking questions like "What's the climate of Beijing?" or "How many people live in the capital of the US?".
Semantic document search is one of the core use cases we see in the community (besides Question Answering) and Haystack was pretty much started because we saw that you need much more than just models. It's so much pain…
Yep, you want a GPU for many of the models. However, then subsecond queries are easy to achieve. See benchmarks: https://haystack.deepset.ai/benchmarks/latest