[–] ernsheong 1mo ago ↗ Hey there, nice one. Care to share a bit what is under the hood? What are the challenges of local AI? It is RAG-ging? What small models do you use? [–] jmathai 1mo ago ↗ To avoid misquoting scripture it’s using a couple techniques including tool calls for grounding and a client-side parsing layer to find and replace citations.It currently uses deepseek flash. We’ll evaluate local models in the future.
[–] jmathai 1mo ago ↗ To avoid misquoting scripture it’s using a couple techniques including tool calls for grounding and a client-side parsing layer to find and replace citations.It currently uses deepseek flash. We’ll evaluate local models in the future.
2 comments
[ 3.1 ms ] story [ 6.9 ms ] threadIt currently uses deepseek flash. We’ll evaluate local models in the future.