Show HN: Visualize how you split your document into chunks for RAG applications (huggingface.co)

2 points by aubanel ↗ HN
To create a LLM based Retrieval Augmented Generation, you need to create a retriever par which is basically an internal search on document excerpts from your knowledge base. The snippets to search on should be meaningful, not too large an not too small: thus choosing a correct splitting method is crucial. I've created a tool that lets you visualize how your choices of splitting criteria determine the chunks you get!

0 comments

[ 3.1 ms ] story [ 7.2 ms ] thread

No comments yet.