hessdalenlight
- Karma
- 0
- Created
- ()
- Submissions
- 0
- Show HN: Chonky – a neural text semantic chunking goes multilingual (huggingface.co)
TLDR: I’m expanding the family of text-splitting Chonky models with new multilingual model. You can learn more about this neural approach in a previous post: https://news.ycombinator.com/item?id=43652968 Since the…
-
TLDR: I’ve made a transformer model and a wrapper library that segments text into meaningful semantic chunks. The current text splitting approaches rely on heuristics (although one can use neural embedder to group…