From Text to Token: How Tokenization Pipelines Work (paradedb.com) 2 points by jamesgresql 11mo ago ↗ HN
[–] jamesgresql 11mo ago ↗ The original title of this post was "When Tokenization Becomes Token", but nobody got it.I'm curious, after reading this article how many people can tell me why that title would have been great?(also I'd love feedback on the interactive components, I think they came out well!) [–] anonymoushn 11mo ago ↗ hello. it would be great because it celebrates the total destruction of the search capabilities of the tool, just like the article does.
[–] anonymoushn 11mo ago ↗ hello. it would be great because it celebrates the total destruction of the search capabilities of the tool, just like the article does.
2 comments
[ 2.3 ms ] story [ 19.9 ms ] threadI'm curious, after reading this article how many people can tell me why that title would have been great?
(also I'd love feedback on the interactive components, I think they came out well!)