Tokenizer Mono (george.mand.is)

1 points by georgemandis 4d ago ↗ HN

2 comments

[ 1.9 ms ] story [ 5.6 ms ] thread

georgemandis 4d ago ↗

A font that visualizes how LLMs tokenize text

[dead] SlightGenius 4d ago ↗

[dead]