1 comment

[ 3.5 ms ] story [ 14.3 ms ] thread
>Sadly there is no other tokenizer as smart as standard and as permissive as whitespace, if you feel like writing one, be my guest!

The only good thing that could come out of that article and it's missing...