2D Tokenization for Large Language Models (david-gilbertson.medium.com)

This article is about how we process text before passing it to large language models, the problems with this approach, and an alternative solution.