Infini-Gram: Scaling unbounded n-gram language models to a trillion tokens (arxiv.org)

I'm surprised that this doesn't cite Frank Wood and et al. work on the Sequence Memoizer: https://dl.acm.org/doi/10.1145/1897816.1897842