Arithmetic Without Algorithms: LLMs Solve Math with a Bag of Heuristics (arxiv.org)

I would have never guessed that networks that exist solely to approximate functions work on heuristics...