Some notes on the internal implementation of mathematica (reference.wolfram.com)

I think the biggest takeaway is just how big it is; for instance:

> Expression formatting uses several thousand pages of C++ code.

That's an order of magnitude larger than TeX.