Making sense of principal component analysis, eigenvectors and eigenvalues (stats.stackexchange.com)

This has been submitted several times before (unsurprisingly! it's an extremely good piece of technical writing) but never discussed. Let's see if the nth time is the charm.