For anyone that finds the posted site painful on the eyes, here's another introduction to SVD that is all on one page by default and isn't crowded by advertisements.
The SVD connects the four fundamental subspaces of a linear system. I was fortunate to receive this great insight from one of Strang's lectures. I highly recommend you watch one of his videos online on this particular topic.
This post doesn't do full justice to the beauty of the SVD. Intuitively, you are trying to compute a transformation that diagonalizes the covariance matrix of the data. Computing the covariance has two problems: 1) this is a O(n^2) operation and 2) can lead to big numerical errors for really small values in the matrix.
By creative use of elementary matrix operations, the SVD gives you the transformation on the original matrix. If you are interested in just the first few singular vectors, certain math libraries also support an economical mode that does just this.
everyone loves to reference the SVD because the concepts are principled and intuitive. but i've found that, as often as it is brought up in conversation, its rarely used in practice. anyone here used SVD in a production setting?
Nonnegative matrix factorization. It was the advantages of keeping a sparse matrix sparse, can be iteratively created and generally the bellkor team's matrix factorization of choice.
Wow, this is really great. The data seems to to support the claim that politics has gotten more divisive over the past 2 decades. (I get unreasonably happy when data actually supports a broad claim). Very creative way to show this.
Have you thought about going further back? I'd be curious to see this on voting records as far back as possible, just to see what trends might have happened.
15 comments
[ 4.2 ms ] story [ 42.7 ms ] threadhttp://www.igvita.com/2007/01/15/svd-recommendation-system-i...
http://www.puffinwarellc.com/index.php/news-and-articles/art...
This post doesn't do full justice to the beauty of the SVD. Intuitively, you are trying to compute a transformation that diagonalizes the covariance matrix of the data. Computing the covariance has two problems: 1) this is a O(n^2) operation and 2) can lead to big numerical errors for really small values in the matrix.
By creative use of elementary matrix operations, the SVD gives you the transformation on the original matrix. If you are interested in just the first few singular vectors, certain math libraries also support an economical mode that does just this.
The site is currently down, google chache link: http://209.85.129.132/search?q=cache:h4Ljyun3gUcJ:sifter.org...
and its HN thread: http://news.ycombinator.com/item?id=736618
Have you thought about going further back? I'd be curious to see this on voting records as far back as possible, just to see what trends might have happened.