This is an awesome resource that I keep coming back to again and again. Save this somewhere on your computer so you'll have it handy whenever you see some weird matrix derivative...
I used to use this a bunch when calculating gradient descent algorithms, but I've since moved to using libraries with auto-differentiation (numpy with autodiff or theano) and it's a huge force multiplier for my work (not to mention GPU implementations basically for free).
Of course there's always some derivation that's easiest done by hand.
10 comments
[ 1.8 ms ] story [ 34.1 ms ] threadOf course there's always some derivation that's easiest done by hand.
(I think there's vid on youtube)