Anyone Can Learn to Code an LSTM-RNN (Part 1: RNN) (iamtrask.github.io) 125 points by williamtrask 10y ago ↗ HN
[–] bravo 10y ago ↗ I can't if I can't access that link. [–] williamtrask 10y ago ↗ not sure what happened...should be back up now. I'm guessing github hiccup
[–] williamtrask 10y ago ↗ not sure what happened...should be back up now. I'm guessing github hiccup
[–] make3 10y ago ↗ Some more information on LSTMs http://colah.github.io/posts/2015-08-Understanding-LSTMs/ [–] williamtrask 10y ago ↗ excellent post
[–] hellameta 10y ago ↗ This is a wonderful post. For anyone who'd like to see a nice intro to decision trees insofar as how they apply to machine learning, this is a nice post as well: http://www.r2d3.us/visual-intro-to-machine-learning-part-1/
[–] nicklo 10y ago ↗ Terrific post! Its great to see things implemented in short, 1-file programs. Tends to demystify things a lot.What did you use to make the diagrams + gifs? [–] williamtrask 10y ago ↗ Glad you liked it! For the gifs... http://makeagif.com/
[–] imh 10y ago ↗ For a more thorough intro, I can't recommend anything better than this http://arxiv.org/abs/1506.00019
[–] digisth 10y ago ↗ If you want to know more about RNNs in general, I can't recommend watching the videos/reading the notes from this course enough:http://cs224d.stanford.edu/syllabus.htmlIf you want something more basic to get your head around NNs, I recommend Denny Britz's "Neural Networks from Scratch":http://www.wildml.com/2015/09/implementing-a-neural-network-...I created a gist with a heavily commented version of his code:https://gist.github.com/sthware/c47824c116e6a61a56d9
[–] [dead] digisth 10y ago ↗ If you want to know more about RNNs in general, I can't recommend watching the videos/reading the notes from this course enough:http://cs224d.stanford.edu/syllabus.htmlIf you want something more basic to get your head around NNs, I recommend Denny Britz's "Neural Networks from Scratch":http://www.wildml.com/2015/09/implementing-a-neural-network-...I created a gist with a heavily commented version of his code:https://gist.github.com/sthware/c47824c116e6a61a56d9
[–] Houshalter 10y ago ↗ In theory yes, but these NN libraries are very difficult to set up. I remember it was a huge pain to get numpy working with lots of frustrations and learning technical things. Torch and theano are not supported on Windows at all.I've been looking at brain simulator recently. It has it's own installer and a decent GUI: http://www.goodai.com/#!brain-simulator/c81c [–] wodenokoto 10y ago ↗ http://deeplearning.net/software/theano/install_windows.htmlIt seems like theano does work on Windows, but the install looks to be quite the pita. [–] p1esk 10y ago ↗ It looks harder than it is. For me it took less than 3 minutes (I already had CUDA installed) to run the logistic regression example. [–] whatok 10y ago ↗ They also link Anaconda in there and that should get you up and running within minutes.
[–] wodenokoto 10y ago ↗ http://deeplearning.net/software/theano/install_windows.htmlIt seems like theano does work on Windows, but the install looks to be quite the pita. [–] p1esk 10y ago ↗ It looks harder than it is. For me it took less than 3 minutes (I already had CUDA installed) to run the logistic regression example. [–] whatok 10y ago ↗ They also link Anaconda in there and that should get you up and running within minutes.
[–] p1esk 10y ago ↗ It looks harder than it is. For me it took less than 3 minutes (I already had CUDA installed) to run the logistic regression example.
[–] whatok 10y ago ↗ They also link Anaconda in there and that should get you up and running within minutes.
[–] deepGem 10y ago ↗ Another fantastic resource, from a programmer's perspective. Very little math. http://karpathy.github.io/neuralnets/
15 comments
[ 10.6 ms ] story [ 46.0 ms ] threadWhat did you use to make the diagrams + gifs?
http://cs224d.stanford.edu/syllabus.html
If you want something more basic to get your head around NNs, I recommend Denny Britz's "Neural Networks from Scratch":
http://www.wildml.com/2015/09/implementing-a-neural-network-...
I created a gist with a heavily commented version of his code:
https://gist.github.com/sthware/c47824c116e6a61a56d9
http://cs224d.stanford.edu/syllabus.html
If you want something more basic to get your head around NNs, I recommend Denny Britz's "Neural Networks from Scratch":
http://www.wildml.com/2015/09/implementing-a-neural-network-...
I created a gist with a heavily commented version of his code:
https://gist.github.com/sthware/c47824c116e6a61a56d9
I've been looking at brain simulator recently. It has it's own installer and a decent GUI: http://www.goodai.com/#!brain-simulator/c81c
It seems like theano does work on Windows, but the install looks to be quite the pita.