1 comment

[ 3.1 ms ] story [ 10.1 ms ] thread
I've been building neural nets in Python & Pytorch for a while but felt like I truly appreciate what was happening under the covers. So I set out to build an autograd engine from scratch in Rust.

This blog is a step-by-step tutorial on how to build nanograd in about 300 lines of code. The github repo is in the blog as well.