https://jaykmody.com
Author here. It's a design choice, but there's two reasons I chose to use imports like this: 1) For demonstrative purposes. The title of the post is `A GPT in 60 Lines of NumPy`, I kinda wanted to show "hey it's just…
Hey ya'll author here! Thank you for all the nice and constructive comments! For clarity, this is ONLY the forward pass of the model. There's no training code, batching, kv cache for efficiency, GPU support, etc ... The…
https://jaykmody.com
Author here. It's a design choice, but there's two reasons I chose to use imports like this: 1) For demonstrative purposes. The title of the post is `A GPT in 60 Lines of NumPy`, I kinda wanted to show "hey it's just…
Hey ya'll author here! Thank you for all the nice and constructive comments! For clarity, this is ONLY the forward pass of the model. There's no training code, batching, kv cache for efficiency, GPU support, etc ... The…