Show HN: Building an LLM from Scratch in TypeScript (book.humanexperiences.io)

2 points by baraa_ ↗ HN
I wanted to understand transformers at a level where nothing is magic, so I'm building a ChatGPT-style model from first principles in TypeScript. Why not Python? I've found that reimplementing concepts in a different language forces me to grasp the nuance of the implementation. Chapters cover dataloaders, embeddings, and the attention mechanism so far. Feedback welcome if anything's unclear.

6 comments

[ 2.2 ms ] story [ 14.2 ms ] thread
Why does it start at Chapter 2? Is it one of those JavaScript integer quirks?
Chapter 1 exists. It's just a Promise that never resolved