jaymody
No user record in our sample, but jaymody has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
No user record in our sample, but jaymody has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
I wrote an article that attempts to explain attention in a more intuitive manner, without any PyTorch or other deep learning specific context: https://jaykmody.com/blog/attention-intuition/
I wrote a minimal implementation in NumPy here (the forward pass code is only 40 lines): https://github.com/jaymody/picoGPT And also a related blog post: https://news.ycombinator.com/item?id=34726115 Although this is…