1 comment

[ 0.20 ms ] story [ 15.1 ms ] thread
Hi, this is an implementation from scratch - the goal was to become more familiar with how the transformer model works. Also, I implemented inference of the GPT-J model which is quite similar to GPT-2 - it's another example in the same repository.