"TL;DR" on Recent Transformers Papers

4 points by wilhelm____ ↗ HN
With the explosion in research on all things transformers, it seemed there was a need to have a single table to distill the "tl;dr" of each paper's contributions relative to each other. Here is what I got so far: https://github.com/will-thompson-k/tldr-transformers . Would love feedback - and feel free to contribute too :)

2 comments

[ 3.0 ms ] story [ 17.1 ms ] thread
There's a great survey of transformers paper: https://arxiv.org/abs/2106.04554

It's longer but more in depth than the repo which you linked.

yep that is a good one. The goal of this repo to have a bird's eye view of different papers as I read them and to distill that info into one table.