This is a great article. The author breaks down key advancements in AI--from Nvidia's release of CUDA in 2006, deep learning using CNNs in 2012, followed by recent language translation models and their shortcomings.
The coverage of transformers is particularly well-done, including their novel approach to language translation and their generality.
Quanta Magazine has covered transformers as well [1,2].
1 comment
[ 3.3 ms ] story [ 14.9 ms ] threadThe coverage of transformers is particularly well-done, including their novel approach to language translation and their generality.
Quanta Magazine has covered transformers as well [1,2].
[1] Will Transformers Take Over Artificial Intelligence? - https://www.quantamagazine.org/will-transformers-take-over-a...
[2] How Transformers Seem to Mimic Parts of the Brain - https://www.quantamagazine.org/how-ai-transformers-mimic-par...