2 comments

[ 0.21 ms ] story [ 17.6 ms ] thread
I really like this trend of large research group writing more about the difficulties they encountered along the way.

Meta had also released a (much more detailed) "Logbook" when they published their 175b models in May: https://github.com/facebookresearch/metaseq/blob/main/projec...

For example I somehow expected a Chinese research group with such a proven track record to be showered in compute by the government...

Does anyone know what makes it different from the recently published Bloom? Bloom released an ethical charter that established the values they hold onto regarding the development and deployment of these technologies. Is there a framework that allows one to compare these developmnents?