[–] JohnJamesRambo 4y ago ↗ Can anyone provide insight on what kind of hardware Lamda runs on?https://www.documentcloud.org/documents/22058315-is-lamda-se...I do find the responses here fascinating, if not a little disturbing. [–] GalahiSimtam 4y ago ↗ oh so that is the doc they shared with the higher-ups?as for your question, https://arxiv.org/pdf/2201.08239.pdf states 2 months of 1024 TPUv3 for a pre-training, and TPUv3 isn't even the most recent TPU hardware [–] JohnJamesRambo 4y ago ↗ Thank you for your response. So it is trained on 1024 TPUs but then if I chat with it today, what is it running on?
[–] GalahiSimtam 4y ago ↗ oh so that is the doc they shared with the higher-ups?as for your question, https://arxiv.org/pdf/2201.08239.pdf states 2 months of 1024 TPUv3 for a pre-training, and TPUv3 isn't even the most recent TPU hardware [–] JohnJamesRambo 4y ago ↗ Thank you for your response. So it is trained on 1024 TPUs but then if I chat with it today, what is it running on?
[–] JohnJamesRambo 4y ago ↗ Thank you for your response. So it is trained on 1024 TPUs but then if I chat with it today, what is it running on?
4 comments
[ 4.6 ms ] story [ 18.6 ms ] threadhttps://www.documentcloud.org/documents/22058315-is-lamda-se...
I do find the responses here fascinating, if not a little disturbing.
as for your question, https://arxiv.org/pdf/2201.08239.pdf states 2 months of 1024 TPUv3 for a pre-training, and TPUv3 isn't even the most recent TPU hardware