geoffreyirving
- Karma
- 11
- Created
- September 8, 2014 (12y ago)
- Submissions
- 0
Member of the AI safety team at OpenAI. AI will probably be wonderful; let's make that even more probable.
[ my public key: https://keybase.io/girving; my proof: https://keybase.io/girving/sigs/Vpo0Mp0sPfdxVzxMQm1jpO3qvlgFNhGP3E4ZU-0YdaU ]
https://arxiv.org/abs/2112.04426 https://arxiv.org/abs/2112.04359 Gopher soon. :)
And it's worth emphasizing that we don't need to have particularly high confidence that this trend continues for it to motivate working on AI safety. All we need is the lack of high confidence that it will stop.
Yep, we're not claiming this is the compute required for DL, and for specific tasks we expect compute required to fall over time. But better algorithms actually mean compute is more important, not less, and would likely…
After a quick scan, I'm a bit worried that this is too tied to a server in practice. For example, if I've downloaded everything locally, can I easily clone the whole download (including all lfs files) into a separate…