Like many others in HN, I’m interested in learning more about GPT-3 and experimenting with the model myself but I was surprised to find that it’s not openly available and that the repo was archived, perhaps for the reasons discussed in this issue.
Maybe someone here on HN could help shed light on what’s going on and clarify if/when a GPT-3 model will be available?
Gwern had a good piece on it. It's crazy expensive to train and run, not something for a laptop or gaming rig. The claim is it's really not that interesting, just a bigger GPT-2. It will be more interesting to see similar results with smaller models that are more accessible
That’s what it looks like. There’s a comment in this issue calling that out also. [0]
Considering how inaccessible it is I’m curious why there’s so much hype around it. Just the cost/benefit of cloud compute resources needed to run the model looks really bad. All of these hypothetical use cases being discussed in other threads would be financially unsustainable.
Granted, it’s still yet to be seen how the smaller models will perform. Looking forward to experimenting with those once they’re released!
4 comments
[ 4.6 ms ] story [ 26.0 ms ] threadMaybe someone here on HN could help shed light on what’s going on and clarify if/when a GPT-3 model will be available?
Considering how inaccessible it is I’m curious why there’s so much hype around it. Just the cost/benefit of cloud compute resources needed to run the model looks really bad. All of these hypothetical use cases being discussed in other threads would be financially unsustainable.
Granted, it’s still yet to be seen how the smaller models will perform. Looking forward to experimenting with those once they’re released!
[0] https://github.com/openai/gpt-3/issues/1#issuecomment-636008...