Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World (medium.com) 6 points by dhdhd1 3y ago ↗ HN
[–] dhdhd1 3y ago ↗ training the GPT-3 175B model required 3.2 million core hours spread across 285,000 processor cores over several months. It is projected that the overall cost of training the model will be roughly $4.6 million. [–] rani08 3y ago ↗ We are doomed
[–] blackhat2017 3y ago ↗ we need an open GPT, its becoming more and more centralized instead of becoming open source as Elon intended for. [–] rani08 3y ago ↗ One day we will be kicked out of our Jobs [–] smoldesu 3y ago ↗ As many have said before, there are open GPT models you can use. You can't run ChatGPT yourself, but you don't have the resources to run it anyways.You can get relatively SOTA models running locally, it just requires a lot of compute. [–] [deleted] 3y ago ↗ (comment deleted) [–] version_five 3y ago ↗ LAION is working on an open chatgpt like model [0] and there is a project discussed here recently that is about running the llms on single gpus [1]I agree, there is a very serious risk of newer AI advances being closed by default, and I think it's not being taken seriously enough.Even "open" players are still for-profit, say Huggingface. There really needs to be Linux or FSF like players that are motivated by freedom.[0] https://github.com/LAION-AI/Open-Assistant [1] https://github.com/FMInference/FlexGen
[–] smoldesu 3y ago ↗ As many have said before, there are open GPT models you can use. You can't run ChatGPT yourself, but you don't have the resources to run it anyways.You can get relatively SOTA models running locally, it just requires a lot of compute. [–] [deleted] 3y ago ↗ (comment deleted)
[–] version_five 3y ago ↗ LAION is working on an open chatgpt like model [0] and there is a project discussed here recently that is about running the llms on single gpus [1]I agree, there is a very serious risk of newer AI advances being closed by default, and I think it's not being taken seriously enough.Even "open" players are still for-profit, say Huggingface. There really needs to be Linux or FSF like players that are motivated by freedom.[0] https://github.com/LAION-AI/Open-Assistant [1] https://github.com/FMInference/FlexGen
7 comments
[ 3.2 ms ] story [ 26.5 ms ] threadYou can get relatively SOTA models running locally, it just requires a lot of compute.
I agree, there is a very serious risk of newer AI advances being closed by default, and I think it's not being taken seriously enough.
Even "open" players are still for-profit, say Huggingface. There really needs to be Linux or FSF like players that are motivated by freedom.
[0] https://github.com/LAION-AI/Open-Assistant [1] https://github.com/FMInference/FlexGen