Inquiring minds want to know --- what happens when everything has been stolen and content creators are out of business? Is this "consistent with the national interest"?
OR this is FUD
and China is showing the world that all the ballyhoo about exotic tech etc. required to produce good AI is just billionaire bros making it up to suck in investor dollars.
> China-Based AI Companies Conducting Industrial-Scale Distillation Campaigns
If distillation of closed models was indeed easier than training from scratch, others would have done it too, with similar results. However, that's not happening, instead, a lot of US and EU companies are fine-tuning open Chinese models, an easy task when the originals are open, but regardless, their results don't reach the general level of their Chinese originals.
There's no evidence that China is distilling closed models, Chinese companies have developed quite a few different open models with different architectures and capabilities but none appear similar to the two closed models doing the blaming.
3 comments
[ 6.1 ms ] story [ 10.0 ms ] threadWhat is good for the goose is not good for the gander?
Even when endorsed by the US administration as "fair use" and "consistent with the national interest in promoting innovation and free expression"?
https://www.yahoo.com/news/politics/articles/trump-admin-cou...
Inquiring minds want to know --- what happens when everything has been stolen and content creators are out of business? Is this "consistent with the national interest"?
If distillation of closed models was indeed easier than training from scratch, others would have done it too, with similar results. However, that's not happening, instead, a lot of US and EU companies are fine-tuning open Chinese models, an easy task when the originals are open, but regardless, their results don't reach the general level of their Chinese originals.
There's no evidence that China is distilling closed models, Chinese companies have developed quite a few different open models with different architectures and capabilities but none appear similar to the two closed models doing the blaming.