HN Explorer

Is It Legal/Ethical for OpenAI to Scrape All Top Websites?

1 points by ohitstyler ↗ HN
While OpenAI hasn't made their training dataset available. It appears that they have used bots to index all top websites. (Maybe just using Bing's data itself? ) It appears that it knows everything about all of the websites, and can even tell what information was available on a URL.

I am just wondering if it would constitute fair use as there is no citations in answers and it would be quite obvious that the answers that it provides to queries are formulated using data from all these blogs and other websites.

Here are a few example queries - https://imgur.com/a/AmF1rYR

1 comment

[ 2.6 ms ] story [ 14.7 ms ] thread
warrenm
"Legal" and "Ethical" do not always overlap

It's legal to scrape websites: otherwise crawlers and search engines couldn't exist

As to whether it's ethical - that's a whole other ball of fish