Ask HN: Does the web need a `license` tag?
Okay, it doesn't have to be a tag, nor be called license. The real, somewhat longer question would be: Do HTML and similar technologies need a mechanism to encode licensing / copyright information in a uniform, machine-readable way? This could take the shape of a tag in the header of a document, an attribute that can be used with any or just a few tags, etc.
The web has shifted from people hosting their own content on a website or blog, with a copyright notice in the footer, to submitting larger platforms, be it imgur and similar, social media, or sites that focus more heavily on text as their content, even including hacker news itself.
How should a crawler know, if it may or may not take some random text from a website and display it somewhere else? How can it know, who to credit, or whether to credit someone at all?
Searching google hasn't brought up any way to encode any of this in HTML, maybe I'm missing something? If there really isn't any such mechanism, should there be one? What should it look like?
7 comments
[ 4.9 ms ] story [ 18.9 ms ] thread> How should a crawler know, if it may or may not take some random text from a website and display it somewhere else?
The recommendation I follow is to use robots.txt to disable crawling of specific pages or paths. If I really want information protected I either (a) put it behind authentication or (b) don't put it on a public website.
> How can it know, who to credit, or whether to credit someone at all?
Why does the content need credit at the search engine level? If the reader cares, the reader will navigate to the page and determine the author.
Crawlers could, with more granularity, decide what they may embed and how.
> Why does the content need credit at the search engine level?
It's not just about search engines though.
> The recommendation I follow is to use robots.txt to disable crawling of specific pages or paths.
Thay way you're just locking bots out. It's a completely different thing. This is not about protection; it's about communication.
> If I really want information protected I either (a) put it behind authentication or (b) don't put it on a public website.
If you want to avoid people stealing things they shouldn't, yeah, that's your only option. If all you want is to communicate whether or not they may take your content, you don't really have any tools to do so. Again: Communication; not protection.
> If the reader cares, the reader will navigate to the page and determine the author.
No. That's not how it works. You can't expect users to click through several links to find the author of a resource. Unless you link directly to the resource on the authors site, the author should in many cases be credited directly next to where the resource is embedded.
[1] http://microformats.org/wiki/rel-license
[2] http://www.dublincore.org/specifications/dublin-core/dcq-htm...
[2] http://purl.org/dc/terms/