HN Explorer

105 comments

[ 3.3 ms ] story [ 168 ms ] thread
pkhamre
Best football club in the world with word URL scheme in the world?
jakub_g
Can anyone tell the advantages of having unreadable URLs like this? The only thing I can think of is reducing bandwidth usage through short URLs :)
Ovid
And reducing bandwidth via a brilliant anti-SEO strategy.

* Useless URLS? Check.

* Eye-gougingly ugly design? Check.

* Densely packed content with tiny font? Check.

And have lots of fun reading the source.

twistedpair
You've got to go green by conserving bits. You can use up to a radix of 30 I believe in JS, so why use those pesky base 10 values when you can go base 30 with no additional overhead? Heck, use base 62 for the easily url passable values too. Just 4 chars to encode your 14M WP articles.

Think of the bits!

dbbolton
So, this page is named ?_(null)çô(null)

? How does that even begin to make sense?

hosay123
It's an underscore followed by 4 bytes, possibly the integer 2650072859 or 468186269. If they're intentionally trying to obfuscate their URLs to prevent crawling, it might be further encrypted somehow.
lysol
This is nitpicking, but the worst URL scheme is actually smb:
helipad
Look! Another fixed-width, left-aligned German website. Brimming with nostalgia here.
[deleted]
(comment deleted)
XarotheOne
Haha that is epic.

EDIT: I apologise for the really bad comment. I have read the rules now and will only put high quality posts from now on. Thankyou.

endgame
http://thebestpageintheuniverse.net/c.cgi?u=epic
PavlovsCat
Thank you. I often wanted to write a rant about the epidemic usage of that word, but now I see I don't have to (I can just link to it, like a cow ^^)
XarotheOne
Actually thanks for that, I didn't realise so many people were against it but I shall refrain from using the word "epic" in a context that it should be used.
cedricd
The elephant in the room here of course is this: https://news.ycombinator.com/x?fnid=b7VO4wED8MRumCeiX5fCnF
ancarda
I never understood why HN has such a peculiar URL for accessing pages. It times out after a while too, is that to stop crawlers?
[deleted]
(comment deleted)
Robin_Message
They are ids to lookup closures in a database. They time out to stop the database overflowing ;) It's called continuation-based web development [1], popular with Lisp and Smalltalk-based web servers (because who else has continuations?)

[1] http://en.wikipedia.org/wiki/Continuation#In_Web_development

jgrahamc
There's no database.

EDIT: to all the people arguing with me. Read the source code to Hacker News.

    (= fns* (table) fnids* nil timed-fnids* nil)

    ; count on huge (expt 64 10) size of fnid space to avoid clashes

    (def new-fnid ()
      (check (sym (rand-string 10)) ~fns* (new-fnid)))

    (def fnid (f)
      (atlet key (new-fnid)
        (= (fns* key) f)
        (push key fnids*)
        key))

    (mac afnid (f)
      `(atlet it (new-fnid)
         (= (fns* it) ,f)
         (push it fnids*)
         it))
They are in memory. Which is why they expire randomly when the HN process is restarted.
scotth
Depends on what you consider a database.
oh_sigh
Then where is the data that is associated with "b7VO4wED8MRumCeiX5fCnF" stored? How is that data requested? There certainly is a database, it is just most likely not a traditional database that most people think of.
defen
where is the data that is associated with "b7VO4wED8MRumCeiX5fCnF" stored

In the Racket process that's running the Arc code for news.yc

Robin_Message
That's probably true John. If I may mis-quote Greenspun:

"Any sufficiently complicated Lisp program contains an ad hoc, informally-specified, bug-ridden, slow implementation of half of an actual database."

gcr
Racket (arc's host language) keeps continuations on the filesystem, or you can write your own "stuffer" to do what you want with them (store them in a database or whatever). But you have to keep them somewhere or else (assuming the server uses continuations) you can't keep track of the user's path through your code as they click through links and such.

Racket does have an option to serialize the continuations, gzip them, sign them with HMAC, and then send all of that to the client so the server doesn't have to keep track of anything, but HN doesn't use it.

See http://docs.racket-lang.org/continue/#(part._.Advanced_.Cont... for a quick introduction.

kens
The fnids do not expire randomly due to restarts; they expire when there are too many or they timeout so memory doesn't fill up with these continuations. Personally, I don't like this continuation-based approach since "Unknown or expired link" is a really bad user experience.

Way back I wrote a bunch of documentation on the Arc web server if you want details: http://www.arcfn.com/doc/srv.html Look at harvest-fnids which expires the fnids.

The fnid is an id that references the appropriate continuation function in an Arc table. The basic idea is that when you click something, such "more" or "add comment", the server ends up with the same state it had when it generated the page for you, because the state was stored in a continuation. (Note that these are not Scheme's ccc first-class continuations, but basically callbacks with closures.)

(The HN server is written in Arc, which runs on top of Racket (formerly known as PLT Scheme or mzscheme))

Edit: submitted in multiple parts to avoid expired fnids. Even so, I still hit the error during submission, which seems sort of ironic.

tveita
Oh, wow. I had assumed that people who visited around the same time got the same next page URL, maybe as part of a caching strategy or something.

This way seems impractical, TBH. Certainly for the user - the expiration a bit of a nuisance, as I'll get it more often than not if I read a couple of stories and then click 'More'.

kalmar
I believe it's a continuation-style server—hence fnid: function id—and the continuations are only kept around in memory for ~5 minutes.
lucian1900
I never understood why the continuation couldn't instead be addressed by a URL path. It could even get constructed from URL/query data if it moves out of memory, so keeping them in memory would only be a caching mechanism.
pfarrell
Yes, but the way hn works, the continuations map uri's to browser sessions so they can be expired on a more granular basis than all at once or lru or what have you. I'm guessing here, though, I've not looked through the code.

[addendum] I Reread your comment and realized that wasn't what you meant at all. What would be the benefit of path based uris over query string params in hn's case? I only see how they be equal, not better.

lucian1900
I meant that the continuation could be identified by (session_id, URL data), and re-created based on this data if it goes missing.

URL data can come from path or query string, it doesn't matter.

acdha
Every continuation framework I've looked at radiates an intense desire to treat the web as something other than what it actually is.
masnick
LinkedIn URLs are by far the worst. For example, the first profile that came up when I searched for Paul Graham:

http://www.linkedin.com/profile/view?id=23081590&authTyp...

joosters
Yes, all those *2s could easily have been optimised into a left shift operator.
masnick
Oh so the *2s have some sort of meaning beyond random URL garbage? Please explain! I've always been curious.
aerique
No, I think it is just a joke: if you parse "*2" as "times two" you could optimize it in code by shifting the bits left since bit shifting operations are cheaper than multiplication.

#b0001 = 1

#b0010 = 2

#b0100 = 4

#b1000 = 8

masnick
Haha thanks for the explanation.
delinka
And to continue on this tangent, if your code is multiplying by the constant 2 (e.g. "x = z * 2") the compiler's probably going to optimize that into a shift anyway, so just keep the "* 2" to keep future human readers of the code happy.
Peroni
Some poor PI is going to freak out when he checks his 'recently viewed your profile' stats.
[deleted]
(comment deleted)
raverbashing
You can have a public URL for linkedin in the format /in/CustomName

E.g.:www.linkedin.com/in/barackobama

3825
Apparently he is a 3rd connection. o.O
smackfu
Too bad that seems like only an external reference method, and the site never uses those URLs internally.
masnick
Yeah, I want to know what they're doing internally with these insane URLs. It's just ugly -- poor craftsmanship IMHO.
mseebach
Yeah, nothing screams good craftsmanship like armchair-quarterbacking someone else's work that clearly works well.

FWIW, it seems to be some sort of encoded state, essentially HATEOS.

smackfu
Works well?

"Oh you want the URL of your LinkedIn Profile? Don't use the URL in the address bar, silly! Use this other URL we are providing randomly down the page."

mseebach
I was referring to the URL-scheme of the LinkedIn app in general, not just the profile page - I somehow missed that this subthread was only about the profile page. Yes, I agree they dropped the ball completely on that. Especially tragic as they could fix the 80% case with a front-end one-liner (window.history.replaceState).
viame
I was just going to say that! Before I saw this post I was on LinkedIn looking for something, and you simply cannot miss when something like this shows in your address bar:

...gid=3396514&goback=%2Enpv_152562310_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_1_*1&trk=NUS_JGRP-grp-nm

joosters
Take THAT, evil web crawlers! Maybe they are trying to get poorly-written spiders to crash when they hit the site?
jakub_g
Actually when you google site:www.bvb.de there are some readable URLs (not sure how they got there), upon navigating to which they do 302 redirects.
joosters
It's just like tinyurl.com, but in reverse :)
X4
hahaha :D

Let's put the tech sensation aside. I'm glad to know that the HN Folk have a good sense of humor :)

BTW: you can add multiple routes pointing to the same url, but allow only the SEO URLs to be indexed. This keeps the cryptic URLs for the entertainment of the Users/Crawlers.

joosters
How would you do this? (Leaving aside the question of 'why?')

I suppose you could try blocking crawlers from the raw URLs with an aggressive robots.txt and then put a sitemap (with friendly/SEO URLs in) somewhere for them to discover instead. Would that work?

Paranoid web spiders could flag the site as suspicious, though. Such schemes might make it seem like the website is presenting one view to the spider, and another to real visitors. Almost like it was trying to hide malware from a scanner.

alanh
My understanding is that you can use e.g. "rel=canonical" links to tell bots what the indexable URL of the current page is. Other tools in the box include UA sniffing and sitemap.xml.
X4
You could simply add "index" to the page when accessed with /seo/url and noindex when accessed with the cryptic url. Additionally you can enforce that using .htaccess or nginx rules also. Your Framework and HTTP-Router class just has to support multiple URLs per page.

Basically your CMS or Framework must allow to have multiple routes like site.com/best/watch/casio and site.com/→@ðŋ]æ~@¢“«¢“¹²³»«@€^ linking to the same page.

I've used that in the past to switch languages dependant on url-path + browser-language. /en/my-article would show that english article to a german visitor, but everything else on the site like nav, terms etc. would be German. To access the Enlish site, the german visitor would have to click the appropriate flag. I could have easily added the feature to read that same article in German, by a click on a flag in the bread-crumb's mini drop-down. Example: blog»my-article[v] a click on [v] would open blog»mein-artikel etc.

Ovid
Well, I do remember years ago when I helped a colleague debug a problem with a web app. Seems that IE was the only browser we could find that crashed with %00 in the URL. I'm pretty certain there was a NUL byte exploit we could have dug into.
msturm
Not sure what it is but the URLs on the japanese BVB site look better: http://www.bvb.jp/
homosaur
What the heck, this site is reasonable, attractive, and legible, why is this not the MAIN SITE?!?
bdg
My first thought when I see this:

This is a band-aid to try and prevent an XSS or SQLi flaw somewhere on the site.

hamoid
I still think the one used by the Spanish Congress is worse. URL for legal document 162/000609:

http://www.congreso.es/portal/page/portal/Congreso/Congreso/...

masklinn
Legal portals are generally gasbage, here's the french one for Article L511-1 of the environmental code: http://www.legifrance.gouv.fr/affichCodeArticle.do?idArticle...
claudius
§ 1353 of the BGB (German Civil Code) can be found at http://www.gesetze-im-internet.de/bgb/__1353.html (literally ‘laws on the internet’).
Jhsto
Legal portals are also many times vulnerable to a form of directory traversal, where you descend the URL scheme by cropping out the last slash. ie. /documents/17683/ would become /documents/. Doing the same thing for parameters can do wonders.

So far I've found login portals to a few banks, teleoperators and to the parliament and military systems of my country. In addition, I've hit several FTP directories of organizations such as my state's public welfare system, which included software and documents.

I sometimes report these incodents as I find them, anonymously and without contact information, since nobody never responds to these reports.

tldr; Long urls can also be dangerous.

ozh
How about http://www.tsa.gov/tsa-pre%E2%9C%93%E2%84%A2 ? It's "TSA-Pre✓™" and you have to type in the checkmark and the trademark symbols, otherwise it 404s

Edit: ho, they fixed that and it's redirected. Too bad, that was funny :)

ramses0
"I can't imagine the skill required to do this without the experience to know it's a bad idea" (can't find the source for this quote, but you should get the sentiment).

...ahhh... found it: """"How do you attain the skills required to do this while not also learning not to?" http://news.ycombinator.com/item?id=4711355 """

blcknight
The way you end up with URL's like http://www.tsa.gov/TSA-Pre✓™ is a CMS system that replaces spaces with dashes in the title to make the URL. No skill required.
whalesalad
Glad to see they finally fixed that with a redirect to a sane url.
franze
i have seen worse.

i.e. sites that show on page with the url http://www.example.com and another page with the URL http://www.example.com and even after another click the URL http://www.example.com with completely new content

and sites, that use a logic like this http://www.example.com/357893857435/sfjsfsfsfd/this-should-b... where http://www.example.com/357893857435/sfjsfsfsfd/this-is-shoul... and http://www.example.com/357893857435/sfjsfsfsfd/tHIS-is-the-s... show the same page, oh and of course http://www.example.com/357893857435/sfjsfsfsfd also shows the same page.

oh, and cases where http://www.example.com/click1/click2/click3/item-id/123 show the same page as http://www.example.com/click1/item-id/123 which show the same page as http://www.example.com/click1/click2/click3/click4/item-id/1...

all of the examples above are far worse than bvb.de

tsahyt
Quite frankly, I despise the use of "SEO URLs" altogether. It's basically a waste of bytes.
davedx
Not if you view SEO as genuinely helping search engines to find content in a way that improves the discoverability of web pages.

If it's purely to boost rankings artificially, then yes, I agree.

nkozyra
Sometimes, sometimes not. You can often compress a lot of

&parameter=value into a simple /value/

rewrite. This - by most accounts - makes it more SEO friendly. Granted, putting full sentences that match an article title is never necessary, but there are a lot of SEO tricks that can make a url not only "nicer" looking but also shorter.

jeffasinger
Some of the best SEO URLs also tend to be human guessable URLs, which is definitely not a waste of bytes.
glyphobet
It's Latin-1 encoded and then URL-encoded:

>>> import urllib

>>> print urllib.unquote('%1B%E7%F4%9D').decode('latin-1')

çô

waffle_ss
I think THOMAS (http://thomas.loc.gov/), the search engine provided by the US Library of Congress for searching federal legislation, has the worst URLs I've seen. Here's a random one:

  http://thomas.loc.gov/cgi-bin/bdquery/D?d113:1:./temp/~bdGqLa:@@@T|/home/LegislativeData.php|
And here's a link I got to the Patriot Act (HR 3162):

  http://thomas.loc.gov/cgi-bin/query/D?c107:44:./temp/~c107DgA33R::
h-go
Why? Surely you'd have to go out of your way to make it that unnecessarily complicated.
jnazario
i have often thought that the THOMAS system was an overt attempt to obfuscating government activities. it's such a pain to use.
smackfu
Note that these are not even canonical URLs. Both of them now fail with a "Search Timed Out" error.

US Trademark Office has the same issue, there is no way to link to a particular trademark, because the only access is via the search engine and queries time out, e.g.: http://tess2.uspto.gov/bin/showfield?f=doc&state=4802:xt...

mseebach
It's clearly a set of arguments (separated by ':') to a function, i.e. it's a RPC invocation. The first seems to be the session of congress, 113th and 107th. The second, perhaps the nth item in that collections? The third, a temporary filename, probably where the search result is stored, so you don't have to re-run the search which you hit "back". The last bit, probably a later addition that manages breadcrumb navigation.
romaniv
Weird characters aside, having URLs of the form example.com?stuff has many advantages. For one, you don't need any weird magic to get relative URLs working properly.