HN Explorer

25 comments

[ 3.1 ms ] story [ 61.7 ms ] thread
ibdf
This is pretty neat. I would include an option to search a date range, or at a minimum display the date of the post and let me sort by date - this would make it easier to find posts that are related to events.
jawerty
Thank you. The date on each is a priority for new features
Freak_NL
I don't think it really works. A search for 'Amsterdam' returns only one comment.
istinetz
0 hits for Rammstein and Romania. Perhaps OP just scraped something like a 1000 comments?

Also, location filters seem to be hardcoded for US and Canada.

jawerty
It only works for the Us
hansel_der
i feel like this should be in the title in order for the rest of humanity to quickly skip it. like an date tag "oh this is from 2010, nevermind".

then again, paywalled sites grml

jawerty
Thanks for the feedback just added
DarkContinent
I wasn't able to find comments behind privacy settings--can you add a login extension to make that possible?
jawerty
Interesting, yes I can do that
honkdaddy
Where are you getting the comments from? It seems to be a very, very tiny subset.
jawerty
It’s coming from public pages in US cities.
breakfastduck
Yeah this just doesn't get anything for most terms I've searched where you'd expect thousands if not millions of results. What exactly IS this searching?
encodedstephen
“Computer vision” doesn’t seem to bring back any relevant comments.
jayolden
This doesn't work for local languages or country-specific comments, which destroys the purpose of having a search engine for FB comments.
Karawebnetwork
This needs to take spaces and sentences into account. For example, "hacker news" will find results about regular news and no comments have the word "hacker" in them.
jawerty
Thanks I’ll add this to the feature list.
jawerty
Hi,

Just to clarify a few things. This search only works for cities in the US.

doubleorseven
so if i'm not from or don't care about US pages, can you at least share some info about what you do there? I'm guessing GQL but I'm just guessing.
jawerty
Absolutely, I algorithmically fetch prominent public news/media pages from a list of us cities of at least a few thousand and get the comments from each page.
Leary
Great project! One thing I'm sure a lot of people would find useful is a "top comments" page that shows what the most popular/ trending topics are.

Or is it possible to find what sort of news articles are the most popular? I often hear both side of the political spectrum saying Facebook is biased. Would be cool to see if it was true.

jawerty
Thanks for the note. Funny enough I’m working on some sentiment analysis in another project on bias. parallel thinking
matt123456789
Wow, super responsive. Great work. I don’t want to ask how you scraped these, but can you talk about your software (solr?) and compute resources?
jawerty
Mongodb aggregation pipeline working wonders.
altdataseller
This is Facebook posts posted on FB pages from external ppl, not comments on other page posts. Misleading title.