Show HN: News geolocation website
For now I have a minimum viable product, I have the website up and running that shows how the news will be displayed on a map.
What I am asking:
It will be really very nice of you if you can give me feedback, any feedbacks even negative ones are really more than appreciated. I know there are many bugs, bad design, lack of content but the question I am asking you is would you use such a website/mobile app if it existed? Do you like the idea? Do you think it is worth it if I finish building such a website?
Here is the link to the website:
Here is the link to the newsmap:
https://www.toperudite.com/pages/news/newsmap
Please don't hesitate to fill the following survey (it takes less than 3 minutes)
https://docs.google.com/forms/d/e/1FAIpQLSe9q_0roqwtipe4KLyR...
Here is a link to a slack channel : https://join.slack.com/t/toperuditebetatesters/shared_invite...
Here is a quick youtube video https://www.youtube.com/watch?v=CrwvY049ipE
Thank you very much for your time :)
60 comments
[ 3.1 ms ] story [ 118 ms ] threadAlso it's a little strange that you're only able to search for streets, not general areas or cities.
https://imgur.com/a/BWpvBdOq
http://www.theheretimes.com
about: http://www.theheretimes.com/about
But also many challenges. I noticed in the past days that the accuracy of locations in the news is much lacking. Location names are not unique so an automatic approach is likely to fail.
Geolocated "news" is used in larger Brazilian cities but it's regarding stay bullets and robberies (eg. Fogo Cruzado, Onde Tem Tiroteio, Onde Fui Roubado). So there are some emergency use cases, but I'm unable to think of another use case where I might want to see the news mapped, as the core idea.
https://www.reuters.com/article/us-brazil-security-app/brazi...
Union Jack Flag
1. Your biggest problem is going to be acquiring audience; 'if you build it, they will come' is probably not going to play out unless you offer something above and beyond a typical aggregation web site.
2. Consider the utility of granular location-specific news. For many users what you will be showing is either very little content (because there isn't any) or content from a larger geographic region. At that point you have to ask who your audience is and what you provide to them over a bigger regional news source.
3. Keeping up with available sources will be a big challenge. Remember, if you're just aggregating from the big sources, you're not providing much; the appeal to an aggregator is that it gets and filters everything. If you have to go to another source as a user, there's no point in using this site.
4. The site looks pretty bare-bones. It could use some design help across the board.
5. The 'secret sauce' of a site like this is actually not aggregation and automation ... it's curation. If you read 100,000 RSS feeds (if and where you can even find them these days!) you still need to separate the wheat from the chaff. That's why Reddit works - it's effectively a user-curated aggregate site that leverages a scoring algorithm to (ostensibly) bring the best stuff to the top.
Edit: Forgot one of the biggest challenges. I don't know how you're doing your address extraction, but one of the toughest things we ran into were false positives. Articles that reference a location which we geocode but really weren't about that location. So you'll analyze a whole story (which can get very computationally expensive) and find 4 locations:
1600 Pennsylvania Avenue Washington, D.C. Washington Zimbabwe
Now this story is about the Zimbabwe ambassador having a meeting with the president. Two of those addresses are where the story is, two probably aren't (Washington would probably not be geocoded to D.C.). So you file the story in:
Washington, D.C. Washington, USA Zimbabwe
Now you've just got noise. NLP can help but it's not enough - you will mis-geolocate this story. When that happens a lot the results are not reliable and, again, your potential audience does not see the utility.
Anyway, best of luck.
In 2009, there was around 25 million smart phone users. We will close out this decade close to 3 billion. That is half the world with a geo-location based device in their pocket which grabs their attention for hours each day.
The peak may have been Pokemon Go, or maybe we aren't even there yet.
https://www.gdeltproject.org/
If something happens in Paris, show it in Paris, not in some random particular location in the middle of Paris, unless you know that it really happened at that exact location.
See this: https://splinternews.com/how-an-internet-mapping-glitch-turn... for the kind of issue you can cause.
For example, Trump-Putin meeting is an event. I'd like news aggregation on this event on what every corporate and independent news publication across the world is saying. Currently, I am only able to get US/British news viewpoints or angles and I have to work ridiculous hard ( google search is terrible now ) to find reporting on other nations/viewpoints. I was curious how the chinese, arabs, israelis, indians, south americans, etc were reporting on the story because having been to europe and asia, I know that news is not the same everywhere. One good thing about traveling.
Google news used to do something like this until they were forced to limit it to corporate news and regions.
There is a bug for me where if I click the language change to english, then set the location to english, the "hours ago" section still shows french.
This is a really cool project! Hope you post more updates on HN as you go.
However - I am looking for a Google News replacement, as it keeps showing me gossip, entertainment and snarky news, no matter how many times I click "fewer stories like this". They used to have a feature where you could block news providers (eg never show me news from TMZ), and also choose my preferred news sources (eg I could choose The Verge & Bloomberg) and it would rank their version of the story highest. That was very useful while it worked. You could also add topics that you were interested in, so if I added "Nine Inch Nails, Trent Reznor", it would rank news stories about Nine Inch Nails more highly so that I would see them. (I would really like to be able to blacklist topics/keywords too.)
If somebody made a news aggregator like this, I'd love to switch away from Google News.
Location is interesting when you combine it with time. News archives contain a lot of valuable content that would be interesting in the context of a location. For example, I live in Berlin and when we started digging around in archives from news papers, we found all these gems about David Bowie visiting certain bars, being on certain streets, etc. This is interesting to people in that area, years after the fact but not necessarily for people outside that area. Just having a historical view on a place via the things that people published about it is interesting.
Our problem at the time was coming up with enough of an MVP to convince users and investors. One thing we explored was using nlp to extract clues about location references from the text. This is surprisingly hard but not impossible. People use a lot of ambiguous language to refer to locations but taken together you can sometimes deduce correctly that people are referring to a street in Prenzlauerberg (a neighborhoud) in Berlin (the capital of germany, not the village near Bremen). This is of course flaky. The good news is some content is actually geotagged, which makes this easier. However, we found a lot of low quality geotagging as well.
The idea is OK, but you're missing something important. People don't care about local news, they care about relevant news. Some news is relevant to me even though it's happening on the other side of the World. Some news is only relevant to me because it affects my next door neighbour (who knew he was into that, huh?).
You're going to need to spend a lot of time fixing up the design as it is right now, and audience building is going to be so, so hard in this climate.
Good luck, but you've a way to go.
I had a similar MVP in 2010 with the intent on building a curated news aggregator for sales territories. Once you define your geographic area (zipcodes/states/draw etc) and choose keywords and/or topics, your news feed will include any local or AP story that includes these keywords and geotagged within your territory.
- Rob
As other comments already mentioned, there are many false positive locations, such as names of persons, organizations, chemical elements or even normal verbs and nouns. There exist for example places named "Robin Hood".
Took me some time to realize that i should not limit the text extraction to locations, but also focus on the recognition of other entities (persons, organizations,..) in order to filter out the ambiguous names.