5 comments

[ 4.0 ms ] story [ 28.5 ms ] thread
> we scraped it all (at least as many as we could find on their English site) 12,118 questions

There's a lot more questions on Yahoo Answers. Their robots.txt file contains a sitemap: https://answers.yahoo.com/sitemaps/sitemap-us.xml

That sitemap contains links to 2,115 other sitemaps. Each of those sitemaps contains links to around 47k questions.

Good find! Worth a follow up to get more!
Use your tool to scrape FBI crime and victimisation statistics and you might reconsider the beneficiary of the proceeds.
How strange, what do you mean by this comment? I just visited the website of the beneficiary of the proceeds and they have this to say about the death penalty[1], for example: “African Americans make up 42% of people on death row and 34% of those executed, but only 13% of the population is Black”.

It sure sounds like racial bias to me! And I for one I’m glad the they chose this nonprofit organization which is doing excellent work.

[1] https://eji.org/issues/death-penalty/

Taking homicide as an example (a crime more likely than most to result in a trip to death row), the most recently available data (2019) [1] shows that 56% of perpetrators were black. That's quite a feat for 13% of the population!

If anything, that only 42% of those on death row are black may be indicative of a racial bias in their favour.

[1] https://ucr.fbi.gov/crime-in-the-u.s/2019/crime-in-the-u.s.-...