HN Explorer

Show HN: Groupon Scraper in Python

8 points by svrocks ↗ HN
https://github.com/jxchen/DailyDealScrapers

On the Groupon IPO thread someone mentioned people selling scraped groupon deal data. To satisfy my curiosity I made my own. Pretty interesting to play around with the data and see how much money their deals are making.

8 comments

[ 2.8 ms ] story [ 28.6 ms ] thread
drats
Looks great. I'd comment the code though, and look into a real html parser.
svrocks
Ha yeah the code is a mess. I have used BeautifulSoup before but I don't understand how it works well enough and just wanted to get something out the door
demirhan
I was looking for their revenues for april and may. Their revenues were declined for previous months.

Business Insider didnt report their revenue for april and may. Thus, did you have a chance to scape their past data for may and april ?

svrocks
no i just made this yesterday, it only takes snapshots of current deals. If you want to collect revenues going forward I would set up some kind of cron job and run it every night at a reasonable time (11pm Eastern US time would probably work, but you'd underestimate on the West Coast deals)