The licence (GPLv3) limits its use a bit - at least for people who prefer other licences like BSD or MIT. The generated C++ source contains the following comment: // This code is in part copyright Kay Hayen, license…
The openstreetmap project lets you download its whole dataset: http://wiki.openstreetmap.org/wiki/Planet They also got a API ... see the wiki.
I have done some webscraping with twisted and BeautifulSoup. But it was just for a few small sites. That was when I found http://scrapy.org/ , a complete python framework for writing webcrawlers. It looks promissing,…
The licence (GPLv3) limits its use a bit - at least for people who prefer other licences like BSD or MIT. The generated C++ source contains the following comment: // This code is in part copyright Kay Hayen, license…
The openstreetmap project lets you download its whole dataset: http://wiki.openstreetmap.org/wiki/Planet They also got a API ... see the wiki.
I have done some webscraping with twisted and BeautifulSoup. But it was just for a few small sites. That was when I found http://scrapy.org/ , a complete python framework for writing webcrawlers. It looks promissing,…