Building a Concurrent Web Scraper In Python (codingninja.co.uk)

Have a look at Python multiprocessing for true parallel threading: http://docs.python.org/2/library/multiprocessing.html