From Python 2.6 there is a nice multiprocessing library which based on OS processes. It's more heavyweight from the OS point of view but you don't need to worry about issues with GIL. I'm using it on an EC2 image with 8 cores and it rocks.
Plus it has the added benefit that if you design your architecture with queues as your distribution primitive you can scale across multiple machines pretty easily. There's a mostly drop-in interface [1] to AMQP that mimics the native Python Queue interface.
6 comments
[ 3.3 ms ] story [ 30.4 ms ] threadLots of folks have started to tackle this in the past and given up in horror.
[1] http://www.lshift.net/blog/2009/06/11/python-queue-interface...
recommended for everyone who wants to know more about python, threads, ticks and signal handling.