I must admit I'm not seeing the point of this but it obviously has a use or you wouldn't have created it. I'm just recently trying to get my head around async in python, good to see some clear and understandable code involving it.
For sure it's just a simple script. But I really like to play with news data in my personal NLP projects. So I had the idea to scrape the data by myself.
Some months ago I've implemented the same script with the requests library and complete synchron and the script took around 1 minute to complete. Now, after first time implementing HTTP requests with async it's finished instantly in around 1-2 seconds.
Yeah I'm interested in async for the same reasons. It's still not clear in my mind yet but I'll get there. I'll definitely be using your script to make sense of it. I'm told web requests and file IO is a good place to use async.
4 comments
[ 4.5 ms ] story [ 15.4 ms ] threadSome months ago I've implemented the same script with the requests library and complete synchron and the script took around 1 minute to complete. Now, after first time implementing HTTP requests with async it's finished instantly in around 1-2 seconds.