Cloudflare is bypassable and most captchas can be bypassed too. If they can't, outsourcing this to low-wage countries is not very expensive. If it's to get to something you need, these methods will slow you down a little - they're never a barrier.
Not sure why you're getting downvoted but it might be the Cloudflare aspect?
I've recently been exposed to the world of proxies, scrapers, data harvesting firms, etc and it's widely accepted that you can scrape anything, circumvent just about anything, and eventually get your hands on whatever data you're looking for.
That said from what I hear Cloudflare is actually pretty good at scraping/bot/etc detection and mitigation.
Interesting project. How does this compare with for instance ccxt ?
I think if someone is serious about semi or automated trading, writing your own exchange API integration is something you cannot get around. Every exchange is different and going for the lowest common denominator is going to work against you.
8 comments
[ 3.3 ms ] story [ 30.3 ms ] threadHow about a bridge towards geth for Uniswap trading? "Should be easy".
It is actually easy with some tools.
As for some of the ecosystem parts, it is just typical scrapping which can be easily broken by either Cloudflare or a simple Captcha.
That doesn't seem to be very reliable, in the long term.
I've recently been exposed to the world of proxies, scrapers, data harvesting firms, etc and it's widely accepted that you can scrape anything, circumvent just about anything, and eventually get your hands on whatever data you're looking for.
That said from what I hear Cloudflare is actually pretty good at scraping/bot/etc detection and mitigation.