casperjs is pretty unreliable, I wouldn't bother. Even for relatively trivial frontend testing we were using it for, it would crash ~50% of the time on Linux and Mac.
Really? I actually found it to be quite stable for a scrape project I had; it was rather trivial too though.
My only gripe is with the cryptic error messages I was receiving when executing JavaScript in a casper browser. But that could have just been my ignorance and unfamiliarity.
PhantomJS 1.6 is massively unstable. Downgrade to 1.5. I'm really surprised this hasn't been fixed yet - there are bugs in their tracker related to it.
Let me know if you have any questions or issues. I'll try and do something more exciting later like grab 100 sites, create pdfs, and store them in S3 all in parallel.
16 comments
[ 0.22 ms ] story [ 36.1 ms ] threadMy only gripe is with the cryptic error messages I was receiving when executing JavaScript in a casper browser. But that could have just been my ignorance and unfamiliarity.
Additionally you could install it using the build() command in the .worker file very similar to the way PhantomJS is installed.
I just included the whole CasperJS library with the worker package and followed the getting started example from the Casper site.
ERROR -- IronWorkerNG: Can't find src with path='node_modules'
and then follow the directions from /binary/phantom-nodejs
https://github.com/iron-io/iron_worker_examples/tree/master/...
then follow the blog post.
Let me know if you have any questions or issues. I'll try and do something more exciting later like grab 100 sites, create pdfs, and store them in S3 all in parallel.