27 comments

[ 3.2 ms ] story [ 70.3 ms ] thread
Used it for a while instead of PhantomJS to automatically create screenshots of webpages. Produces better results (much better custom font support) but slower. I believe it's because Slimer is not really headless, you need xvfb, a virtual X11 server.
Produces better results (much better custom font support)...

Hah, funnily enough, that's the exact same reason we're using it as well!

PhantomJS's "it'll be ready when it's ready" release cycle has been a bit frustrating, especially with version 2 and its support for custom fonts.

It's a shame there's no one perfect solution: PhantomJS is great, shortcomings aside; and SlimerJS is near perfect but slow, slow, slow.

PhantomJS (at least the 1.x branch) still randomly crashes a lot too.
I've tried it for a screenshot service I was working on. I ended up using Selenium with Firefox because no other system supported Flash.
I had a project at work where I needed to navigate to a form on a regulatory sight and click a button to download a csv report. I initially tried PhantonJS, but it could not handle how the IIS server responded with the csv file. SlimmerJS was able to handle the response and capture the csv file for me. My only issue was it is a bit difficult to build from source on a RHE machine.
One quick tip if you're torn between SlimerJS and PhantomJS.

Use http://casperjs.org scripts, and then choose the best engine at runtime.

For example, need screenshots? Tell CasperJS to use SlimerJS.

Looking for faster rendering to HTML? Tell CasperJS to use PhantomJS.

(comment deleted)
Quick nit: you can take screenshots with PhantomJS [0], exposed in casperjs as `capture` [1]

[0] http://phantomjs.org/screen-capture.html

[1] http://docs.casperjs.org/en/latest/modules/casper.html#captu...

Quick nit: you can take screenshots with PhantomJS

Sorry, that's my fault for not going into more detail :)

The big issue I have with PhantomJ's screenshots is that it doesn't support web fonts, and so pages don't render correctly.

One quick tip if you're torn between SlimeJS and PhantomJS, do either of them or both at the same time, they expose the same* API.

* with minor changes, as documented with SlimerJS

What are the advantages of a solution like this, over:

[1] Selenium (http://www.seleniumhq.org),

[2] scriptable testing, like Groovy's Geb (http://www.gebish.org), which uses Selinium's core WebDriver component under the covers, or

[3] scriptable headless browsing without using a real browser engine, such as with Python's Mechanize (http://wwwsearch.sourceforge.net/mechanize)?

Is this pretty much bullet #3, just for people who want to use "full-stack JavaScript" everywhere?

This type of solution is faster than Selenium, at least when talking about PhantomJS, as well as it's headless so it does not require running graphical environment.

Bullet #2 is basically the same as #1, and advantage over #3 is that Mechanize won't run Javascript, so it's useless eg. for testing Single Page Applications.

Hmm... can you elaborate further on that last point? I totally understand the value of headless browser testing, when you're not checking for browser-specific issues. However, I'm less clear on how a headless test runner's implementation language should ever matter one way or the other.

If you're testing the behavior of a web application as it receives HTTP requests, then shouldn't the application be agnostic about which clients are sending those requests? If your test runner is reaching around the HTTP protocol and directly manipulating JavaScript on the rendered page, then doesn't that affect the reliability of the test suite... since it no longer represents true HTTP client interaction?

I think what he was saying was:

If I have a webpage that only does one thing, it executes

alert('Hello world');

Then the headless solution would have to be able to check that the alert fired. If your testing framework does not execute the JavaScript on the page (i.e just fetching the resources) then you are back to square one.

I have no idea if Mechanize executes page JavaScript, but SlimerJS (and PhantomJS) does. Which is the difference here.

* execute alert will probably for most use cases be bootstrapping some MVC and setting properties, doing navigation and so on.

Whatever JavaScript a web page runs, shouldn't it be driven by some kind of event though? Rather it be the "onLoad" event itself, or the user clicking/hovering/changing something, etc.

In a real use case setting, you wouldn't have users load a web page and then somehow arbitrarily execute JavaScript code directly, without any particular event firing. So why wouldn't you test through the relevant events?

I don't know what your question means, especially the "reaching around the HTTP protocol" part, but I'm going to try to answer it anyway.

Mechanize doesn't contain a JS engine, so it can't scrape sites that rely on JS execution. You can't use it, for example, to scrape (or run tests on) content that was loaded via AJAX. The other scrapers in question do include a JS engine, so you can use them to scrape or test pages that load content dynamically.

Because more and more Web sites are implemented as client-side single-page applications (SPAs), the ability to scrape dynamic content is becoming more important.

Selemium is noticeably slow, and "Full-stack JavaScript" is vital for our primary SlimerJS use case: taking screenshots of webpages.

As a sidenote, there's a very interesting docker container that gets Selenium up and running heedlessly with Chrome and Firefox:

https://registry.hub.docker.com/u/vvoyer/docker-selenium-fir...

Whilst it's still slow, to suddenly have headless automated acceptance tests on real browsers is incredibly cool!

There's some of us out there who don't like Groovy's ecosystem or Python's syntax. Groovy changes its direction every few years -- first it was a scripting language, then a MOP for Grails, then a DSL for Gradle et al, then statically-compiled to compete with Java, and soon a toy language for Android. Python's indent-based syntax puts a lot of people off. Javascript, while not great, doesn't have the killers that other languages and echosystems have.
Slimer, Casper, Phantom...

Browser testing is becoming a case for the Ghostbusters!

I use this to login to my ISP without opening a browser.
I have an odd usecase. Would Slimer be able to handle capturing webgl output at video speeds? 30-60fps.
Anyone have pictures of this? I don't see any on the site.
PhantomJS, SlimerJS or Selenium?

Selenium if you want to support all browsers, including mobile.

PhantomJS if you want a performant and easy solution.

SlimerJS if you want PhantomJS but want HTML5/CSS3, too (or just need Firefox).

My 2 cents

In the past, when I used to cheat at various web games by running scripts, this would've been a wet dream.