Why we test every single API deployment (assertible.com)

We've been dog-fooding Assertible extensively since we released and it's now a primary part of our continuous integration/deployment setup.

I'm interested to hear what solutions others are using to test production / staging environments (automatically?).

I'd love to hear any feedback!