Let'sEncrypt renewal monitoring (letsmonitor.org)

Does it check for things like a full certificate chain?

Yeah, it does present a maintenance problem. I think a third party service is a good validator. Also look at pingdom.

Cool idea, but there doesn't appear to be any service there yet - just an email harvester. I would expect the site to use SSL too.