Ask HN: Share how you benchmark and monitor page speed

If you're maintaining performance benchmarks for your web site, how are you doing it?

Software, services, automation, real browser vs. pinging, and alerting - it'd be interesting to see how HN is doing it, from one-person web apps to the big guys with dedicated performance teams.