Ask HN: What would you like to know about A/B testing?

4 points by karolisd ↗ HN
I'm a developer at a CRO agency and I'm thinking about writing a small ebook about A/B testing and Conversion Rate Optimization. I've worked with over 30 clients, mostly in the eCommerce space and I'd like to get more ideas from the HN crowd which I suspect is skewed more into the start-up/SaaS side of things.

I'm wondering how many of you are A/B testing. And by that I mean, do you have a clearly defined strategy or is it more like "we installed A/B testing software and are just randomly testing things"?

Any answers/questions/thoughts are welcome. I'd like to get a better understanding of the gaps in the public knowledge of A/B testing.

1 comment

[ 2.6 ms ] story [ 16.3 ms ] thread
what is most interesting to me is doing multivariate testing well enough to tell us "what we don't know we don't know".

not interested in traditional a/b testing, it has been done to death and there are many software tools that make execution easy.