Why black box A/B testing is BS (leanplum.com)

3 points by momchil84 ↗ HN
Black box optimization simply doesn't work for a/b testing. Product teams should be agile and understand WHY their features are affecting users the way they do.

1 comment

[ 4.4 ms ] story [ 8.8 ms ] thread
Our view is that data is just one piece of the overall picture for A/B testing. Agile human teams are needed to drive creativity and insight for new features and innovation. Black box algorithms can never outperform this type of ingenuity.