HN Explorer

17 comments

[ 3.1 ms ] story [ 46.3 ms ] thread
remotejoeclark
How many experiments can I run at once?
maximedupre
:D

It's better if all your experiments are independent from each other however.

josephcsible
Consider this hypothetical situation: my grandma is having trouble with something on a website, so she calls me for help. She talks me through what she's doing and what she sees, and I try to follow along, but I see something totally different because unbeknownst to us, the thing she's having trouble with is being A/B tested, she's in the "A" group, and I'm in the "B" group. Does Splitzy offer any solutions for this problem?
maximedupre
Hey Joseph, thanks for the comment. To be honest, this scenario never crossed my mind once xD. I have not implemented any solution to this problem... and as I'm writing this comment I'm not sure what the solution would look like. Surely the other big A/B testing tools have solved this and I could inspire myself from their solutions. Splitzy is very new (a couple of weeks old), so I haven't really covered all the possible use cases. It's very simple right now =).
adxmcollins
I think your only option would be screenshare or visit your Grandma, there's not really a lot an A/B tool could do about that problem
maximedupre
I'd be curious to know what the other a/b testing tools are doing regarding this problem if anything.
nikpolale
I think you could possibly allow the user to copy the "fullUrl" and share it with others. This fullUrl will have all the AB tests in the query param, and when another user visits the url - he'll have all the same AB tests

google.com?835483558=A&gdfmgfmgd=A&5435848=B

Something like this

scrum-treats
Agreed. It's usually noted in the URL, the metadata, or JS. All of which can be curled, processed, and diff-ed.
maximedupre
Right! That makes sense. I guess you still need some technical knowledge though.
dev-bre
I like the simple approach. Is there a way I can see history of my experiments?
nikpolale
Loving the simplicity here. Can't really use it right now as I'm not having enough data, but as my project goes further - will definitely consider

Good luck!

KaseKun
This looks great! I'm building www.monca.app Maybe we can share notes, I'm far more data than engineer :)