13 comments

[ 3.9 ms ] story [ 39.9 ms ] thread
Bayes' rule is quite easy to understand as a Venn diagram, though the linked article doesn't seem to use this fact. But here's a blog-post that does: http://oscarbonilla.com/2009/05/visualizing-bayes-theorem/
The Venn diagram makes visualizing the update so easy, you start to wonder why the Bayes rule is a "thing" at all.

It works especially well with the examples, like Yudkowsy's breast cancer screeening example.

Being able to prove the Total Prob. Theorem and from there the Bayes Theorem has helped me solve problems (granted from a textbook and not real-life ones).

-> In the problem, the sample space comes divided into mutually disjoint portions.

-> Using the definition of probability, we can compute joint distribution from the a-priori distributions.

-> Using the definition of conditional probability, we can flip around the inference direction.

I usually find that all problems (Naive-Bayes spam, cancer) etc. all show this pattern.

I don't quite get the steps after cutting off the other branches. The original diagram didn't seem to get updated.
The original diagram isn't important any more. It is replaced by the new values that are the results of the experiment. Kind of like:

  world = get_world()
  for experiment in experiments():
    world = combine(world, experiment())
The original world doesn't exist after the first experiment. The experiment has provided us a new world.
There should be a law that you only get one paragraph and one figure when explaining Bayes' rule.
I'll give it a shot and get back to you. Should be doable.