Surely it isn't that surprising that the outcomes of two different experiments can end up providing the exact same information?
In fact this case can be inferred from the fact that the Beta distribution is the conjugate prior distribution for both the binomial and negative binomial distribution. There are many more distributions that have the Beta distribution as conjugate prior to one of the variables (in fact it's pretty much all distributions with a factor p or (1-p) somewhere).
It is often considered surprising and controversial. In particular, if the experiment performed included "controversial" stopping criteria then you could imagine the same data arising but not trusting each result identically.
Yep, I should add that portion. You're spot on. This was surprising to me because I've shown both models contain the same information but identical Frequentist hypothesis tests will show different p-values. This unshown part is what suprised me. The next post! :)
So I guess the problem here is that to calculate the probability that the likelihood exceeds a certain bound can't be calculated solely from the likelihood (+prior) itself.
Yet interestingly, the likelihood + prior is enough to make statements about the distribution of the parameters you're looking at. So you can say something about the certainty that your parameter exceeds a certain bound.
I suppose it really depends on your application which you'd want to use.
That's a Bayesian perspective, but the heart of the Likelihood Principle is that non-Bayesians/non-Likelihoodists can find reason to believe that the Likelihood doesn't really contain all of the relevant information for making inferences.
> "all of the relevant information for making inferences"
I think this terminology is way too strong. Obviously the context matters. For example, the way the data is collected (whether or not the data collector is a known liar/p-hacker, the sensor is known to malfunction at certain temperatures, etc) should affect inference.
Right, and the Likelihoodist/Bayesian would put those details into the model. Real world concerns get handled by each side in acceptable ways, but very special details about how sampling and posterior distributions differ are what make this tricky.
I read that pdf and it is not exactly rigorous. Eg page 4:
"Should depend only on the outcome observed and not on any other outcome we might have observed and
thus sharply contrasts with the method of likelihood inference from the Neyman-Pearson, or more generally
from a frequentist, approach. In particular, questions of unbiasedness, minimum variance and risk, consistency,
the whole apparatus of confidence intervals, significance levels, and power of tests, etc., violate the
conditionality principle."
and
"Here is yet another scenario that will not impress a conditionalist:"
You don't write a paper to trash a POV. You put your own thesis across. That thing is bollocks.
Frequentist analyses will depend upon assumptions of the sampling process which often include specific stopping conditions. This means that the _reason_ an experiment ends is an important part of data. That exactly defies the likelihood principle since it means that our outcome is dependent on information not observed.
Nice eye! In this case it's a no op and the function has no effect because I've used the `rowwise()` call such that the data frame is evaluated one row at a time x 1.
The `prod` call is an artifact of me previously using the function in a vectorized manner to calculate the model's likelihood.[1] This isn't the common way one might see. More often one would work with the log likelihood [2]. The reason being that the product of the density can be converted into sums avoiding overflow errors. The likelihood is __very cool_. I liken it to a grand generalization of the needle of a record player wrt to information (entropy).
21 comments
[ 106 ms ] story [ 595 ms ] threadIn fact this case can be inferred from the fact that the Beta distribution is the conjugate prior distribution for both the binomial and negative binomial distribution. There are many more distributions that have the Beta distribution as conjugate prior to one of the variables (in fact it's pretty much all distributions with a factor p or (1-p) somewhere).
Arguments exist for each side.
Yet interestingly, the likelihood + prior is enough to make statements about the distribution of the parameters you're looking at. So you can say something about the certainty that your parameter exceeds a certain bound.
I suppose it really depends on your application which you'd want to use.
I think this terminology is way too strong. Obviously the context matters. For example, the way the data is collected (whether or not the data collector is a known liar/p-hacker, the sensor is known to malfunction at certain temperatures, etc) should affect inference.
I don't follow.
"Should depend only on the outcome observed and not on any other outcome we might have observed and thus sharply contrasts with the method of likelihood inference from the Neyman-Pearson, or more generally from a frequentist, approach. In particular, questions of unbiasedness, minimum variance and risk, consistency, the whole apparatus of confidence intervals, significance levels, and power of tests, etc., violate the conditionality principle."
and
"Here is yet another scenario that will not impress a conditionalist:"
You don't write a paper to trash a POV. You put your own thesis across. That thing is bollocks.
The `prod` call is an artifact of me previously using the function in a vectorized manner to calculate the model's likelihood.[1] This isn't the common way one might see. More often one would work with the log likelihood [2]. The reason being that the product of the density can be converted into sums avoiding overflow errors. The likelihood is __very cool_. I liken it to a grand generalization of the needle of a record player wrt to information (entropy).
[1] https://en.wikipedia.org/wiki/Maximum_likelihood_estimation#...
[2] https://en.wikipedia.org/wiki/Likelihood_function#Log-likeli...