> It's important to keep in mind that there are always plenty of outstanding experimental anomalies in physics. At the moment, this is one of ~40 roughly equally credible hints towards new physics, and it's more likely than not that all of those hints will fade away over time. That isn't anybody's fault either: it has always been like this, and it happens because experiments are difficult and subtle.
You can go straight to review articles, which are generally available for free on the arXiv. Or if you want the firehose, you can scan for papers whose abstracts contain words like 'hint', 'anomaly', 'excess', 'discrepancy', and so on [0].
Because they're statistical artifacts, basically. P=0.05 means you're got a 1/20 chance of it happening on any given random test set where the bill hypothesis is true, after all. Physics uses far higher confidence levels, but also runs (effectively) massive numbers of tests. That's part of the danger of picking theories based on the data - each degree of freedom in interpretation multiplies your chances of having spurious results crop up.
Given the high statistical confidence they have, 7.2 sigma or 1 in 2 trillion, it's more likely to be some sort of systemic issue with the experimental setup.
I almost agree. This is the more probable explanation of the other ~39 anomalies that are at 2 or 3 sigma. As a rule of thumb, don't get too attached to a 2 or 3 sisma because there is a high chance that it is only a statistical fluke and the apparent result will disappear with more data.
But this cases has too many sigmas, 7!! And the group has a history of dubious discoveries, like the 5 sigma result in 2015 that was never reproduced. So I'm more inclined for a bad measurement method until an independent group can replicate it.
Isn't that just an earlier version of the same experiment? Doesn't seem too surprising that a broad distribution has a mean shift with a different experimental setup. I'd count this as a repeat of the same experiment. That of course doesn't rule out some flaw in their experimental setup that happens in roughly the same way in each repeat.
The mass of the result of 2015 is close to the current claim, so I have to correct may comment and say that it has not disappeared (yet).
But they have a 13.45+-.30 MeV result in 2012 with a significance of 3 sigmas [1] and a 12.0+-2.5 MeV result in 2008 (I can't find the significance, it looks like a 2 or 3 sigma) [2].
If it possible to get a false result by chance like 1/20 or 1/100 of the times, but they already got 2 of them. So I'm very skeptical of the new third claim.
(Also the story about the protophobic particle is strange. There have been more strange things, but this is strange anyway. And it's also not clear why the protophobicity hides the particle in all the previous electron-positron collision experiments in many other laboratories.)
Just to play advocate more, if you look at the broad excess in the angular plot in all those papers it shouldn't be surprising that this results in a broad and changing best estimates for mass. So without crunching the numbers, again its possible all these are measuring the same thing with a fluctuating best guess for mass. I think we shouldn't dismiss the latest result due to the previous results. I think we should wonder what could be the systematic issue that could cause this effect without it being new physics. I think the excess in all the experiments will likely have the same root, be it new physics or something else that is not yet understood. So don't count those previous papers against them, those are all measuring the same thing and the convention of physics to match to some theory is causing the precise conclusion to jump around. If you look at the actual raw data the effect is not changing too much.
The relevant graph are in the Figure 6 of the first paper and Figure 2b of the second. The idea is to match a simulation of the results you would expect if the new particle has different masses and compare it with the experimental data and see how good is the fit. The horizontal axis is the mass of the hypothetical particle in the simulation, and the vertical value is how good is the fit (lower is better). In both the 17MeV region is out of the interesting region. So if there is an effect, they did a very bad analysis before.
I think it's better to wait until another group can independently reproduce the results. It doesn't look too complicated, for someone that has a similar lab.
(It's not like the results of the LHC, where the reproduction steps start with: "First dig a 17mi long circle and then call for further instructions." :) Note that to try to avoid false positives, they have two almost independent groups in oposite points of the circle.)
I'm a physicist and I've experienced this on the small scale of my own humble work developing measurement equipment. When you observe a surprising effect, you try to make it go away. First, you check to see if it's reproducible under a variety of conditions. Then you search for sources of bias and error that you might have overlooked. You remove things that you think should be extraneous to the purported effect.
At some point, you're satisfied enough, and you publish. Then the rest of the community goes to work trying to do the same thing, with more care, possibly more money, and more minds working on it.
Decades ago, when doing physics and programming together, I discovered the parallel between my experiment revealing an anomaly unexplainable by the current scientific theories and my code revealing a bug in the current version of the compiler. The most likely eventual outcome was not fame and glory but more likely, "Oh! Oops. Never mind...."
Also the Pioneer anomaly. From 1998 to 2012 it hinted to new physics (alternate gravity laws) when the Pioneer 10 and 11 probes flied outside the solar system. Then in 2012 it was solved by accounting for the multiple scattering of heat radiation, as the probes are not convex bodies.
The Pioneer thing, I should collect on some bets. I was on the side of "not a new force, it's some kind of radiation pressure that we're overlooking by treating this like a sphere." Not long after I mentioned that, I attended a lecture by a guy who spent a lot of time working over Casimir effects on strange topologies yielding equally unlikely results. He said something to the effect of "never underestimate the numerous small anomalies created by minuscule forces on complicated surfaces."
I've been watching people look for a fifth force (and sixth) force in different flavors for decades. Maybe there's more out there but we have to work very hard to eliminate all of the numerous potential sources of error. If I had to lay a guess on it, it might take centuries of work find an additional force were it present.
I really think they should have known better, and done more diligence before announcing the anomaly. Superluminal anything implies clock skew issues, and iirc they didn't methodically eliminate those before going public. I don't think the director would have needed to resign if they hadn't taken the bait so eagerly.
Well, to paraphrase what Bellarmine wrote to Galileo, if it turns out to be true, then we've got some cogitatin' to do.
One route is to try and beef up the results, for instance by looking for similar results under different conditions. Then, if someone finds a pattern that ties these results together, there's the chance that they could write a theory. The big win is if theory and experiment can play off of one another as they both gain greater precision and breadth.
True. But all too often, people stop checking when their results agree with prior work. But then, eventually, someone is confident enough to publish results that aren't consistent with prior work.
Lots of reasons. Statistical fluctuation. Equipment malfunction. Misunderstanding of setup. Underestimation of systematic errors. Improper data analysis. Sometimes, new effects that were previously unknown but don't involve new physics.
I once asked a senior physicist what to think about a 4 sigma anomaly that looked like it couldn't just be a systematic effect. He instantly replied "then it's probably two systematic effects pointing in the same direction".
Reread parent's comment, the joke is that making a headline asking if that's true would be instantly answered no, making the law false by being true. It's a paradox. Sort of like Pinocchio saying "My nose will grow now!"
>The discovery is seen as taking us one step closer to the Holy Grail of physics: "unified field theory". This is a single theoretical framework which succinctly explains all the forces of nature.
how would this help. if anything it would make it harder, especially if there other forces, by calling into doubt preexisting assumptions about how physics works
It is "easier" to explain things when there is only one of them or many of them, but not in between. For instance, once we found there are many tens of elements, it was easier to group them in a periodic table, leading us to the discovery of just two (three) elementary particles that explain all elements. Once we found there are many tens of elementary particles, we were able to classify them in tables that made it obvious we need only a handful of leptons and boson to explain them all. The vague hope is that finding a new force will make it obvious what is common between all of them, leading to finding the simpler underlying object that explains them all.
If we were trying to figure out the logic behind a series of numbers and only were given the first four, and had no luck, wouldn’t we want to know the fifth?
yes except that fundamental forces are not at all like numerical sequences generated by a function. gravity and electromagnetism couldn't be more dissimilar.
If such a grand unified theory exists (analogously, if there is a “logical” function that generates the sequence rather than (pseudo)-random numbers) then gravity and electromagnetism couldn’t be more similar, right?
TL;DR: authors have a long history of discovering new particles at various masses, but these discoveries disappear on later studies with no explanation.
The credible measurements of new physics that are later ruled out are generally made at the edge of what is technically possible. Limiting and estimating all sources of systematic uncertainty is our job, but it is a difficult one. It is generally possible to make uncertainty estimates that are so conservative as to be beyond reproach, but to do so also makes progress almost impossible.
I haven't yet had a chance to dig into this particular anomaly at 17 MeV, so what follows is speculation: It is a surprising mass range for anything new to emerge. The coupling constant, or its mechanism, must be so weak that it would avoid discovery in a century of other nuclear-physics and particle-physics experiments that have access to that energy scale. I am surprised that there hasn't yet been a devastating constraint on this thing from the electron-positron collider world.
> If physicists are able to achieve the same result in the laboratory again, they can then work on understanding how that force operates and develop ways of harnessing its power.
Why don't they try to achieve the same result first, and then publish this article in the first place.
This article makes the same mistake as the CNN one. It’s “protophobic, meaning ‘interacts with neutrons instead of protons’", not ‘"photophobic, meaning ‘afraid of light’".
65 comments
[ 4.1 ms ] story [ 127 ms ] threadhttps://www.independent.co.uk/news/science/dark-matter-parti...
With link to not-yet-peer-reviewed paper:
https://arxiv.org/abs/1910.10459
I have the same comment as over there:
> It's important to keep in mind that there are always plenty of outstanding experimental anomalies in physics. At the moment, this is one of ~40 roughly equally credible hints towards new physics, and it's more likely than not that all of those hints will fade away over time. That isn't anybody's fault either: it has always been like this, and it happens because experiments are difficult and subtle.
0: https://news.ycombinator.com/item?id=21616084
0: https://arxiv.org/search/advanced?advanced=&terms-0-operator...
https://news.ycombinator.com/item?id=21617254
https://en.m.wikipedia.org/wiki/Multiple_comparisons_problem
But this cases has too many sigmas, 7!! And the group has a history of dubious discoveries, like the 5 sigma result in 2015 that was never reproduced. So I'm more inclined for a bad measurement method until an independent group can replicate it.
Isn't that just an earlier version of the same experiment? Doesn't seem too surprising that a broad distribution has a mean shift with a different experimental setup. I'd count this as a repeat of the same experiment. That of course doesn't rule out some flaw in their experimental setup that happens in roughly the same way in each repeat.
But they have a 13.45+-.30 MeV result in 2012 with a significance of 3 sigmas [1] and a 12.0+-2.5 MeV result in 2008 (I can't find the significance, it looks like a 2 or 3 sigma) [2].
If it possible to get a false result by chance like 1/20 or 1/100 of the times, but they already got 2 of them. So I'm very skeptical of the new third claim.
(Also the story about the protophobic particle is strange. There have been more strange things, but this is strange anyway. And it's also not clear why the protophobicity hides the particle in all the previous electron-positron collision experiments in many other laboratories.)
[1] https://www.lnf.infn.it/sis/frascatiseries/Volume56/Krasznah...
[2] http://www.actaphys.uj.edu.pl/fulltext?series=Reg&vol=39&pag...
I think it's better to wait until another group can independently reproduce the results. It doesn't look too complicated, for someone that has a similar lab.
(It's not like the results of the LHC, where the reproduction steps start with: "First dig a 17mi long circle and then call for further instructions." :) Note that to try to avoid false positives, they have two almost independent groups in oposite points of the circle.)
At some point, you're satisfied enough, and you publish. Then the rest of the community goes to work trying to do the same thing, with more care, possibly more money, and more minds working on it.
Like you, I've had this experience countless times when debugging a piece of code, usually my own :)
https://en.wikipedia.org/wiki/Pioneer_anomaly
I've been watching people look for a fifth force (and sixth) force in different flavors for decades. Maybe there's more out there but we have to work very hard to eliminate all of the numerous potential sources of error. If I had to lay a guess on it, it might take centuries of work find an additional force were it present.
One route is to try and beef up the results, for instance by looking for similar results under different conditions. Then, if someone finds a pattern that ties these results together, there's the chance that they could write a theory. The big win is if theory and experiment can play off of one another as they both gain greater precision and breadth.
Jeng (2005) A selected history of expectation bias in physics <https://arxiv.org/pdf/physics/0508199.pdf>
Also see Feynman's comment about the electron charge: https://en.wikipedia.org/wiki/Oil_drop_experiment#Millikan.2...
I once asked a senior physicist what to think about a 4 sigma anomaly that looked like it couldn't just be a systematic effect. He instantly replied "then it's probably two systematic effects pointing in the same direction".
https://en.wikipedia.org/wiki/Betteridge%27s_law_of_headline...
Any headline that ends in a question mark can confidently be answered no.
https://www.independent.co.uk/news/science/dark-matter-parti...
is better
or the Arxiv
https://arxiv.org/abs/1910.10459
how would this help. if anything it would make it harder, especially if there other forces, by calling into doubt preexisting assumptions about how physics works
That's what progress is in physics...
TL;DR: authors have a long history of discovering new particles at various masses, but these discoveries disappear on later studies with no explanation.
I haven't yet had a chance to dig into this particular anomaly at 17 MeV, so what follows is speculation: It is a surprising mass range for anything new to emerge. The coupling constant, or its mechanism, must be so weak that it would avoid discovery in a century of other nuclear-physics and particle-physics experiments that have access to that energy scale. I am surprised that there hasn't yet been a devastating constraint on this thing from the electron-positron collider world.
Why don't they try to achieve the same result first, and then publish this article in the first place.
An in depth discussion from last time at The Reference Frame (guest blogger for those who don't like Lubos himself):
https://motls.blogspot.com/2016/08/the-delirium-over-berylli...