> There were only 12 people in the study, this can't have any statistical significance.
That's just mathematically untrue. I'm not saying anything about this particular study though.
(For example, here's a study with 12 healthy people that'll get you a statistically significant result. Have 6 of them run a mile, and for the other 6, have them run a mile with their legs tied together. You'll find, with plenty of statistical significance, that having your legs tied together worsens mile run time performance.)
No, I stand by my assertion. You might have a "statistically significant" result, but the sample size is just too small to know if it represents a real result or not. At best you can say they've discovered something worth investigating with a larger study. But you can't take the conclusions at face value.
That depends on the study and what kind of results it gives and what the numbers turn out to be. While you're now agreeing that you do get so-called "statistical significance," the probability that you've gotten a useful result can also be high, too. You can even get one with a sample size of 1 -- Eddington's solar eclipse experiment is an example of that.
edit: Also, the possibilities for statistical significance and real useful results can be much higher when you have a highly dimensional signal.
Fair enough, and my bad for not using the term statistical significance correctly. But we agree that it's entirely possible to have statistical significance that's completely meaningless. Lies, damn lies, and statistics. This is especially true for health studies, and very common with studies that show so-called gender differences when what's really happening is the variation among individuals of a single gender is larger than the detected variation between sexes. Then a result with a small sample size is really just noise and an attempt to publish a paper for the sake of publishing a paper by some academics with questionable competence or morals (or both.)
Yes. I would expect the typical health study like this with 12 subjects to be weak. It's quite possible (possible) for this one not to be weak is because it involves DNA, which is a highly dimensional thing. For example, if they set out to look at the (large) set of genes with property S and see what proportion of those had property P for all women and not-P for all men or vice versa, and found a result like, 50% of these genes are like this...
At that point you know this made-up result is not luck, there absolutely is something different about these people. (But it is possible it just so happens all the men in the study ate Froot Loops as a kid, and all the women didn't, and that's the cause of all this.)
There is a difference between stating a scientific finding and making a prejudice remark. Especially when the former isn't thinly veiled support for the latter.
I guess I'm being oversensitive because I'm reading the OP as implying that the term "sexist" is thrown around inappropriately.
Anything that doesn't result in equal outcome of greateness is sexism. For example, asking 50% reservation for women in soldiers going to war is sexism because war is not greatness, but preferring women 200% over men in STEM[1] is not sexism because doing science is greatness and women are still < 50% of sceintists.
Just joking of course. Women having different immune system functions means more funding for women specific medicine - hence it is good. Study of behavior at workplace based on gender doesn't generate funding because there aren't many women doing startups anyway.
You keep watching, in a decade or two when there will be enough women in startups that they will actually have any economical significance there WILL be studies conducted. And depending on how that turns out - if 'women better than men', it will be an 'evil corrected' story, and if 'women worse than men', state will intervene via laws to protect women's rights. It has already started actually.
This is why I took the risk of losing mod points and posted 'another decade' comment above.
An initial comment like this is particularly bad because it takes the whole discussion down a predictable generic tangent, instead of discussing the actual story.
I didn't introduce the topic. I only made the typical HN/Reddit-like comment so prevalent on anything like this if it were to show men/non-whites/Americans in a positive light.
From the paper: "Here, we survey variation and dynamics of active regulatory elements genome-wide using longitudinal
samples from human individuals. We applied Assay
of Transposase Accessible Chromatin with sequenc-
ing (ATAC-seq) to map chromatin accessibility in pri-
mary CD4+ T cells isolated from standard blood
draws from 12 healthy volunteers over time, from
cancer patients, and during T-cell activation. Over
4,000 predicted regulatory elements (7.2%) showed
reproducible variation in accessibility between indi-
viduals. Gender was the most significant attributable
source of variation."
A sample size of 12 is small, but makes sense since this is a new technique which enables researchers to identify personal variations in accessible chromatin landscape in
human T cells and trace their genetic, epigenetic, and disease associations. In exploratory experimental science of this sort, sample size is not really a relevant measure.
But, even with the small sample size, the results were interesting. In particular, this new technique demonstrates that there are significant differences in the genetic structure of the immune system, which appear to be sex linked. That is not a sexist statement, it is a fact.
18 comments
[ 3.4 ms ] story [ 56.4 ms ] threadThat's just mathematically untrue. I'm not saying anything about this particular study though.
(For example, here's a study with 12 healthy people that'll get you a statistically significant result. Have 6 of them run a mile, and for the other 6, have them run a mile with their legs tied together. You'll find, with plenty of statistical significance, that having your legs tied together worsens mile run time performance.)
http://www.nature.com/nrn/journal/v14/n5/full/nrn3475.html
edit: Also, the possibilities for statistical significance and real useful results can be much higher when you have a highly dimensional signal.
At that point you know this made-up result is not luck, there absolutely is something different about these people. (But it is possible it just so happens all the men in the study ate Froot Loops as a kid, and all the women didn't, and that's the cause of all this.)
I guess I'm being oversensitive because I'm reading the OP as implying that the term "sexist" is thrown around inappropriately.
How did you arrive at the distinction?
Just joking of course. Women having different immune system functions means more funding for women specific medicine - hence it is good. Study of behavior at workplace based on gender doesn't generate funding because there aren't many women doing startups anyway.
You keep watching, in a decade or two when there will be enough women in startups that they will actually have any economical significance there WILL be studies conducted. And depending on how that turns out - if 'women better than men', it will be an 'evil corrected' story, and if 'women worse than men', state will intervene via laws to protect women's rights. It has already started actually.
This is why I took the risk of losing mod points and posted 'another decade' comment above.
1. https://www.youtube.com/watch?v=B9ICcdpH2WA
https://news.ycombinator.com/newsguidelines.html
An initial comment like this is particularly bad because it takes the whole discussion down a predictable generic tangent, instead of discussing the actual story.
> I only made the typical HN/Reddit-like comment so prevalent on anything like this
Please don't make such comments here.
From the paper: "Here, we survey variation and dynamics of active regulatory elements genome-wide using longitudinal samples from human individuals. We applied Assay of Transposase Accessible Chromatin with sequenc- ing (ATAC-seq) to map chromatin accessibility in pri- mary CD4+ T cells isolated from standard blood draws from 12 healthy volunteers over time, from cancer patients, and during T-cell activation. Over 4,000 predicted regulatory elements (7.2%) showed reproducible variation in accessibility between indi- viduals. Gender was the most significant attributable source of variation."
A sample size of 12 is small, but makes sense since this is a new technique which enables researchers to identify personal variations in accessible chromatin landscape in human T cells and trace their genetic, epigenetic, and disease associations. In exploratory experimental science of this sort, sample size is not really a relevant measure.
But, even with the small sample size, the results were interesting. In particular, this new technique demonstrates that there are significant differences in the genetic structure of the immune system, which appear to be sex linked. That is not a sexist statement, it is a fact.