"Their generation's name has become..." is (and pardon my insistence) what racist people have said about blacks forever. "Black people's name is synonymous with theft", for instance.
That is why those kind of expressions in an abstract and intellectual (hopefully, here in HN) setting do harm.
> In 2022, evaluating original research is harder than ever, due to hyperspecialization. For a typical Ph.D. thesis, there are less than five people in the world qualified to evaluate whether it's worthy of a tenure-track position.
That's simply not true for a typical PhD thesis at all. It certainly doesn't jive with my own experience, so I'd like to cough up a few examples please.
(Do hyperspecialized PhD theses like the one you describe exist? Certainly! But I refute the idea that such these are typical.)
I generally disagree with the premise that scientists are becoming less productive. (To me, the complaints that there are no more grand fundamental discoveries is alike to complaining that we are not discovering any new continents on Earth...)
On the subject of incentives in academia - reflecting on my academia run, I've noticed that I was the most creatively productive when I had a longer planning horizon in front of me. It was either at the beginning of a several-years position. Or at the very end when I knew that I'm leaving and didn't care anymore. The least productive was the sequence of one-year postdocs - when I was constantly worrying about the next one.
I can't speak to all science, but I am a CS (cryptography) researcher and routinely read papers from the 1980s. The level of rigor and quality of my field's papers has absolutely improved, by leaps and bounds. The formal definitions in those early papers are often non-existent (and sometimes wrong in retrospect) and the proposed constructions are often much simpler (and sometimes subtly wrong in retrospect.) And the number of papers has increased by at least an order of magnitude.
On the flip side, those early papers contain the most fundamental discoveries in our field: you're only going to invent RSA or blind signatures or zero knowledge once. It's possible all those researchers were much smarter than we are now. (I grant this!) But there are a lot of absolutely brilliant people I know today. Alternatively, the lower-hanging fruit is all gone and the problems have become much harder.
What's amusing about my field is that while much of the rigor was lost (computational biology in the 90s was very CS-rigorous), what we've learned is that deep networks beat any human features, none of the rigors of chomsky hierarchy really matter to find interesting biology, and you don't even need to know how to differentiate because that's automatic now.
> you're only going to invent RSA or blind signatures or zero knowledge once.
Well, maybe. Sometimes things that are discovered are lost or go completely unnoticed, so progress is not always monotonic. For example, for a long time it was believed that John William Strutt first documented dynamic soaring [1] in birds in the 1800s, but just recently (2018) it was found that actually none other than Leonardo DaVinci documented the phenomena in his notebooks centuries before [2]. People just didn't notice or forgot, despite those documents being some of the most poured over in history.
Sometimes people just aren't ready for new knowledge or they don't know enough to understand it. I see this when new person enters an industry, healthcare in my case. It takes about a year to understand the nuances between healthcare providers, funders and administrators. I am guessing people read what Leonardo wrote but they just didn't understand the significance.
Good point. The same thing definitely happens in physics too. For example, people attributed important advances in mathematical physics (such as the mean speed theorem) to Galileo despite them having been already developed extensively in the middle ages.
Technically - yes. But it 's just that, a paper. Back then , people were chasing glory, not "the paper" because papers didnt matter, that s why so many of them were too short, unreferenced etc. Science was small and more personal. Now it's an impersonal industry and science is a product. Science gets a lot of underserved respect out of inertia, but it really is a big industry sector now.
I can only talk about computer science. The research papers in the past would probably not be able to get published in prestigious journals today. They'd need to get expanded from sketchy 8 page papers into very rigorous 25 page papers. I think we've overshot though. With papers in the modern style you need to wade through a lot of cruft to get to the key idea. As for the quality of the ideas...the older papers do win. I think that's because there was more low hanging fruit, but some part of it may be due to an incentive structure that rewards safe bets.
This is a trick question. How do you quantify quality of articles? How much new science they created? We can't know that yet. What they provided in term of societal impact? SameThey reproductibility, lot of chemistry and biology from the 50s turned out to be really wrong for example.
I would still say that the average quality (in my field), chemistry is lower but just because there is a deluge of really low quality publishers and journals that have no ethics. But if you stay in the major journals of fields, the answer is radically different.
I generally disagree with the premise that scientists are becoming less productive.
This one's tricky to measure. If you go by the number of words published, they're a lot more productive than they used to be. Ten papers won't even get you tenure. In terms of metrics, the game is a lot more competitive.
I would argue that the bigger problem is that academic science is now consumptive. Think of all those tuitions dollars the universities get because they run a protection racket over (what's left of) the middle class job market. Now consider how terrible the academic job market has been for the past 30 years, and that professors who want even a chance of getting respect basically need to self-fund by getting grants. Lots of money is going in, and how much is coming out? Something, for sure, but is it worth it? Or is it like U.S. healthcare, where we're paying 4x for a not terrible but merely acceptable product?
I was the most creatively productive when I had a longer planning horizon in front of me.
Right, and this kind of opportunity has gone extinct, due to the hypercompetitive culture you get as our society disinvests itself in research and as funding becomes harder to find and more winner-take-all. If the neoliberals have their way, being a professor will just be another next-quarter focused corporate job within ten years.
> the most creatively productive when I had a longer planning horizon
I feel the same way. I've never been in academia, but everything he said matches the negative incentive structures I've always seen in the corporate world. For the most part, the incentive structures are designed to catch cheaters (or "slackers"), but since actually discovering and creating something is virtually indistinguishable from "slacking", it just doesn't get done.
> the complaints that there are no more grand fundamental discoveries is alike to complaining that we are not discovering any new continents on Earth.
And this is a very real issue, for instance in physics. It means that if you go for research there, it is likely to be meh.
I did my PhD in physics, I was thankfully at a moment where simulations and ML were just starting so I could have fun. There was exactly zero interesting discoveries in nuclear/atomic/particle during my time in academia. And the 40 years before.
Compare this with 1090-1950. These years were simply incredible (especially the ones around 1900, to ~1920). You had almost every day discoveries that were shaking the world, and everyone was aware of that.
This is not the fault of the scientists, this is just that the world is like this. It is indeed like complaining that there are no more continents, but then the reasonable thing to do it to invest more in teaching, or applied science.
My supervisor told me recently that it is very risky to focus on breakthrough topics except when you are doing PhD or if your are tenured. probably less true for PhD if you don't have ambitious PI. The demand for publications and results that is mainly the way to evaluate you starting from postdoc until tenure promotion is very tense. People usually try to do many things and stretch themselves. sometimes this even lead to burnout and many people leave academia for that adding to the very competitive and low gain opportunities available in most academic field.
To be honest, I really think that we have wrong metric. Most importantly, if you try to ignore them even if you get some local support within your group. Good luck getting any fund because funding agencies evaluation have the same problems.
> My supervisor told me recently that it is very risky to focus on breakthrough topics except when you are doing PhD or if your are tenured.
Academic researchers spend the majority of their career in tenure or in PhD, with untenured/tenure-track status for only 7-9 years out of a career of, say, 40 years. So one would expect that 75% of academic research time would be spent on "breakthrough topics".
Academic researchers who make it to a tenure track position and stick with it for the rest of their career spend the majority of their career in tenure or in PhD. Most do not make it this far because there are fewer positions than applicants.
You will be right under the assumption that all or even most academic careers end up with a tenure. Majority of PhD holders don't end up in that position because the positions available are very limited.
> To me, the complaints that there are no more grand fundamental discoveries is alike to complaining that we are not discovering any new continents on Earth...
anyone of any era could claim this. and many did. yet here we are, still discovering things, and not discovering new continents.
it is folly to assume that we have discovered everything, or even a small fraction of everything.
I think you will find that it is difficult to find someone who has been vetted by a system who would be open to admitting that said system is fundamentally flawed, especially when successful passage through that system grants things that those who have been through it want to have, such as academia does.
I 100% agree that academia is flawed. But I think the reason we're not making grand fundamental discoveries is that the "low-hanging fruit" was already done.
We definitely haven't discovered everything, and we're actually making way more discoveries much faster than people back then. But the things which are easy or even "not super hard" to discover have already been discovered. Most of the discoveries require background knowledge or are more "niche" things, because discoveries which are really big and affect everyone are easy to find and going to have everyone searching for them.
In fact we could maybe discover a new continent. But it would have to be tiny or underwater or camouflaged or otherwise have some reason that despite having a map of the whole Earth and satellites everywhere, we haven't discovered it yet. When Columbus "discovered" America there weren't nearly as many ships floating around as there are boats/planes/satellites today.
Literally your post, the top comment on the thread, leads with an unabashed claim that humans have already discovered all of the “major advances” in the sciences. It’s flabbergasting.
That is completely inaccurate. They didn't say anything like "humans have already discovered all of the “major advances” in the sciences".
They said that the big obvious discoveries have been discovered. There's very little in physics now that doesn't require thousands of person hours, millions in equipment and unbelievable amounts of computing resource.
The stuff that could be discovered by someone working alone has pretty much all been done, because we've already thrown millions of person hours at it.
That's not to say there aren't major advances to be made, it's just REALLY HARD.
They absolutely did not say anything about “obvious” discoveries. That is even more ridiculous of a claim. Which major breakthroughs in stem were “obvious”? Or are you speaking from hindsight, where in this brave new world we’re smarter than all previous generations?
They also did not say there are major advances but they are “really hard” (your words), they said there are no major advances left (by comparing them to continents, which we’ve already all discovered). There is no other way to interpret their words, unless you believe there are additional continents on earth to discover. Maybe atlantis?
The OP is not commenting on individual contributors vs large groups but I will comment on that as I disagree. You are describing the current state of physics (and many other stem fields) and the popular consensus about future advancements. While certainly having hundreds of researchers is necessary on many projects, you have no basis to claim an individual will not make a major breakthrough in the distant future. And frankly, as much as they are necessary, giant labs are strongly encouraged by our current culture. Large profits from monetizing research into products, corporate involvement and funding, staggering bloat in universities, fame-chasing, printing off papers like buzzfeed articles, unprecedented levels of organized fraud in academia… very little of the current culture is conducive to modest, brilliant individual contributors in many fields.
You have no idea how the culture will change in science, how much more intelligent and capable people will be than we are in the distant future with natural selection and gene modification, and whether there will be any more breakthroughs by individuals or small groups that will seem “obvious” in hundreds of years. To say otherwise is frankly dogmatic caveman thinking.
“Obvious” was probably the wrong word there. I think “achievable” is probably more apt.
Poor choice of words aside, the point stands.
And as for humans being far more intelligent in the future, I don’t buy it. Maybe in millions of years with evolution, but I’d bet on humanity either killing itself or replacing itself before that happens.
A million years? Let’s crunch the numbers. I think the intellectual honest would acknowledge ashkhenazi intelligence differences. That took quite a lot less than a million years. And certainly intelligence is being selected for more than ever. We’re just, as a race, starting to experiment with gene modification. Would it really surprise you if minor modifications in intelligence aren’t made? It’s not going to be a million years for a significant leap bud.
As for the other point, it is indeed standing, on air.
> I've noticed that I was the most creatively productive when I had a longer planning horizon in front of me.
Assuming that this is generally the case (which I do), and given that longer planning horizons have become rare in academia over the past decades, the logical implication does seem to be that productivity in science decreases.
How to measure and how to value academic productivity is another interesting question.
Man, I wish I could use my real name for this reply, but for political reasons I can't (in fact, I change my username regularly) because I have a lot of insight into this problem, why it exists, and why it probably won't get better barring a complete overhaul of our socioeconomic system and the myriad corrupt institutions that support it.
We live in an age of institutional decline and it is severe. You see this in (trade) publishing. Your publisher no longer builds your reputation; the publisher has pushed that responsibility unto the author. The ones who already have the personal resources necessary to market their books get further validation and credibility; the ones who don't will go unheard. Academia's the same way: universities no longer provide funding for people of excellence; rather, they have put the onus of funding on the professors themselves--you'll get more funding (and published in better places) on account of using their name, and for that they take a cut. The relationship has inverted; rather than nurturing emerging talent, these institutions are nurtured by emerging talent, and this vampirism is sustainable because those talented people have no other choice insofar as all the other institutions are failing at approximately the same right.
Consequently, we have widespread duplicated effort, channel-flooding due to metrics-gaming (gotta get that h-index into the three digits before tenure time) and a corporatized, mediocre culture in which agreeability (negatively correlated with excellence and conscientiousness) matters far too much and salesmen run the day.
Historically, there were nations of priests and nations of warriors and nations of farmers. We've become a nation of sellers; but we no longer have much to sell but our own talk.
I don't know, for sure, how to solve this. Anyone who pays attention can see that capitalism (which invariably becomes corporate capitalism) is a dead end at a 21st-century technology level... but of course the eradication of capital is merely a necessary, not a sufficient, condition for scientific excellence. Going socialist is mandatory if we want to fix this, but alone does not guarantee much--there are a lot of cultural changes that probably need to happen before we can build healthy institutions again.
>Going socialist is mandatory if we want to fix this
Of course, the lede is buried exactly where expected. How novel an idea it is that the the system is separable from its components and that utopia is indeed achievable if only the rest of the world would wake up and learn to serve your idea of a higher purpose. The inevitable counterpoint is that the system is responding predictably and efficaciously to a change to its environment: more undergraduate funding leads to more students pursuing graduate degrees and a greater deal of competition in the academic space. The "problem" is self-correcting. It turns out science doesn't need happy scientists.
The reason why you don't attach your name to comments like this is because your possession of a name worth attaching would preclude this comment from existing.
> The reason why you don't attach your name to comments like this is because your possession of a name worth attaching would preclude this comment from existing.
Socialists are actually oppressed in many countries
This comment is spot-on. We've traded actual productivity for the appearance of productivity as thrift.
Yes that's primarily due to capitalism, specifically neoliberalism, crony capitalism and late-stage capitalism.
Unfortunately socialism isn't enough to save us, because even democratic socialism demands full employment, which is increasingly at odds with automation and UBI.
I don't believe that we have come up with a system yet that incentivizes the kind of one-off revolutionary invention that most of us got into programming for in the first place. The kind of economy where a single invention frees millions of people from forced labor.
Sergey and Larry come up with PageRank and suddenly everyone wants their search engine and they're set for life. Google wins the internet lottery and keeps all of the trillions of dollars. What about the rest of us? We invent something and our business fails due to long-tail effects and we die broke. 90% of businesses fail in their first year. So it's becoming increasingly competitive as tech improves - the ultimate tragic result. Which self-evidently trends toward a crisis of techno-capitalism in the future: The Singularity. Probably the last failure in human history.
We're looking at a situation by the end of the decade where one guy generates an entire movie from notes scribbled on a napkin with some future variation of DALL-E 2 and makes a million dollars. Meanwhile another guy who doesn't have the right connections spends his life working in the service industry as a wage slave.
Meaning that the most likely indicator of someone's success is a coin flip as we enter this era of neo-fuedalism.
Meaning that civil unrest and violence are all but inevitable now (just turn on the TV to see it everywhere).
Now, I think a lot of people on HN and the world at large have not tried working for themselves, so have no idea how hard money is to come by. Sure, we can make a quarter million dollars every year working 40+ hour weeks at a FAANG company. But make that from a personal project? Highly unlikely.
Writing this now, I have given up on a solution to this coming from the top. People close to me, even the majority of people on HN, don't seem to get it. They'll never get it. Something in the idea of UBI irks them deep down inside, just like with student loan forgiveness. So it's over.
On a personal level, I'm looking towards solarpunk and local cooperatives that create resource streams for people outside of the financial incentive. I think it's possible to invent robot kits that provide things like hydroponic produce for very low cost. Once people have their basic needs met, it liberates them from having to beg for grants or even a job. Which is why the entire status quo is geared against this. Rents and basic expenses will squeeze us even harder before the end. Expect crushing regulations against off-grid living, just like how rain barrels have been criminalized in the southwestern US.
Academia has become big business. Over a period of 30+ years I have observed that part-time admin roles that were filled by academics are now run by full-time corporate types. Their primary mandate is to increase profits and thus inflate their own salaries.
As for successful grants, I have seen that, now, 50% of the amounts immediately goes to "overhead" and the PI needs to pay for stipends and equipment from the remaining 50%, yet there are further "transaction charges" even those activities.
The publishing, grant winning, etc are simply "KPIs" so beloved by the MBA hordes.
What I found incredible is the lack of push-back from academics against the encroaching takeover by the biznoids. Speaking of whom, they don't give a damn about research, academia is merely yet another territory to which they extend their rent seeking (for themselves) activities.
> What I found incredible is the lack of push-back from academics against the encroaching takeover by the biznoids.
Paradox of tolerance. Academics were too peacefully inclined to realize what is happening to them and their jobs until it's too late.
As the left re-emerges, I hope it will evolve into something with some fight in it. De-corporatization is going to take decades and it's not all going to be pretty.
I agree with point #1, but disagree with point #2.
Academic research is not a place to go for extrinsic motivation. If you're not primarily in it for love, you're going to have a bad time.
An example: Who has heard of the Wolf Prize in physics? It is in the set of prizes known as "second prize to the Nobel Prize", yet essentially nobody outside of the field will react with, "Whoa, she won a Wolf Prize? She must be really good."
Even in the well-resourced research groups, researchers will be find much better extrinsic reward outside of academia. Advancing the boundaries of our understanding is priceless intrinsic motivation for those who can find a way to stay, but doing so requires substantial sacrifice -- more than many of those in academia realize.
I'm far from convinced that science is less productive as a whole than it was in 1900, though I'm sure the average scientist today isn't as productive as Max Planck (but of course he was above average in his own day as well).
Something I think would help the incentive situation is providing more incentives for teaching and service. My grandfather was a professor emeritus and I can't find any record of him authoring a research paper (or a PhD thesis for that matter) but even 30+ years since he last taught I still run into people who rave about the formative experiences they had in his classes. He's a minor celebrity among local engineers of a certain age.
Such a person could still provide a lot of value, but it's harder to measure.
That's a nice story, but teaching =/= research and I fail to see how this is related to research productivity. If anything the relation is inverse because, as you said, he doesn't have a publication record, so from the perspective of research he was basically useless.
If we are trying to improve research productivity, then removing or dramatically reducing teaching responsibilities for researchers sounds a lot more sensible. Besides, modern pedagogy is getting increasingly complicated and having teaching specialists can be much more beneficial to your average 1-2 year undergrad.
Not to diminish his teaching career, it sounds very valuable, but not in a way that's directly relevant to the OP.
It's simple! Grant applications are so hard because they are so competitive. They are so competitive because a lot of people want to be professors. Currently, to succeed as a professor you need a research grant.
If, instead, we made it easier to advance your career as exactly the kind of pedagogy specialist you described (as well as through leadership in professional organizations, work in the community, and all the other kinds of service), I believe you would get fewer applications to those research grants. It might result in better post-secondary education as well.
> if grant applications are valued enough (e.g., needed to get promotion), scientists may be willing to spend even more time than is rational to do so
This isn't worded properly. It's clearly rational for the scientists to spend time on the pursuit of grants. Otherwise they wouldn't be doing it.
$100 in grant money is not the same as $100 in university income. In fact, the whole point of the grant is to cover the cost of doing research, and in principle should leave the university's net revenue unchanged. (In practice, overhead changes that, but that's a different topic.)
The problem is that the university's objective is to spend as much on research as possible. Grant money is simply the fuel for that process. All else equal, more expensive research is very strongly preferred, because that increases research spending, and that improves the standing of the university.
That is a seriously distorted set of incentives. All perfectly rational. Just insanely stupid.
> It's clearly rational for the scientists to spend time on the pursuit of grants. Otherwise they wouldn't be doing it.
Is that worded properly? Are you really saying that nobody would ever do something irrational?
If that's not what you mean, then we have to look at what "rational" means here. I think parent didn't mean "rational" in the sense of "maximising personal gain", but "maximising output of quality research".
> It's clearly rational for the scientists to spend time on the pursuit of grants. Otherwise they wouldn't be doing it.
This is one of the reasons why I left academia. The insane run for grants was just starting and i said that I do not have any intent do do that.
I was a scientist. Doing science. Not filling in papers and going to belly dancing shows.
When I was told that this is compulsory and nobody else is going to do it, I sad good bye and left for the industry. I was earning 10x more, had no worries about funding or copier paper. Plenty of my friends did it and then academia was crying because of the brains drain and how unfair it was. The salme who said that grats are compulsory (they were sitting in the various jurys to accept them, instead of doing science)
I'm an assistant professor in a medical school in the US and agree in general with the article. It takes an absurd amount of time to write a grant application, time that could be spent doing science - but we faculty don't have any choice if we want to continue our careers.
I am the first grad student of an assistant professor (chemistry/biology). Seeing her writing workload has made me a lot less enthusiastic about being a professor myself. I like writing about science, but the constant treading water mentality makes it difficult to 1) find the mental space to be creative and 2) take the risks that are often necessary for innovation, especially since the careers of your trainees are on the line. The kicker is that most grant writing isn't even about science. Good luck with your lab!
Same exact experience - I finished my CS PhD in 2005 and thought I would go into academia, but decided not to given how much of academia seemed to be just writing grant proposals vs. actual research.
FWIW, also decided not to go into academia because of how much smarter I realized I needed to be to be a top tier academic!
I agree, specially with the 2nd point. You can see this in virtually every academic institution where researchers will find all ways to simply "plot" good results, i.e., beat the data until you find what you want. The intrinsic value of the research is nearly 0, because all that matters is to get things published to attract citations that will help them in getting promotions and prizes.
Earlier this year I was exploring a web3 industry 4.0 open science solution rethinking how research is performed, by who (or what), skills required, deliverables (no journals needed), a semantic knowledge base of results good & bad, validated through repetition, a framework for how experiments are managed.
"It discourages rigorous research as it is difficult to obtain enough results for a paper (and hence progress) in two to three years.
The constant stress drives otherwise talented and intelligent people out of science also."
- Anonymous
"End the PhD or drastically change it. there is a high level of depression among phd students. long hours, limited career prospects, and low wages contribute to this emotion."
- Don Gibson, Scientist at BioConsortia
Funding "affects what we study, what we publish, the risks we (frequently don't) take, it nudges us to emphasise safe, predictable (read: fundable) science"
- Gary Bennett - Neuroscientist at Duke University
"We need to recognise academic journals for what they are: shop windows for incomplete descriptions of research, that make semi-arbitrary editorial [judgments] about what to publish and often have harmful policies that restrict access to important post-publication critical appraisal of published research."
—Ben Goldacre, The Datalab, epidemiology researcher, physician, and author
"The BMJ found that one-third of university press releases contained either exaggerated claims of causation (when the study itself only suggested correlation), unwarranted implications about animal studies for people, or unfounded health advice."
- https://www.vox.com/2014/12/10/7372921/health-journalism-sci...
I agree that scientists are discovering less, but I don't think it's mostly about their incentives. Instead, I think it's that there is much less low-hanging fruit than there used to be, and a lot more people trying to pick what fruit there is. You can see the difference by looking at new fields that have recently stumbled upon something very different, like all the progress recently in deep learning. More in this general direction: https://astralcodexten.substack.com/p/the-low-hanging-fruit-...
Commenters and even Lemire are really missing the two points of major inefficiency.
(1) Making 30 researchers spend time on grants when only 1 wins is a waste of researchers time, regardless of productivity.
It's a system built for bureaucrats who don't know to evaluate work-product from those who do by comparison if not mutual critique. It's a wealth transfer from researchers to taxpayers.
(2) Grants always are on topic, but the topic is mostly selected to avoid political embarrassment. In the 1990's, it was HIV. In 2010 it was Alzheimer's Amyloid Beta. Then computer security. Unlike the internet or jet engines, these have not panned out as foundational research (except perhaps for some of HIV). Again, topics are selected not to deliver value to citizens, but to politicians.
Yes, this is inefficient. Yes, academic bureaucracy sucks and the publication game is easily corrupted and early advances are more relatable than later ones.
But the real problem with science in the U.S. is that there are not enough jobs for scientists, because companies are happy to get research and development done more cheaply elsewhere. Companies have only disincentives to develop local labor pools.
That's the negative incentive that dwarfs everything in academia and publicly-funded research.
Then computer security. Unlike the internet or jet engines, these have not panned out as foundational research (except perhaps for some of HIV)
In what word is computer security not a foundational topic? There's lots of reasons to critique the way NSF/NIH/DOD/etc allocate funding, but this is definitely not one of them.
> But the real problem with science in the U.S. is that there are not enough jobs for scientists
Are there other places where the science-funding mechanisms work well? Otherwise I do not see why your argument about companies being cheap makes sense.
> Yes, this is inefficient. Yes, academic bureaucracy sucks and the publication game is easily corrupted and early advances are more relatable than later ones.
How would you promote teaching and knowledge transfer while not needing to do this? On the job learning?
Another interesting factor. PhD stipends are getting gobbled up by inflation. I wonder how many people will forgo starting a research career because they want to be able to pay rent.
>>> In the first half of the XXth century, there were relatively few scientists, and these scientists were generally not lavishly funded
This statement may not be entirely accurate. Philosophers, scientists and mathematicians in the early 20th century and before that were independently wealthy or had some sort of “royal” patronage that allowed them to pursue their interests for “public good”. Things changed in the later part of the 20th century but a scientist was a rarified breed until the 1970s. I don’t think most people had the means to pursue a scientific career. Grants and funding exploded at the end of the 20th century and foreign students (especially from China and India) provided the “cheap labor” that’s needed for a lot of the STEM fields PhD/post-doc armies. This has essentially led to a proliferation of scientists in academia. Abundance of school loans means universities can expand teaching faculty and then add research responsibility. It’s a vicious cycle.
To comment on the 40 days to make a grant application, yes that's close to what I used to spend. But the worst part is that on most grants you are not alone. I'd estimate participation looks like a power law. PI spends most of the time, another or two helpers spent a good week or so. And then the long tail of others that contribute between a tiny paragraph to nothing. Plus you need to take into account the money and personal management, that takes a chunk of the researcher time. And usually you are also part of committees to review grants and this takes a lot of time too and make the system "work". Now science is not a single person thing on most grants, the PI isn't doing much or at all of the lab work and most of it is done by postdocs, PhDs and other non-tenured personnel. So you can't compare with the old days. Another factor is that in the old days, there was a lot of unnamed personnel that was doing the dirty work of setting up experiments, tabulating data, writing and typing the articles and so on. They also often contributed on the "scientific work" itself, but this often was not recognized either.
>In the first half of the XXth century, there were relatively few scientists, and these scientists were generally not lavishly funded.
But aren't there still some scientists who work outside of grant funding and prestige ratrace? People at industry research labs who don't write grants, and aren't trying to impress a tenure committee, for example. Shouldn't we be able to point to them and say, "look how much more productive they are"?
> for a single successful research grant, hundreds of days might have been spent, purely on the acquisition of funding.
I'm a former professor who has written many proposals and won some of them. I've reviewed many more.
I did a lot of thinking and research when writing proposals. In a proposal, I tried to clearly explain the state of the art and how it could be extended, what resources I would need to do that, and how that work could be structured to make success more likely. I might even do a pilot study to show that the key idea is promising. Note that 'how to extend the state of the art' can be a seriously creative inventive step, or it could be the obvious next thing. But creativity does happen at proposal stage, and it certainly factors in my reviews of other's proposals.
My point is that writing proposals is not entirely a waste of time. It's a bit like writing a movie script. It's not a movie, many scripts never become movies, but for some movies some of the best ideas were in the script. Same for proposals.
From what I remember, it's not uncommon for proposals and actual work to be disjoint. Back when I was in academia, you'd hear of PIs writing a proposal, getting a grant and then deploying that on a completely different project.
Sure, if you have a better idea, redeploy the money. But if your best idea was in the proposal, you will work on it. That does not invalidate the proposal as a driver of clear thinking.
Sidetracking a bit the conversation. What a coincidence that the author (Lemire) is also represented on Today's #1 "Ask HN: What are some cool but obscure data structures you know about?" as he is the main contributor of RoaringBitmap https://github.com/RoaringBitmap/RoaringBitmap and one of the main authors of the data structure.
I'm not sure that science as a whole is less useful than it was in 1900, but I'm sure that the average scientist today isn't as useful as Max Planck (but of course he was above average in his own day as well).
>> You should not underestimate the effect that constant administrative and grant writing might have on a researcher: many graduate students will tell you of their disappointment when encountering high status scientists who cannot seem to do actual research anymore.
While I don't have the data to support this my intuition is that there are now many, many more researchers than in earlier years- both senior researchers who already have a career and junior researchers that are trying to get theirs started.
The amount of science funding probably has also increased, but there are just too many people exiting PhD programmers for all of us to find cozy research jobs where we are free to pursue our interllectural interests undisturbed while the public money slowly but steadily drips in.
In other words, a moderate pot of grant money combined with a huge number of new PhDs makes for huge competition.
85 comments
[ 2.8 ms ] story [ 158 ms ] threadTuring Award winner Michael Stonebraker talked about this at length here:
https://www.youtube.com/watch?v=DJFKl_5JTnA
Some points:
- Original (risky) research is detrimental and likely fatal to a career in science
- Actually creating systems doubly so
And there are more non-graduate boomers than graduate ones.
That is why those kind of expressions in an abstract and intellectual (hopefully, here in HN) setting do harm.
That's simply not true for a typical PhD thesis at all. It certainly doesn't jive with my own experience, so I'd like to cough up a few examples please.
(Do hyperspecialized PhD theses like the one you describe exist? Certainly! But I refute the idea that such these are typical.)
On the subject of incentives in academia - reflecting on my academia run, I've noticed that I was the most creatively productive when I had a longer planning horizon in front of me. It was either at the beginning of a several-years position. Or at the very end when I knew that I'm leaving and didn't care anymore. The least productive was the sequence of one-year postdocs - when I was constantly worrying about the next one.
Do you believe the average academic research paper or project written/done today is of the same quality or better as the average in 1980, or 1950?
On the flip side, those early papers contain the most fundamental discoveries in our field: you're only going to invent RSA or blind signatures or zero knowledge once. It's possible all those researchers were much smarter than we are now. (I grant this!) But there are a lot of absolutely brilliant people I know today. Alternatively, the lower-hanging fruit is all gone and the problems have become much harder.
Reminds me of a patent officer who said in 1899 that "everything that can be invented has been invented."
Well, maybe. Sometimes things that are discovered are lost or go completely unnoticed, so progress is not always monotonic. For example, for a long time it was believed that John William Strutt first documented dynamic soaring [1] in birds in the 1800s, but just recently (2018) it was found that actually none other than Leonardo DaVinci documented the phenomena in his notebooks centuries before [2]. People just didn't notice or forgot, despite those documents being some of the most poured over in history.
[1] https://en.wikipedia.org/wiki/Dynamic_soaring
[2] https://royalsocietypublishing.org/doi/10.1098/rsnr.2018.002...
What do you mean by that? Good writing? Good rigor? Good research work? Have a fundamental discovery? There are not as correlated as one expects.
This one's tricky to measure. If you go by the number of words published, they're a lot more productive than they used to be. Ten papers won't even get you tenure. In terms of metrics, the game is a lot more competitive.
I would argue that the bigger problem is that academic science is now consumptive. Think of all those tuitions dollars the universities get because they run a protection racket over (what's left of) the middle class job market. Now consider how terrible the academic job market has been for the past 30 years, and that professors who want even a chance of getting respect basically need to self-fund by getting grants. Lots of money is going in, and how much is coming out? Something, for sure, but is it worth it? Or is it like U.S. healthcare, where we're paying 4x for a not terrible but merely acceptable product?
I was the most creatively productive when I had a longer planning horizon in front of me.
Right, and this kind of opportunity has gone extinct, due to the hypercompetitive culture you get as our society disinvests itself in research and as funding becomes harder to find and more winner-take-all. If the neoliberals have their way, being a professor will just be another next-quarter focused corporate job within ten years.
Not sure where that came from. The NSF provides a lot of 3 or 5 year grants. The science org I work for is mostly funded by 3-5 year grants.
I feel the same way. I've never been in academia, but everything he said matches the negative incentive structures I've always seen in the corporate world. For the most part, the incentive structures are designed to catch cheaters (or "slackers"), but since actually discovering and creating something is virtually indistinguishable from "slacking", it just doesn't get done.
And this is a very real issue, for instance in physics. It means that if you go for research there, it is likely to be meh.
I did my PhD in physics, I was thankfully at a moment where simulations and ML were just starting so I could have fun. There was exactly zero interesting discoveries in nuclear/atomic/particle during my time in academia. And the 40 years before.
Compare this with 1090-1950. These years were simply incredible (especially the ones around 1900, to ~1920). You had almost every day discoveries that were shaking the world, and everyone was aware of that.
This is not the fault of the scientists, this is just that the world is like this. It is indeed like complaining that there are no more continents, but then the reasonable thing to do it to invest more in teaching, or applied science.
1900 yeah?
To be honest, I really think that we have wrong metric. Most importantly, if you try to ignore them even if you get some local support within your group. Good luck getting any fund because funding agencies evaluation have the same problems.
Academic researchers spend the majority of their career in tenure or in PhD, with untenured/tenure-track status for only 7-9 years out of a career of, say, 40 years. So one would expect that 75% of academic research time would be spent on "breakthrough topics".
anyone of any era could claim this. and many did. yet here we are, still discovering things, and not discovering new continents.
it is folly to assume that we have discovered everything, or even a small fraction of everything.
I think you will find that it is difficult to find someone who has been vetted by a system who would be open to admitting that said system is fundamentally flawed, especially when successful passage through that system grants things that those who have been through it want to have, such as academia does.
We definitely haven't discovered everything, and we're actually making way more discoveries much faster than people back then. But the things which are easy or even "not super hard" to discover have already been discovered. Most of the discoveries require background knowledge or are more "niche" things, because discoveries which are really big and affect everyone are easy to find and going to have everyone searching for them.
In fact we could maybe discover a new continent. But it would have to be tiny or underwater or camouflaged or otherwise have some reason that despite having a map of the whole Earth and satellites everywhere, we haven't discovered it yet. When Columbus "discovered" America there weren't nearly as many ships floating around as there are boats/planes/satellites today.
Meanwhile in Earth... oh, man, this tiny rock in Pluto has exactly the shame shape of Mickey Mouse's dog, call the press!
They said that the big obvious discoveries have been discovered. There's very little in physics now that doesn't require thousands of person hours, millions in equipment and unbelievable amounts of computing resource.
The stuff that could be discovered by someone working alone has pretty much all been done, because we've already thrown millions of person hours at it.
That's not to say there aren't major advances to be made, it's just REALLY HARD.
They also did not say there are major advances but they are “really hard” (your words), they said there are no major advances left (by comparing them to continents, which we’ve already all discovered). There is no other way to interpret their words, unless you believe there are additional continents on earth to discover. Maybe atlantis?
The OP is not commenting on individual contributors vs large groups but I will comment on that as I disagree. You are describing the current state of physics (and many other stem fields) and the popular consensus about future advancements. While certainly having hundreds of researchers is necessary on many projects, you have no basis to claim an individual will not make a major breakthrough in the distant future. And frankly, as much as they are necessary, giant labs are strongly encouraged by our current culture. Large profits from monetizing research into products, corporate involvement and funding, staggering bloat in universities, fame-chasing, printing off papers like buzzfeed articles, unprecedented levels of organized fraud in academia… very little of the current culture is conducive to modest, brilliant individual contributors in many fields.
You have no idea how the culture will change in science, how much more intelligent and capable people will be than we are in the distant future with natural selection and gene modification, and whether there will be any more breakthroughs by individuals or small groups that will seem “obvious” in hundreds of years. To say otherwise is frankly dogmatic caveman thinking.
Poor choice of words aside, the point stands.
And as for humans being far more intelligent in the future, I don’t buy it. Maybe in millions of years with evolution, but I’d bet on humanity either killing itself or replacing itself before that happens.
As for the other point, it is indeed standing, on air.
Assuming that this is generally the case (which I do), and given that longer planning horizons have become rare in academia over the past decades, the logical implication does seem to be that productivity in science decreases.
How to measure and how to value academic productivity is another interesting question.
We live in an age of institutional decline and it is severe. You see this in (trade) publishing. Your publisher no longer builds your reputation; the publisher has pushed that responsibility unto the author. The ones who already have the personal resources necessary to market their books get further validation and credibility; the ones who don't will go unheard. Academia's the same way: universities no longer provide funding for people of excellence; rather, they have put the onus of funding on the professors themselves--you'll get more funding (and published in better places) on account of using their name, and for that they take a cut. The relationship has inverted; rather than nurturing emerging talent, these institutions are nurtured by emerging talent, and this vampirism is sustainable because those talented people have no other choice insofar as all the other institutions are failing at approximately the same right.
Consequently, we have widespread duplicated effort, channel-flooding due to metrics-gaming (gotta get that h-index into the three digits before tenure time) and a corporatized, mediocre culture in which agreeability (negatively correlated with excellence and conscientiousness) matters far too much and salesmen run the day.
Historically, there were nations of priests and nations of warriors and nations of farmers. We've become a nation of sellers; but we no longer have much to sell but our own talk.
I don't know, for sure, how to solve this. Anyone who pays attention can see that capitalism (which invariably becomes corporate capitalism) is a dead end at a 21st-century technology level... but of course the eradication of capital is merely a necessary, not a sufficient, condition for scientific excellence. Going socialist is mandatory if we want to fix this, but alone does not guarantee much--there are a lot of cultural changes that probably need to happen before we can build healthy institutions again.
Of course, the lede is buried exactly where expected. How novel an idea it is that the the system is separable from its components and that utopia is indeed achievable if only the rest of the world would wake up and learn to serve your idea of a higher purpose. The inevitable counterpoint is that the system is responding predictably and efficaciously to a change to its environment: more undergraduate funding leads to more students pursuing graduate degrees and a greater deal of competition in the academic space. The "problem" is self-correcting. It turns out science doesn't need happy scientists.
The reason why you don't attach your name to comments like this is because your possession of a name worth attaching would preclude this comment from existing.
Socialists are actually oppressed in many countries
Yes that's primarily due to capitalism, specifically neoliberalism, crony capitalism and late-stage capitalism.
Unfortunately socialism isn't enough to save us, because even democratic socialism demands full employment, which is increasingly at odds with automation and UBI.
I don't believe that we have come up with a system yet that incentivizes the kind of one-off revolutionary invention that most of us got into programming for in the first place. The kind of economy where a single invention frees millions of people from forced labor.
Sergey and Larry come up with PageRank and suddenly everyone wants their search engine and they're set for life. Google wins the internet lottery and keeps all of the trillions of dollars. What about the rest of us? We invent something and our business fails due to long-tail effects and we die broke. 90% of businesses fail in their first year. So it's becoming increasingly competitive as tech improves - the ultimate tragic result. Which self-evidently trends toward a crisis of techno-capitalism in the future: The Singularity. Probably the last failure in human history.
We're looking at a situation by the end of the decade where one guy generates an entire movie from notes scribbled on a napkin with some future variation of DALL-E 2 and makes a million dollars. Meanwhile another guy who doesn't have the right connections spends his life working in the service industry as a wage slave.
Meaning that the most likely indicator of someone's success is a coin flip as we enter this era of neo-fuedalism.
Meaning that civil unrest and violence are all but inevitable now (just turn on the TV to see it everywhere).
Now, I think a lot of people on HN and the world at large have not tried working for themselves, so have no idea how hard money is to come by. Sure, we can make a quarter million dollars every year working 40+ hour weeks at a FAANG company. But make that from a personal project? Highly unlikely.
Writing this now, I have given up on a solution to this coming from the top. People close to me, even the majority of people on HN, don't seem to get it. They'll never get it. Something in the idea of UBI irks them deep down inside, just like with student loan forgiveness. So it's over.
On a personal level, I'm looking towards solarpunk and local cooperatives that create resource streams for people outside of the financial incentive. I think it's possible to invent robot kits that provide things like hydroponic produce for very low cost. Once people have their basic needs met, it liberates them from having to beg for grants or even a job. Which is why the entire status quo is geared against this. Rents and basic expenses will squeeze us even harder before the end. Expect crushing regulations against off-grid living, just like how rain barrels have been criminalized in the southwestern US.
As for successful grants, I have seen that, now, 50% of the amounts immediately goes to "overhead" and the PI needs to pay for stipends and equipment from the remaining 50%, yet there are further "transaction charges" even those activities.
The publishing, grant winning, etc are simply "KPIs" so beloved by the MBA hordes.
What I found incredible is the lack of push-back from academics against the encroaching takeover by the biznoids. Speaking of whom, they don't give a damn about research, academia is merely yet another territory to which they extend their rent seeking (for themselves) activities.
Paradox of tolerance. Academics were too peacefully inclined to realize what is happening to them and their jobs until it's too late.
As the left re-emerges, I hope it will evolve into something with some fight in it. De-corporatization is going to take decades and it's not all going to be pretty.
Academic research is not a place to go for extrinsic motivation. If you're not primarily in it for love, you're going to have a bad time.
An example: Who has heard of the Wolf Prize in physics? It is in the set of prizes known as "second prize to the Nobel Prize", yet essentially nobody outside of the field will react with, "Whoa, she won a Wolf Prize? She must be really good."
Even in the well-resourced research groups, researchers will be find much better extrinsic reward outside of academia. Advancing the boundaries of our understanding is priceless intrinsic motivation for those who can find a way to stay, but doing so requires substantial sacrifice -- more than many of those in academia realize.
When you go to top universities, you'll find plenty of academics who are extrinsically motivated:
* Number of research papers
* Cumulative value of grants
* Awards
* Titles. This was insane. Apparently being a Fellow of the IEEE wasn't enough, so they actively sought becoming Fellows in adjacent societies.
Yes, I've also understood it this way.
Something I think would help the incentive situation is providing more incentives for teaching and service. My grandfather was a professor emeritus and I can't find any record of him authoring a research paper (or a PhD thesis for that matter) but even 30+ years since he last taught I still run into people who rave about the formative experiences they had in his classes. He's a minor celebrity among local engineers of a certain age.
Such a person could still provide a lot of value, but it's harder to measure.
If we are trying to improve research productivity, then removing or dramatically reducing teaching responsibilities for researchers sounds a lot more sensible. Besides, modern pedagogy is getting increasingly complicated and having teaching specialists can be much more beneficial to your average 1-2 year undergrad.
Not to diminish his teaching career, it sounds very valuable, but not in a way that's directly relevant to the OP.
If, instead, we made it easier to advance your career as exactly the kind of pedagogy specialist you described (as well as through leadership in professional organizations, work in the community, and all the other kinds of service), I believe you would get fewer applications to those research grants. It might result in better post-secondary education as well.
This isn't worded properly. It's clearly rational for the scientists to spend time on the pursuit of grants. Otherwise they wouldn't be doing it.
$100 in grant money is not the same as $100 in university income. In fact, the whole point of the grant is to cover the cost of doing research, and in principle should leave the university's net revenue unchanged. (In practice, overhead changes that, but that's a different topic.)
The problem is that the university's objective is to spend as much on research as possible. Grant money is simply the fuel for that process. All else equal, more expensive research is very strongly preferred, because that increases research spending, and that improves the standing of the university.
That is a seriously distorted set of incentives. All perfectly rational. Just insanely stupid.
Is that worded properly? Are you really saying that nobody would ever do something irrational?
If that's not what you mean, then we have to look at what "rational" means here. I think parent didn't mean "rational" in the sense of "maximising personal gain", but "maximising output of quality research".
This is one of the reasons why I left academia. The insane run for grants was just starting and i said that I do not have any intent do do that.
I was a scientist. Doing science. Not filling in papers and going to belly dancing shows.
When I was told that this is compulsory and nobody else is going to do it, I sad good bye and left for the industry. I was earning 10x more, had no worries about funding or copier paper. Plenty of my friends did it and then academia was crying because of the brains drain and how unfair it was. The salme who said that grats are compulsory (they were sitting in the various jurys to accept them, instead of doing science)
FWIW, also decided not to go into academia because of how much smarter I realized I needed to be to be a top tier academic!
Somehow.
https://fastgrants.org/ did some good work for covid. Could maybe be a starting point for a new system.
Here's my research on the 'Challenges facing Academic Research' - https://miro.com/app/board/uXjVOkNfljM=/?share_link_id=58427...
Quotes that I found important:
"It discourages rigorous research as it is difficult to obtain enough results for a paper (and hence progress) in two to three years.
The constant stress drives otherwise talented and intelligent people out of science also."
- Anonymous
"End the PhD or drastically change it. there is a high level of depression among phd students. long hours, limited career prospects, and low wages contribute to this emotion."
- Don Gibson, Scientist at BioConsortia
Funding "affects what we study, what we publish, the risks we (frequently don't) take, it nudges us to emphasise safe, predictable (read: fundable) science"
- Gary Bennett - Neuroscientist at Duke University
"We need to recognise academic journals for what they are: shop windows for incomplete descriptions of research, that make semi-arbitrary editorial [judgments] about what to publish and often have harmful policies that restrict access to important post-publication critical appraisal of published research." —Ben Goldacre, The Datalab, epidemiology researcher, physician, and author
"An estimated $200 billion - or the equivalent of 85% of global spending on research - is routinely wasted on poorly designed and redundant studies." - https://www.thelancet.com/journals/lancet/article/PIIS0140-6...
"As much as 30% of the most influential original medical research papers turn out to be wrong or exaggerated." - https://jamanetwork.com/journals/jama/fullarticle/201218#COM...
"The BMJ found that one-third of university press releases contained either exaggerated claims of causation (when the study itself only suggested correlation), unwarranted implications about animal studies for people, or unfounded health advice." - https://www.vox.com/2014/12/10/7372921/health-journalism-sci...
(1) Making 30 researchers spend time on grants when only 1 wins is a waste of researchers time, regardless of productivity.
It's a system built for bureaucrats who don't know to evaluate work-product from those who do by comparison if not mutual critique. It's a wealth transfer from researchers to taxpayers.
(2) Grants always are on topic, but the topic is mostly selected to avoid political embarrassment. In the 1990's, it was HIV. In 2010 it was Alzheimer's Amyloid Beta. Then computer security. Unlike the internet or jet engines, these have not panned out as foundational research (except perhaps for some of HIV). Again, topics are selected not to deliver value to citizens, but to politicians.
Yes, this is inefficient. Yes, academic bureaucracy sucks and the publication game is easily corrupted and early advances are more relatable than later ones.
But the real problem with science in the U.S. is that there are not enough jobs for scientists, because companies are happy to get research and development done more cheaply elsewhere. Companies have only disincentives to develop local labor pools.
That's the negative incentive that dwarfs everything in academia and publicly-funded research.
In what word is computer security not a foundational topic? There's lots of reasons to critique the way NSF/NIH/DOD/etc allocate funding, but this is definitely not one of them.
Are there other places where the science-funding mechanisms work well? Otherwise I do not see why your argument about companies being cheap makes sense.
How would you promote teaching and knowledge transfer while not needing to do this? On the job learning?
This statement may not be entirely accurate. Philosophers, scientists and mathematicians in the early 20th century and before that were independently wealthy or had some sort of “royal” patronage that allowed them to pursue their interests for “public good”. Things changed in the later part of the 20th century but a scientist was a rarified breed until the 1970s. I don’t think most people had the means to pursue a scientific career. Grants and funding exploded at the end of the 20th century and foreign students (especially from China and India) provided the “cheap labor” that’s needed for a lot of the STEM fields PhD/post-doc armies. This has essentially led to a proliferation of scientists in academia. Abundance of school loans means universities can expand teaching faculty and then add research responsibility. It’s a vicious cycle.
At least this is my hypothesis.
But aren't there still some scientists who work outside of grant funding and prestige ratrace? People at industry research labs who don't write grants, and aren't trying to impress a tenure committee, for example. Shouldn't we be able to point to them and say, "look how much more productive they are"?
I'm a former professor who has written many proposals and won some of them. I've reviewed many more.
I did a lot of thinking and research when writing proposals. In a proposal, I tried to clearly explain the state of the art and how it could be extended, what resources I would need to do that, and how that work could be structured to make success more likely. I might even do a pilot study to show that the key idea is promising. Note that 'how to extend the state of the art' can be a seriously creative inventive step, or it could be the obvious next thing. But creativity does happen at proposal stage, and it certainly factors in my reviews of other's proposals.
My point is that writing proposals is not entirely a waste of time. It's a bit like writing a movie script. It's not a movie, many scripts never become movies, but for some movies some of the best ideas were in the script. Same for proposals.
Your money is not going to research. Instead, it is going to bureaucracy and "extrinsic motivations" (researchers status games)
While I don't have the data to support this my intuition is that there are now many, many more researchers than in earlier years- both senior researchers who already have a career and junior researchers that are trying to get theirs started.
The amount of science funding probably has also increased, but there are just too many people exiting PhD programmers for all of us to find cozy research jobs where we are free to pursue our interllectural interests undisturbed while the public money slowly but steadily drips in.
In other words, a moderate pot of grant money combined with a huge number of new PhDs makes for huge competition.