The Mythical Man-Month is one of the seminal works on software engineering practice. It has held up extremely well over time. If I have to jettison professional books over time for whatever reason, it'll be in the last box /shelf I retain.
I know a lot of people like MMM - I too enjoyed it. “The bearing of a child takes nine months, no matter how many women are assigned.” Still totally valid, IMO.
But I really enjoyed The Design of Design as well.
R.I.P. Mr. Brooks. I thank you for introducing to me the idea of conceptual integrity.
Sad loss. One might wonder how much faster technology’s state of the art would have progressed if we had more people like Fred Brooks working in the field.
Haha, that's a great come back! Thanks for cheering me up. :D
I mentioned Fred Brook in a comment just earlier in the week. The Mythical Man Month is such an obviously and well known trap it's still surprising so many projects still fall into it.
Whilst his work is mostly seen as for software engineers, really it should be more well known by project and senior managers in general.
"The Mythical Man-Month: Essays on Software Engineering is a book on software engineering and project management by Fred Brooks first published in 1975, with subsequent editions in 1982 and 1995. Its central theme is that adding manpower to software project that is behind schedule delays it even longer. This idea is known as Brooks's law, and is presented along with the second-system effect and advocacy of prototyping.
Brooks's observations are based on his experiences at IBM while managing the development of OS/360. He had added more programmers to a project falling behind schedule, a decision that he would later conclude had, counter-intuitively, delayed the project even further."
I'm glad I got to at least shake his hand. One of the lawyers at Google had studied under him, and when I saw them crossing the street I just assumed the older gentleman with the visitor's badge was Brooks (I didn't even know what he looked like, but I found out later I'd guessed correctly).
Don't be sad - he lived a long productive life full of people he impacted, and as you can see from the comments here he was well respected. All of us will die one day, let's not feel sadness.
Nothing you said means you can't feel sad. No matter how long and full someone's life is, there is still sadness when they are gone. It doesn't have to be debilitating sadness, but it is ok to feel sad.
Not so much, at that time I was making projects putting them out on the internet etc. I tried talking with other adults that were programmers about some of the issues I had and occasionally got advice.
But when I got to grad school.. their convervsations about "the industry" and ways of working was massively inexperienced. I also read a lot at that age. It also did give me a leg up in identifying high pressure of delieverying. (The 9 women in 1 month for a baby reference).
We should probably wait for confirmation from more than this source. I don't disbelieve it, because they cite the UNC CS department, but even Wikipedia hasn't been updated yet.
As faculty at UNC CS, I can mournfully confirm this is indeed the case. He passed peacefully at his home in Chapel Hill earlier this evening, surrounded by family.
Dang can you clarify why you found "Columbia CS" credentials more credible than "UNC CS"? I'd like to say that's a pretty shocking position but sadly it isn't.
I didn't find that, nor say it, nor imply it, nor did such a possibility ever enter my consciousness until now. I'm mystified that such an interpretation could even arise! Do you want to explain how it occurred to you?
how would you rank the possibility that Wikipedia is updated from that same source? It's an open article. If a piece of news, say, "goes viral", how do you know this does not directly affect sources you would have used for comparison - /especially/ a wiki?
PS: I just realized the coincidence that I have just submitted a piece about "Epistemic Vigilance in teams, esp. in the context of news sources", https://news.ycombinator.com/item?id=33651906
> how would you rank the possibility that Wikipedia is updated from that same source
I'd rank it as definitely possible. No idea how often it happens.
The thing that really persuaded me to put the story back up was the source of the tweet. A Columbia CS prof and law prof who had apparently studied with Brooks would not likely have posted that if he hadn't had a genuine notification.
"Show me your flowchart and conceal your tables, and I shall continue to be mystified. Show me your tables, and I won't usually need your flowchart; it'll be obvious." -- Fred Brooks, The Mythical Man Month (1975)
Stated a different way:
"Bad programmers worry about the code. Good programmers worry about data structures and their relationships." -Linus Torvalds
It used to mean that, but a programmer changed the meaning. They could.
(a) rename the column, be the guy who broke the system and spend all weekend trying to fix 6 systems he never knew existed, written in Access, Excel, Crystal Reports, VB6, Delphi and a CMD file on a contractors laptop.
(b) keep the column name, deliver the feature, go home.
It might not be math-related; could be something as simple as a requests table being named to indicate that api X was used and now it uses API y and there is some reporting on that somewhere that doesn't care which API was used.
Ideally the table would have been named more generically but in an earlier stage startup there will be mistakes in naming things no matter how hard you try to avoid that.
So the only thing that actually breaks here is that a small number of engineers that care about this might misinterpret what it means unless they learn the appropriate tribal knowledge. Ideally it gets fixed but if you look at all of the things that can be improved in an early stage startup, this kind of thing is pretty minimal in importance so it becomes tech debt.
(b) Go home and be happily oblivious that six other systems silently started to produce wrong results since the meaning of the column has changed. But, of course, that is someone else’s problem, some other day, when several months of reports and forecasts have to be recalled and updated.
We prefer option c: add a new table/column with similar looking name. Then few years later start wondering why there're two almost identical entities, and why one of them behaves weirder than another.
Self-documenting code (what I take in practice means "no comments"-culture) is something I don't understand how it can work, never seen a good implementation of it. It _can_ be successful in describing the _what_ but is poorly or not at all describing the _why_. Perhaps I'm in the wrong domain for that though.
The why should be clear from the domain that you're working within. A line of comment should count as something like 10 lines of code, if you're reading a comment then you're treading into real complexity. If you're in a code base where that isn't true, then is the comment really necessary?
Fairly hot take from me, life is more ambiguous than that :-).
Unless you are in some trivial startup domain, real domains (TM) have almost fractal-level complexities if you dig deep enough, corner cases, sometimes illogical rules etc.
The "why" is still very much needed since it can have 10 different and even conflicting reasons, and putting it in the code in appropriate amount shows certain type of professional maturity and also emotional intelligence/empathy towards rest of the team.
I mean, somebody has to be extremely junior to never experience trying to grok somebody's else old non-trivial code in situation when you need to deliver fix/change on it now. And its fairly trivial to write very complex code even in few lines, which some smart inexperienced juniors (even older, but total skill-wise still juniors) produce as some sort of intellectual game out of boredom.
> I mean, somebody has to be extremely junior to never experience trying to grok somebody's else old non-trivial code
People are definitely capable of looking at someone else's code and saying "this crap is completely unreadable, we should rewrite it all", while at the same time believing that their own code is perfectly readable and self-documenting.
I’m not a “no comments” maximalist but someone has to be pretty junior to have never experienced a comment that is just completely incorrect.
It’s really hard to write a good comment that is only “why”. It’s really hard to keep comments up to date as code is moved and refactored. And an incorrect comment is much more damaging than no comment at all.
That’s the driving force behind “self documenting” code. My view is that a comment is sometimes necessary but it is almost always a sign that the code is weak.
> It’s really hard to keep comments up to date as code is moved and refactored
I agree with this, but if the explanation for logic has good reason to be there, then keeping comments up-to-date with code changes is very important and it goes back to seniority and empathy I mentioned earlier - if you understand why its there in the first place, and you actually like rest of your team, you are doing too all of you a big favor with updates of comments.
Each of us has different threshold for when some text explanation should be provided, which is source of these discussions. But again back to empathy, not everybody is at your coding level, you can save a lot of new joiner's time (and maybe a production bug or two) if they can quickly understand some complex part.
> The why should be clear from the domain that you're working within
Sometimes the 'why' is purely domain knowledge. Sometimes the 'why' is about narrowing down options available in the domain. Sometimes the 'why' is about a choice made for reasons that aren't specific to the domain. And sometimes the 'why' is about the code that wasn't written, so it can't possibly be in the code that was.
Comments are supplemental. If you have just added some weird, non-obvious, bit of code because you needed to compromise, or work around some other quirk, go ahead and comment. No one is going to (sanely) object to that.
What you describe is how I tend to comment. At the opposite end of the spectrum we have Knuth's 'literate programming', exemplified in Tex, which has as its goal 'making programs more robust, more portable, more easily maintained, and arguably more fun' [0] by merging documentation with code. I'd bet if you counted documentation lines vs. code lines in Tex they'd be near 50/50, and I'd bet that if we asked Knuth whether the comment lines were supplemental he'd say no.
> sometimes the 'why' is about the code that wasn't written, so it can't possibly be in the code that was.
I have often had to write extensive comments related to this to prevent well meaning coders who are not expert in the domain from replacing the apparently bad or low performance code with an obvious but wrong 'improvement'.
Grokking that 'why' can take non-trivial mental effort by a non-author, even when well coded/documented. Worse, if the code is needlessly complex, or trying to be smart or over-engineered, any amount of commenting wont help. The non-author (maintainer) of the code is now burdened. And if (so commonly happens) - they dismiss the original code as 'non-performant' or 'not a best practice' or something else.. we know how that plays out.
The developers , especially new ones do not understand or know all the history of the project.
I remember one time in css I had to do something weird like min-widht:0;
It was needed to force the css engine to apply some other rule correctly,. but this will puzzle you when you read it. And this kind of puzzling code needs comments, I prefer to just put the ticket ID there and the ticket should contain the details on what the weird bug was with all the details, so if some clever dev wants to remove the weird code he can understand stuff.
Sometimes I see in our old project code like if webkit to X else do Y ,
there is no comment with a bug link so I have no idea if this code is still needed or not (Browsers still differ in more complex stuff, like contenteditable )
> The why should be clear from the domain that you're working within.
I hear this commonly from coders who haven't had the ambiguous pleasure of working with old, production critical codebases from generations of coders who have come and gone, with technical decisions buffeted around by ever-shifting organizational political and budgeting winds. Knowing the why's that leadership cares about is far more important to your career than the technical why's, which are along for the ride.
Once you go into production with tens of thousands of users and up, with SLA's driven by how many commas of money going up in smoke per minute...yeah, illusions of "pure" domain knowledge driving understanding of function dictating code form evaporate like a drop of distilled water on the Death Valley desert hardpan in the middle of summer.
I used to be like that as well years ago, but some kind greybeards who took me under their wings slapped that out of me.
Now my personal hobby code with an "unlimited" budget and I'm the sole producer and consumer? Yep, far closer to this Platonic ideal where comments are terse and sparse, and the code is tightly coupled to the domain.
A better approach would be that A comment should tell you something that you cannot glean from the code and/or is non-obvious. Yes, I understand non-obvious can have a truck driven through it, but in general it should work.
You can read code and understand what it's doing mechanically, but you may not understand why the obvious approach wasn't taken or understand what it's trying to achieve in the larger context. Feel free to comment on those, but if the code is difficult to understand mechanically, the code is generally bad. Not always, everything has exceptions, but generally that's true.
In practice it really does mean self documenting code.
Like variables called "daysSinceDocumentLastUpdated" instead of "days". The why comes from reading a sequence of such well described symbols, laid out in a easy to follow way.
It doesn't do away with comments, but it reduces them to strange situations, which in turn provides refactoring targets.
Tbh, its major benefit is the fact that comments get stale or don't get updated, because they aren't held in line by test suites and compilers.
Most comments I come across in legacy code simply don't mean anything to me or any coworkers, and often cause more confusion. So they just get deleted anyway.
In most cases, even though there's verbose variable names you still can't understand the why just by reading the code. And even if you did, why would one want to?
Most often I'm just skimming through, and actual descriptions are much better than having to read the code itself.
This whole notion of "documentation can get out of sync with the code, so it's better not to write it at all" is so nonsensical.
Why isn't the solution simply: "lets update the docs when we update the code". Is this so unfathomably hard to do?
Lazy people work the hardest. It's an up front investment for a big payoff later when you can grok your code in scannable blocks instead of having to read a dozen lines and pause to contemplate what they mean, then juggle them in your memory with other blocks until you find the block you're looking for.
Comments allow for a high-level view of your code, and people who don't value that probably on average have a slower overall output.
What you write in your first para is so self evidently true, at least to me.
I simply cannot comprehend the mindset that views comments as unnecessary. Or worse, removes existing useful comments in some quest for "self-documenting" purity.
I've worked in some truly huge codebases (40m LOC, 20k commits a week, 4k devs) so I think I have a pretty good idea of what's easy vs hard in understanding unfamiliar code.
As the late Chesterton said, "Don't ever take a fence down until you know the reason why it was put up."
A lot of people think comments are descriptive rather than prescriptive. They think a comment is the equivalent of writing "Fence" on a plaque and nailing it to the fence. "It's a fence," they say, "You don't need a sign to know that."
Later, when the next property owner discovers the fence, they are stumped. What the hell was this put here for? A prescriptive comment might have said, "This was erected to keep out chupacabras," answering not what it is, but why.
You might know about the chupacabras, but if you don't pass it on then you clearly don't care about who has to inherit your property.
What's amazingly funny is that many people think this is a positive, because they ascribe more value to working hard than to achieving results. I even thought your comment was going to go that way when I first read it.
> This whole notion of "documentation can get out of sync with the code, so it's better not to write it at all" is so nonsensical.
I do believe that in a lot of case an outdated, wrong or plain erroneous documentation does more harm than no documentation. And while the correct solution is obviously "update the doc when we update the code", it has been empirically proven not to work across a range of projects.
What 'has' been proven then? No comments or docs? Long variable and method names?
I just had a semi-interview the other day, and was talking with someone about the docs and testing stuff I've done in the past. One of the biggest 'lessons' I picked up, after having adopted doc/testing as "part of the process" was... test/doc hygiene. It wasn't always that stuff was 'out of date', but even just realizing that "hey, we don't use XYZ anymore - let's remove it and the tests", or "let's spend some time revisiting the docs and tests and cull or consolidate stuff now that we know about the problem". Test optimization, or doc optimization, perhaps. It was always something I had to fight for time for, or... 'sneak' it in to commits. Someone reviewing would inevitably question a PR with "why are you changing all this unrelated stuff - the ticket says FOO, not FOO and BAR and BAZ".
Getting 'permission' to keep tests and docs current/relevant was, itself, somewhat of a challenge. It was exacerbated by people who themselves weren't writing tests or code, meaning more 'drift' was introduced between existing code/tests and reality. But blocking someone's PR because it had no tests or docs was "being negative", but blocking my PR because I included 'unnecessary doc changes' was somehow valid.
> This whole notion of "documentation can get out of sync with the code, so it's better not to write it at all" is so nonsensical.
To me, this feels similar to finding the correct granularity of unit tests or tests in general. Too many tests coupled to the implementation too tightly are a real pain. You end up doing a change 2-3 times in such a situation - once to the actual code, and then 2-3 times to tests looking at the code way too closely.
And comments start to feel similar. Comments can have a scope that's way too close to the code, rendering them very volatile and oftentimes neglected. You know, these kind of comments that eventually escalate into "player.level += 3 // refund 1 player level after error". These are bad comments.
But on the other hand, some comments are covering more stable ground or rather more stable truths. For example, even if we're splitting up our ansible task files a lot, you still easily end up with several pages of tasks because it's just verbose. By now, I very much enjoy having a couple of three to five line boxes just stating "Service Installation", "Config Facts Generation", "Config Deployment", each showing that 3-5 following tasks are part of a section. And that's fairly stable, the config deployment isn't suddenly going to end up being something different.
Or, similarly, we tend to have headers to these task files explaining the idiosyncratic behaviors of a service ansible has to work around to get things to work. Again, these are pretty stable - the service has been weird for years, so without a major rework, it will most likely stay weird. These comments largely get extended over time as we learn more about the system, instead of growing out of date.
> To me, this feels similar to finding the correct granularity of unit tests or tests in general.
I recently had an interview with what struck me as a pretty bizarre question about testing.
The setup was that you, the interviewee, are given a toy project where a recent commit has broken unrelated functionality. The database has a "videos" table which includes a column for an affiliated "user email"; there's also a "users" table with an "email" column. There's an API where you can ask for an enhanced video record that includes all the user data from the user with the email address noted in the "videos" entry, as opposed to just the email.
This API broke with the recent commit, because the new functionality fetches video data from somewhere external and adds it to the database without checking whether the email address in the external data belongs to any existing user. And as it happens, it doesn't.
With the problem established, the interviewer pointed out that there was a unit test associated with the bad commit, and it was passing, which seemed like a problem. How could we ensure that this problem didn't reoccur in some later commit?
I said "we should normalize the database so that the video record contains a user ID rather than directly containing the user's email address."
"OK, that's one way. But how could we write a test to make sure this doesn't happen?"
---
I still find this weird. The problem is that the database is in an inconsistent state. That could be caused by anything. If we attempt to restore from backup (for whatever reason), and our botched restore puts the database in an inconsistent state, why would we want that to show up as a failing unit test in the frontend test suite? In that scenario, what did the frontend do wrong? How many different database inconsistencies do we want the frontend test suite to check for?
That makes no sense to me either. In my book, tests in a software project are largely responsible to check that desired functionality exists, most often to stop later changes from breaking functionality. For example, if you're in the process of moving the "user_email" from the video entity to an embedded user entity, a couple of useful tests could ensure that the email appears in the UI regardless if it's in `video.user_email` or in `video.user.email`.
Though, interestingly enough, I have built a test that could have caught similar problems back when we switched databases from mysql to postgresql. It would fire up a mysql based database with an integration test dump, extract and transform the data with an internal tool similar to pgloader, push it into a postgres in a container. After all of that, it would run the integration tests of our app against both databases and flag if the tests failed differently on both databases. And we have similar tests for our automated backup restores.
But that's quite far away from a unit test of a frontend application. At least I think so.
> With the problem established, the interviewer pointed out that there was a unit test associated with the bad commit, and it was passing, which seemed like a problem. How could we ensure that this problem didn't reoccur in some later commit?
It would seem that the unit test itself should be replaced with something else, or removed altogether, in addition to whatever structural changes you put in place. If you changed db constraints, I could see, maybe, a test that verifies the constraints works to prevent the previous data flow from being accepted at all - failing with an expected exception or similar. But that may not be what they were wanting to hear?
> Comments can have a scope that's way too close to the code, rendering them very volatile and oftentimes neglected.
I think this is a well put and nuanced insight. Thank you.
This is really what the dev community should be discussing; the "type" of comments and docs to add and the shape thereof. Not a poorly informed endless debate whether it should be there in the first place.
The argument isn’t that it’s better to not write it at all, it’s that it’s not worth the effort when you could have done something else. Opportunity cost and all that.
But arguments around "is this so hard?", or resolution stripping like "so don't write documents at all", are more about superiority signalling, aimed at individualistic benefit.
The fact is that, when you zoom out to org level, comments do quickly drift out of sync and value, and so engineering managers must encourage code writing that will maintain integrity over time, regardless of what people "should" be able to do.
I have better hope that a good programmer can write readable code, than that they will write readable documentation. As you point out, people suck at writing.
I would remark here that The Mythical Man-Month did give a page or two to documentation. My copy seems to be out on loan, but as I recall the section included a figure showing the documentation for a sort function, perhaps 25 lines or so.
Drifting off-topic, but I wonder how close to the top of the list TMMM is for "on loan" duty cycle in the software world. My copy also seems to be persistently in someone else's hands.
Documentation without accurate and descriptive method/member names is much more harmful than the inverse. If an abstraction is sufficiently complex to warrant a lengthy description of why it exists, then it should have a design doc. In practice, most code within a repo is pretty simple in what it accomplishes and if it's confusing to a reader, then it is most likely because they don't understand the design of the larger component or system or simply because the implementation is poor. There are of course cases where comments are really useful or even necessary (e.g. if going against best practices for a good reason or introducing an optimization that is for all intents and purposes unreadable without explanation), but they are exceptions.
At my company code is required to be self-documenting. My attitude is that if you can't determine the why then you likely are not familiar enough with the problem domain to be working with that code. It's fine not to be familiar with the domain and there are ways to address that, but reading source code is not one of them.
Yes absolutely. All developers, junior and senior, go through a 4 month training program working on a completely independent project from scratch that teaches them everything they need to work in their domain. There are exceptions now and then, but for the most part it's pretty consistent.
When a developer wants to switch from one area to another, they go through an accelerated program (takes only about a month).
I can just barely count the times I have seen a production failure due to someone assuming a millicent value from a column with ambiguous naming was in centicents or vice-versa.
The Linus quote is ripe for misinterpretation. Not worrying about the code can lead to an unreadable mess, that ones future self or others will hate working with. So a really good programmer will probably rather go the Sussman way and realize, that programs are firstly meant to be read and only lastly meant to be run by a computer (paraphrasing here).
Designing good data structures is very important for code readability too. If you struggle to understand how given data structure is used / what it contains it would be hard to understand the rest of the code.
There's a lot of code out there that would improve massively with better data structures though.
I mean I've waded through tons of code where the original author abused strings to indicate relationships in a table - a column with semicolon-separated values referencing other tables / rows. And a ton of code to check references.
Mind you, that's more database design than data structures, but they're close enough for this example.
I always attributed it to Rob Pike, but it turns out Pike's is following:
> Rule 4. Fancy algorithms are buggier than simple ones, and they're much harder to implement. Use simple algorithms as well as simple data structures.
> Rule 5. Data dominates. If you've chosen the right data structures and organized things well, the algorithms will almost always be self-evident. Data structures, not algorithms, are central to programming.
While I agree with both quotes separately, I don't think that they necessarily mean the same thing.
To me, the first (by Brooks) seems to be about grasping the domain model to understand what the system does (or can do) in general.
Wheras the second (by Torvalds) seems to be about how best to organize data in code for efficient processing. Array, hash, tree, heap, etc and their associated access time complexity. The efficiency of your solution depends on your choice of a data structure that fits the local problem.
I have fond memories of attending his "No Silver Bullet" lecture only a few short years ago.
A favorite quote of mine from MMM: "The programmer, like the poet, works only slightly removed from pure thought-stuff. He builds his castles in the air, from air, creating by exertion of the imagination. Few media of creation are so flexible, so easy to polish and rework, so readily capable of realizing grand conceptual structures...."
“Castles in the air” was an inspiring quote to read as an undergrad, and helped me recognize programming as my vocation.
I have a beautiful Docubyte print of the IBM-360 in my room, as a reminder of the great endowment that is our computing past. Well done to Brooks on a remarkable life’s work.
The quote is worth reading in full, available here [0]. Brooks captured so perfectly my own experience programming. Sometimes the job is boring and hard, but then there are the moments that are pure magic:
> Yet the program construct, unlike the poet's words, is real in the sense that in moves and works, producing visible outputs seperate from the construct itself. It prints results, draws pictures, produces sounds, moves arms. The magic of myth and legend has come true in our time. One types the correct incantation on the keyboard, and a display screen comes to life, showing things that never were nor could be.
I bought the book years ago when I was on my 'let' s learn everything I can about computers and software ' spree. Very few books have left such a lasting impression on me, even though at the time I had no notion whatsoever of what professional software engineering was like.
I read that section of MMM during a down time in my early career where I was doubting my choice of programming as a career because of my limitations. It buoyed my spirits enough that I decided to stick with it and I am glad I did. I owe a great personal debt to Brooks.
"No silver bullet" in itself must be one of the most misused or misunderstood phrases used by people to argue not to try better ways of doing things. If one suggests, that there is a safer or somehow better tool to get the job done ... no silver bullet! Your tool is not perfect for everything in the universe, so we will not even use it where it works significantly better!
The thought that there is no ultimate perfect way to do things is liberating, if anything. It means that we can pick something we deem good enough and roll with it, or we can try and find an infinity of other good enough ways with acceptable tradeoffs, instead of searching for that end all, be all holy grail. Or we can stop trying at some point, because of diminishing returns. It's all okay.
The important thing is not to worry that what we have is merely good, because the perfect might be waiting around the corner. It's not.
Also, the most important part of that quote is that due to there not being “free lunch” productivity boosts, we really should focus on reusing existing libraries, “standing on the shoulder of giants”, not reinventing the wheel for each platform/language.
"no free lunch" and "standing on ..." are 2 ideas, which are also being misused by people in at least 2 ways: One is to block, basically saying: "But no free lunch! Somewhere there must be a cost, because someone else once said no free lunch!", while it is very possible, that one has done something in a way, which was silly from the start and really could have a "free lunch", by switching to a better way of doing it.
The other "standing on the shoulders of giants" is used as justification for accumulating more and more dependencies and not writing stuff oneself, no matter how simple, which is how we get into left-pad-like territory.
We should indeed focus on reusing libraries, but please, _good_ libraries and not ones, which impose limitations in implementation as well as future thinking, by creating a high mental barrier to change ("But if we switch out this library we need to change aaalll this stuff, because our code is adapted to how the library works."). Sometimes adding a dependency is simply not worth it, like in the left-pad scenario. Just write that one function yourself and don't add more dependencies to the project. Always weigh the benefit against the additional load of dependencies added directly or indirectly as dependencies of dependencies.
JS is definitely not a good example of “standing on the shoulder of giants”, the language has always lacked a sane standard library (it is getting better nowadays), plus due to optimizing for size and depending on “tree shakers” they have probably the worst dependency graphs ever.
But should I really start writing a graph algorithm for the 15th time? I believe the point of the quote is not “blindly add dependencies”, but that a significant boost in productivity can come from reusing already existing, high quality code that fits in with the projects requirements. Left-pad is clearly not such for most projects, and “it is not a free lunch” (:D) in that maintaining dependencies also has a cost.
To summarize, "No silver bullet" claims no single innovation will increase software developer productivity tenfold across the board. He does not say an innovation can't increase productivity greatly in a specific area, neither does he deny that many improvement can accumulate to a tenfold increase.
Also, he speculated it decades ago (though, arguably it still stands. There is no new managed language that would be 10x more productive than any already existing one)
He is not saying a "10x" language couldn't be invented, he is saying a hypothetical 10x language wouldn't increase overall developer productivity 10x.
His argument is developers use a lot of time on the intrinsic complexity of designing solutions for complex problems. Representing these solutions in code is a smaller part of the job. So even if a new language increased coding productivity by 10x (like going from assembler to C might) it wouldn't increase overall productivity with the same factor.
In short, the bottleneck is not the coding, the bottleneck is our minds thinking about how to solve the problem.
I reread the paper and I see what you mean — due to coding being only one part of the equation for productivity, any increase in that area can only speed up that part, not the whole (basically Amdahl’s law).
But it does also mention that since the appearance of high level languages, we are on a path of diminishing returns:
“The most a high-level language can do is to furnish all the constructs the programmer imagines in the abstract program. To be sure, the level of our sophistication in thinking about data structures, data types, and operations is steadily rising, but at an ever-decreasing rate. And language development approaches closer and closer to the sophistication of users.
Moreover, at some point the elaboration of a high-level language becomes a burden that increases, not reduces, the intellectual task of the user who rarely uses the esoteric
constructs.”
Also, Brooks originally wrote this paper for a 10 years timeline, and my point was mostly that even though we are like 3 times over its original length, I still don’t think languages would be even 3 times more productive, let alone more (and I won’t buy empirical evidence of your fav language, but some form of objective one).
When I attended his talk ~4(?) years ago on No Silver Bullet, the audience had the chance to ask questions about recent technologies like ML/DL, AI (though CoPilot didn't exist yet), modern safety features, etc. I wish I could remember his exact responses to those questions, but of course he still maintained that there is no silver bullet :)
> Few media of creation are so flexible, so easy to polish and rework, so readily capable of realizing grand conceptual structures.
Yeah, and then you have the core banking system tied with scotch tape and bubble gum in the 1950s, that drives a business worth tens of billions of dollars and for which a modern rewrite would probably cost a billion dollars.
And then you realize some pieces of software are harder than a mountain made of titanium.
"The teacher's job is to design learning experiences; not primarily to impart information." -Fred Brooks
A favorite, lesser known quote of Fred's from his technical communications course at UNC and a SIGCSE talk. Beyond a software engineer and researcher, he was an extraordinary educator. His design ethos carried through to pedagogy, as well, and has been an inspiration to me. Thanks, Fred.
During my short stint in academia, I once addressed our room full of students with something like "Our role here is not to teach you; it's to provide you with the best context in which you can learn." I have often wondered where that philosophy came from, and I an very happy to have an idea now.
The programmer, like the poet, works only slightly removed from pure thought-stuff. He builds his castles in the air, from air, creating by exertion of the imagination. Few media of creation are so flexible, so easy to polish and rework, so readily capable of realizing grand conceptual structures.
Sad news but he left a legacy to be proud of. Few people write anything which will be read half a century later, much less as a source of insight rather than historical context.
May he rest in peace. Like many here, I was first introduced to Dr. Fred Brooks through Mythical Man-Month, which has had a tremendous impact in shaping my views on software. Afterwards I saw some of his lectures that he held at UNC on Youtube, and always wished I had attended UNC for my undergraduate studies.
> Lockheed Martin Corp. has reassigned 200 engineers to work on the F-35 fighter jet's software, a problem area that Defense Department officials fear could cause more delays to the program.
Somehow obvious to DOD, but not to LM. And that's just one of the more high profile incidents I know of, I've witnessed plenty of others (directly or indirectly) that never made news. Nearly 40 years after MMM was published and people in major corps still have to relearn the lessons.
Consider that from Lockheed Martin's perspective: The F-35 at that point is a program that is guaranteed to have money flowing no matter what, it is too grandiose to fail. The longer Lockheed Martin can protract the work and the more excuses they can muster to rack up the monies needed (read: monies they pocket), the better. The government cashcow will give milk.
Lockheed Martin knew precisely that obvious fact of overhead.
214 comments
[ 4.3 ms ] story [ 257 ms ] threadBut I really enjoyed The Design of Design as well.
R.I.P. Mr. Brooks. I thank you for introducing to me the idea of conceptual integrity.
I mentioned Fred Brook in a comment just earlier in the week. The Mythical Man Month is such an obviously and well known trap it's still surprising so many projects still fall into it.
Whilst his work is mostly seen as for software engineers, really it should be more well known by project and senior managers in general.
Brooks's observations are based on his experiences at IBM while managing the development of OS/360. He had added more programmers to a project falling behind schedule, a decision that he would later conclude had, counter-intuitively, delayed the project even further."
https://en.wikipedia.org/wiki/The_Mythical_Man-Month
He will always be remembered for “Brooks’s Law”, colloquially, “adding people to a late software project makes it later”:
https://en.wikipedia.org/wiki/Brooks%27s_law
And for his timeless essay, “No Silver Bullet”, which introduced the idea of accidental vs essential complexity in software:
https://en.wikipedia.org/wiki/No_Silver_Bullet
RIP.
I'm glad I got to at least shake his hand. One of the lawyers at Google had studied under him, and when I saw them crossing the street I just assumed the older gentleman with the visitor's badge was Brooks (I didn't even know what he looked like, but I found out later I'd guessed correctly).
When I was in high school and learning how to program, he let me borrow a copy of his Mythical Man Month book.
Was he at the school somehow?
Was Mythical Man Month useful for a high school programmer?
But when I got to grad school.. their convervsations about "the industry" and ways of working was massively inexperienced. I also read a lot at that age. It also did give me a leg up in identifying high pressure of delieverying. (The 9 women in 1 month for a baby reference).
sure, but
> even Wikipedia hasn't been updated
how would you rank the possibility that Wikipedia is updated from that same source? It's an open article. If a piece of news, say, "goes viral", how do you know this does not directly affect sources you would have used for comparison - /especially/ a wiki?
PS: I just realized the coincidence that I have just submitted a piece about "Epistemic Vigilance in teams, esp. in the context of news sources", https://news.ycombinator.com/item?id=33651906
I'd rank it as definitely possible. No idea how often it happens.
The thing that really persuaded me to put the story back up was the source of the tweet. A Columbia CS prof and law prof who had apparently studied with Brooks would not likely have posted that if he hadn't had a genuine notification.
You might want to consider reading The Design of Design if you liked The Mythical Man-Month.
"Show me your flowchart and conceal your tables, and I shall continue to be mystified. Show me your tables, and I won't usually need your flowchart; it'll be obvious." -- Fred Brooks, The Mythical Man Month (1975)
Stated a different way:
"Bad programmers worry about the code. Good programmers worry about data structures and their relationships." -Linus Torvalds
(a) rename the column, be the guy who broke the system and spend all weekend trying to fix 6 systems he never knew existed, written in Access, Excel, Crystal Reports, VB6, Delphi and a CMD file on a contractors laptop.
(b) keep the column name, deliver the feature, go home.
Bad programmers chose (b). Good programmers choose (a). Better programmers refuse the change request.
Ideally the table would have been named more generically but in an earlier stage startup there will be mistakes in naming things no matter how hard you try to avoid that.
So the only thing that actually breaks here is that a small number of engineers that care about this might misinterpret what it means unless they learn the appropriate tribal knowledge. Ideally it gets fixed but if you look at all of the things that can be improved in an early stage startup, this kind of thing is pretty minimal in importance so it becomes tech debt.
(b) Go home and be happily oblivious that six other systems silently started to produce wrong results since the meaning of the column has changed. But, of course, that is someone else’s problem, some other day, when several months of reports and forecasts have to be recalled and updated.
Self-documenting code (what I take in practice means "no comments"-culture) is something I don't understand how it can work, never seen a good implementation of it. It _can_ be successful in describing the _what_ but is poorly or not at all describing the _why_. Perhaps I'm in the wrong domain for that though.
Fairly hot take from me, life is more ambiguous than that :-).
The "why" is still very much needed since it can have 10 different and even conflicting reasons, and putting it in the code in appropriate amount shows certain type of professional maturity and also emotional intelligence/empathy towards rest of the team.
I mean, somebody has to be extremely junior to never experience trying to grok somebody's else old non-trivial code in situation when you need to deliver fix/change on it now. And its fairly trivial to write very complex code even in few lines, which some smart inexperienced juniors (even older, but total skill-wise still juniors) produce as some sort of intellectual game out of boredom.
People are definitely capable of looking at someone else's code and saying "this crap is completely unreadable, we should rewrite it all", while at the same time believing that their own code is perfectly readable and self-documenting.
It’s really hard to write a good comment that is only “why”. It’s really hard to keep comments up to date as code is moved and refactored. And an incorrect comment is much more damaging than no comment at all.
That’s the driving force behind “self documenting” code. My view is that a comment is sometimes necessary but it is almost always a sign that the code is weak.
Hard disagree with this.
If your comment is so volatile then that really sounds like there's something architecturally wrong with the code.
Most of the time these kind of "comments" can be turned into either a test, or a extensive description that goes into version control.
Because commit messages are just that: a comment for a specific moment in time. There are lots of options to inline comments.
I agree with this, but if the explanation for logic has good reason to be there, then keeping comments up-to-date with code changes is very important and it goes back to seniority and empathy I mentioned earlier - if you understand why its there in the first place, and you actually like rest of your team, you are doing too all of you a big favor with updates of comments.
Each of us has different threshold for when some text explanation should be provided, which is source of these discussions. But again back to empathy, not everybody is at your coding level, you can save a lot of new joiner's time (and maybe a production bug or two) if they can quickly understand some complex part.
Sometimes the 'why' is purely domain knowledge. Sometimes the 'why' is about narrowing down options available in the domain. Sometimes the 'why' is about a choice made for reasons that aren't specific to the domain. And sometimes the 'why' is about the code that wasn't written, so it can't possibly be in the code that was.
Comments are supplemental. If you have just added some weird, non-obvious, bit of code because you needed to compromise, or work around some other quirk, go ahead and comment. No one is going to (sanely) object to that.
[0] https://www-cs-faculty.stanford.edu/~knuth/lp.html
I have often had to write extensive comments related to this to prevent well meaning coders who are not expert in the domain from replacing the apparently bad or low performance code with an obvious but wrong 'improvement'.
I remember one time in css I had to do something weird like min-widht:0; It was needed to force the css engine to apply some other rule correctly,. but this will puzzle you when you read it. And this kind of puzzling code needs comments, I prefer to just put the ticket ID there and the ticket should contain the details on what the weird bug was with all the details, so if some clever dev wants to remove the weird code he can understand stuff.
Sometimes I see in our old project code like if webkit to X else do Y , there is no comment with a bug link so I have no idea if this code is still needed or not (Browsers still differ in more complex stuff, like contenteditable )
A great example is AWK: It's a tool, and it comes with a book from the people who made the software. That's how I like my software.
I hear this commonly from coders who haven't had the ambiguous pleasure of working with old, production critical codebases from generations of coders who have come and gone, with technical decisions buffeted around by ever-shifting organizational political and budgeting winds. Knowing the why's that leadership cares about is far more important to your career than the technical why's, which are along for the ride.
Once you go into production with tens of thousands of users and up, with SLA's driven by how many commas of money going up in smoke per minute...yeah, illusions of "pure" domain knowledge driving understanding of function dictating code form evaporate like a drop of distilled water on the Death Valley desert hardpan in the middle of summer.
I used to be like that as well years ago, but some kind greybeards who took me under their wings slapped that out of me.
Now my personal hobby code with an "unlimited" budget and I'm the sole producer and consumer? Yep, far closer to this Platonic ideal where comments are terse and sparse, and the code is tightly coupled to the domain.
A better approach would be that A comment should tell you something that you cannot glean from the code and/or is non-obvious. Yes, I understand non-obvious can have a truck driven through it, but in general it should work.
You can read code and understand what it's doing mechanically, but you may not understand why the obvious approach wasn't taken or understand what it's trying to achieve in the larger context. Feel free to comment on those, but if the code is difficult to understand mechanically, the code is generally bad. Not always, everything has exceptions, but generally that's true.
Like variables called "daysSinceDocumentLastUpdated" instead of "days". The why comes from reading a sequence of such well described symbols, laid out in a easy to follow way.
It doesn't do away with comments, but it reduces them to strange situations, which in turn provides refactoring targets.
Tbh, its major benefit is the fact that comments get stale or don't get updated, because they aren't held in line by test suites and compilers.
Most comments I come across in legacy code simply don't mean anything to me or any coworkers, and often cause more confusion. So they just get deleted anyway.
Self describing code does not need theRidiculouslyLongNamesPerferredByJavaCoders.
Most often I'm just skimming through, and actual descriptions are much better than having to read the code itself.
This whole notion of "documentation can get out of sync with the code, so it's better not to write it at all" is so nonsensical.
Why isn't the solution simply: "lets update the docs when we update the code". Is this so unfathomably hard to do?
Comments allow for a high-level view of your code, and people who don't value that probably on average have a slower overall output.
I simply cannot comprehend the mindset that views comments as unnecessary. Or worse, removes existing useful comments in some quest for "self-documenting" purity.
I've worked in some truly huge codebases (40m LOC, 20k commits a week, 4k devs) so I think I have a pretty good idea of what's easy vs hard in understanding unfamiliar code.
A lot of people think comments are descriptive rather than prescriptive. They think a comment is the equivalent of writing "Fence" on a plaque and nailing it to the fence. "It's a fence," they say, "You don't need a sign to know that."
Later, when the next property owner discovers the fence, they are stumped. What the hell was this put here for? A prescriptive comment might have said, "This was erected to keep out chupacabras," answering not what it is, but why.
You might know about the chupacabras, but if you don't pass it on then you clearly don't care about who has to inherit your property.
What's amazingly funny is that many people think this is a positive, because they ascribe more value to working hard than to achieving results. I even thought your comment was going to go that way when I first read it.
I do believe that in a lot of case an outdated, wrong or plain erroneous documentation does more harm than no documentation. And while the correct solution is obviously "update the doc when we update the code", it has been empirically proven not to work across a range of projects.
I just had a semi-interview the other day, and was talking with someone about the docs and testing stuff I've done in the past. One of the biggest 'lessons' I picked up, after having adopted doc/testing as "part of the process" was... test/doc hygiene. It wasn't always that stuff was 'out of date', but even just realizing that "hey, we don't use XYZ anymore - let's remove it and the tests", or "let's spend some time revisiting the docs and tests and cull or consolidate stuff now that we know about the problem". Test optimization, or doc optimization, perhaps. It was always something I had to fight for time for, or... 'sneak' it in to commits. Someone reviewing would inevitably question a PR with "why are you changing all this unrelated stuff - the ticket says FOO, not FOO and BAR and BAZ".
Getting 'permission' to keep tests and docs current/relevant was, itself, somewhat of a challenge. It was exacerbated by people who themselves weren't writing tests or code, meaning more 'drift' was introduced between existing code/tests and reality. But blocking someone's PR because it had no tests or docs was "being negative", but blocking my PR because I included 'unnecessary doc changes' was somehow valid.
To me, this feels similar to finding the correct granularity of unit tests or tests in general. Too many tests coupled to the implementation too tightly are a real pain. You end up doing a change 2-3 times in such a situation - once to the actual code, and then 2-3 times to tests looking at the code way too closely.
And comments start to feel similar. Comments can have a scope that's way too close to the code, rendering them very volatile and oftentimes neglected. You know, these kind of comments that eventually escalate into "player.level += 3 // refund 1 player level after error". These are bad comments.
But on the other hand, some comments are covering more stable ground or rather more stable truths. For example, even if we're splitting up our ansible task files a lot, you still easily end up with several pages of tasks because it's just verbose. By now, I very much enjoy having a couple of three to five line boxes just stating "Service Installation", "Config Facts Generation", "Config Deployment", each showing that 3-5 following tasks are part of a section. And that's fairly stable, the config deployment isn't suddenly going to end up being something different.
Or, similarly, we tend to have headers to these task files explaining the idiosyncratic behaviors of a service ansible has to work around to get things to work. Again, these are pretty stable - the service has been weird for years, so without a major rework, it will most likely stay weird. These comments largely get extended over time as we learn more about the system, instead of growing out of date.
I recently had an interview with what struck me as a pretty bizarre question about testing.
The setup was that you, the interviewee, are given a toy project where a recent commit has broken unrelated functionality. The database has a "videos" table which includes a column for an affiliated "user email"; there's also a "users" table with an "email" column. There's an API where you can ask for an enhanced video record that includes all the user data from the user with the email address noted in the "videos" entry, as opposed to just the email.
This API broke with the recent commit, because the new functionality fetches video data from somewhere external and adds it to the database without checking whether the email address in the external data belongs to any existing user. And as it happens, it doesn't.
With the problem established, the interviewer pointed out that there was a unit test associated with the bad commit, and it was passing, which seemed like a problem. How could we ensure that this problem didn't reoccur in some later commit?
I said "we should normalize the database so that the video record contains a user ID rather than directly containing the user's email address."
"OK, that's one way. But how could we write a test to make sure this doesn't happen?"
---
I still find this weird. The problem is that the database is in an inconsistent state. That could be caused by anything. If we attempt to restore from backup (for whatever reason), and our botched restore puts the database in an inconsistent state, why would we want that to show up as a failing unit test in the frontend test suite? In that scenario, what did the frontend do wrong? How many different database inconsistencies do we want the frontend test suite to check for?
Though, interestingly enough, I have built a test that could have caught similar problems back when we switched databases from mysql to postgresql. It would fire up a mysql based database with an integration test dump, extract and transform the data with an internal tool similar to pgloader, push it into a postgres in a container. After all of that, it would run the integration tests of our app against both databases and flag if the tests failed differently on both databases. And we have similar tests for our automated backup restores.
But that's quite far away from a unit test of a frontend application. At least I think so.
It would seem that the unit test itself should be replaced with something else, or removed altogether, in addition to whatever structural changes you put in place. If you changed db constraints, I could see, maybe, a test that verifies the constraints works to prevent the previous data flow from being accepted at all - failing with an expected exception or similar. But that may not be what they were wanting to hear?
I think this is a well put and nuanced insight. Thank you.
This is really what the dev community should be discussing; the "type" of comments and docs to add and the shape thereof. Not a poorly informed endless debate whether it should be there in the first place.
The fact is that, when you zoom out to org level, comments do quickly drift out of sync and value, and so engineering managers must encourage code writing that will maintain integrity over time, regardless of what people "should" be able to do.
1) Communicating with computers
2) Communicating with other humans
Self-documenting code is essentially writing prose. Granted, to someone with similar knowledge as you.
But most people suck at writing.
Drifting off-topic, but I wonder how close to the top of the list TMMM is for "on loan" duty cycle in the software world. My copy also seems to be persistently in someone else's hands.
When a developer wants to switch from one area to another, they go through an accelerated program (takes only about a month).
In my experience, studying the database schema and IO data structures is indeed the best way to begin understanding a complex system.
Showing things acts as a forcing function to fix the thing being shown
I mean I've waded through tons of code where the original author abused strings to indicate relationships in a table - a column with semicolon-separated values referencing other tables / rows. And a ton of code to check references.
Mind you, that's more database design than data structures, but they're close enough for this example.
I always attributed it to Rob Pike, but it turns out Pike's is following:
> Rule 4. Fancy algorithms are buggier than simple ones, and they're much harder to implement. Use simple algorithms as well as simple data structures.
> Rule 5. Data dominates. If you've chosen the right data structures and organized things well, the algorithms will almost always be self-evident. Data structures, not algorithms, are central to programming.
https://users.ece.utexas.edu/~adnan/pike.html
Interestingly enough, the above link has this to say:
> Rule 5 was previously stated by Fred Brooks in The Mythical Man-Month.
Which I guess references GP's excerpt.
Also says this, which kinda loops back to Linus's way of saying it:
> Rule 5 is often shortened to "write stupid code that uses smart objects".
To me, the first (by Brooks) seems to be about grasping the domain model to understand what the system does (or can do) in general.
Wheras the second (by Torvalds) seems to be about how best to organize data in code for efficient processing. Array, hash, tree, heap, etc and their associated access time complexity. The efficiency of your solution depends on your choice of a data structure that fits the local problem.
A favorite quote of mine from MMM: "The programmer, like the poet, works only slightly removed from pure thought-stuff. He builds his castles in the air, from air, creating by exertion of the imagination. Few media of creation are so flexible, so easy to polish and rework, so readily capable of realizing grand conceptual structures...."
I have a beautiful Docubyte print of the IBM-360 in my room, as a reminder of the great endowment that is our computing past. Well done to Brooks on a remarkable life’s work.
> Yet the program construct, unlike the poet's words, is real in the sense that in moves and works, producing visible outputs seperate from the construct itself. It prints results, draws pictures, produces sounds, moves arms. The magic of myth and legend has come true in our time. One types the correct incantation on the keyboard, and a display screen comes to life, showing things that never were nor could be.
[0] https://pages.cs.wisc.edu/~param/quotes/man-month.html
I bought the book years ago when I was on my 'let' s learn everything I can about computers and software ' spree. Very few books have left such a lasting impression on me, even though at the time I had no notion whatsoever of what professional software engineering was like.
The important thing is not to worry that what we have is merely good, because the perfect might be waiting around the corner. It's not.
The other "standing on the shoulders of giants" is used as justification for accumulating more and more dependencies and not writing stuff oneself, no matter how simple, which is how we get into left-pad-like territory.
We should indeed focus on reusing libraries, but please, _good_ libraries and not ones, which impose limitations in implementation as well as future thinking, by creating a high mental barrier to change ("But if we switch out this library we need to change aaalll this stuff, because our code is adapted to how the library works."). Sometimes adding a dependency is simply not worth it, like in the left-pad scenario. Just write that one function yourself and don't add more dependencies to the project. Always weigh the benefit against the additional load of dependencies added directly or indirectly as dependencies of dependencies.
But should I really start writing a graph algorithm for the 15th time? I believe the point of the quote is not “blindly add dependencies”, but that a significant boost in productivity can come from reusing already existing, high quality code that fits in with the projects requirements. Left-pad is clearly not such for most projects, and “it is not a free lunch” (:D) in that maintaining dependencies also has a cost.
His argument is developers use a lot of time on the intrinsic complexity of designing solutions for complex problems. Representing these solutions in code is a smaller part of the job. So even if a new language increased coding productivity by 10x (like going from assembler to C might) it wouldn't increase overall productivity with the same factor.
In short, the bottleneck is not the coding, the bottleneck is our minds thinking about how to solve the problem.
But it does also mention that since the appearance of high level languages, we are on a path of diminishing returns:
“The most a high-level language can do is to furnish all the constructs the programmer imagines in the abstract program. To be sure, the level of our sophistication in thinking about data structures, data types, and operations is steadily rising, but at an ever-decreasing rate. And language development approaches closer and closer to the sophistication of users. Moreover, at some point the elaboration of a high-level language becomes a burden that increases, not reduces, the intellectual task of the user who rarely uses the esoteric constructs.”
Also, Brooks originally wrote this paper for a 10 years timeline, and my point was mostly that even though we are like 3 times over its original length, I still don’t think languages would be even 3 times more productive, let alone more (and I won’t buy empirical evidence of your fav language, but some form of objective one).
Yeah, and then you have the core banking system tied with scotch tape and bubble gum in the 1950s, that drives a business worth tens of billions of dollars and for which a modern rewrite would probably cost a billion dollars.
And then you realize some pieces of software are harder than a mountain made of titanium.
A favorite, lesser known quote of Fred's from his technical communications course at UNC and a SIGCSE talk. Beyond a software engineer and researcher, he was an extraordinary educator. His design ethos carried through to pedagogy, as well, and has been an inspiration to me. Thanks, Fred.
I've still got my copy of MMM from 20 years ago. I re-read it recently (~2 years ago). Such great wisdom in that book. Would highly recommend it.
1. Adding more people adds overhead which slows down productivity. Might even make it worse
2. 10X developer (100X) mythology and how other programmers should be their support secretaries
(1) is too obvious and (2) I didn’t like for self-interest reasons.
If only.
https://www.military.com/daily-news/2013/06/19/lockheed-reas...
> Lockheed Martin Corp. has reassigned 200 engineers to work on the F-35 fighter jet's software, a problem area that Defense Department officials fear could cause more delays to the program.
Somehow obvious to DOD, but not to LM. And that's just one of the more high profile incidents I know of, I've witnessed plenty of others (directly or indirectly) that never made news. Nearly 40 years after MMM was published and people in major corps still have to relearn the lessons.
Lockheed Martin knew precisely that obvious fact of overhead.