Ask HN: How do you suss out very hard but solvable problems?

2 points by Nomentatus ↗ HN
I spent some time today discussing Elon Musk, the old PayPal crew, and how to get a nose for very hard problems that can, nonetheless be solved (advancing the art and establishing or furthering a business) with an old technologist friend of mine, who's been writing a book. While we agreed that "intuition based on experience" is part of the answer; we also settled on a few rules - I hope y'all can add a few more or poke holes in these.

1) How long since the problem has been seriously revisited? If your queries about new ways are dismissed with facile contempt, but no details and no examples and no specific journal references then maybe nobody alive or active in the field was around when the issue or technology became "settled." When Elon entered the rocket business, it had been an Oligopoly for a long time; many problems, such as how to form aluminum into a fuel tank other than by milling a huge chunk, hadn't been revisited in a couple of decades and more.

2) You hear "If it were possible somebody would have done it already" repeatedly from the "experts." This means "Even though this is my field and it would be an obvious advance I've never spent a second thinking about this." Which is odd, and suggests 1) is true, at a minimum, or perhaps that prevalent unconscious assumptions that have never been explicitly stated or tested, have decided the issue, at a maximum.

3) The question is just outside the understood boundaries of any current common field of expertise. Experts, we know from research, wildly overestimate their competence when considering questions bordering on their genuine area of expertise or outside it.

4) The topic has become disreputable, for reasons that are more coincidental than evidential. A highly publicized accident, fraudulent research in a similar area (that actually provided no evidence one way or another, since it was mere fraud.) Etc.

3 comments

[ 1.4 ms ] story [ 9.3 ms ] thread
The background - Thiel, Musk, etc have said that PayPal trained them to create other billion-dollar companies by forcing them to solve tough problems that could, barely, be solved; part of which was a training in discriminating between very hard problems that could be solved if you smashed yourself at them month after month, and those that couldn't be solved.
5) You are asking a general question and get a "not possible, see paper X" from pretty much every expert you ask. You look up the paper or book and see that it's giving a specific result, NOT a general answer at all. For example, in the late 1970's I asked "what about neural nets for AI" and got the uniform answer "No possible, as Minsky and Papert have proven that mathematically. Forget about it." When I looked into that... the proof wasn't general at all, it only applied to one quite specific method of training neural nets. So I set about programming a function to generate perfect tic-tac-toe players that were neural nets, successfully, using another method (but couldn't get any traction even so, Minsky had made the topic far too toxic.)
My first question is why you want to solve only hard problems? I understand there are a couple of motivation 1. Training yourself to solve hard problem 2. It open doors

I would think it's more valuable to figure out valuable opportunities (this might involve some hard problems or other combination of market forces). So for me hard problem is figuring out valuable opportunities before other people notice.