Ask HN: Do you think intuition is as valuable as rational thinking?

51 points by waru ↗ HN
[This is the first thread I've started here on HN, so I apologize if I made some kind of obvious blunder.]

I was wondering what other hackers' opinions are regarding the value and importance of rational thinking versus intuitive thinking.

By intuitive thinking I mean "going with your gut," doing something because it "feels right," and pursuing something you feel inspired to pursue even though you don't have any rational explanation why at the time.

Rational thinking, on the other hand, would be having a fully realized logical plan and explanation for your actions and decisions.

In the past, I have met some hacker types who think that rationality is the be-all end-all of everything, and that if you can't explain or prove something rationally, then it's not of any value.

Personally, I think that intuition can be more powerful than rationality in some cases, and certainly equally important to train and be able to use. (In my experience, decisions and actions based on intuition usually end up having a rational explanation, I just don't fully understand until later.)

I also think that you can train your intuition, or at least train yourself to recognize when your intuition is good, and then follow it.

Since most people here are trying to think of something new and useful, I imagine that they understand the importance of creativity and imagination, and since intuition and inspiration are crucial for that, I would guess that most people here basically agree with me, but I was wondering what other hackers have to say about this.

What do you think? Thanks.

78 comments

[ 4.2 ms ] story [ 155 ms ] thread
Please don't apologize for trying things. :)

To answer your question. I have personally been more right than wrong when i have followed a gut feeling. I also act when i go with it more often than when i dont. When i am 'rational' i often DO NOT act because rationality tends to lead to pessimism. Atleast with me.

Hm, well, this thread doesn't appear on the "ask" section of HN, only in "new", so I think I may have missed something if there's a way to control that.

Rationality can definitely lead to pessimism if you're not careful, but I think most pessimism is actually quite irrational. Rationality can also be used to support optimism (for example, it's rationally possible that I become really successful). So I try to live by what I call "optimistic rationality" (if that hasn't been coined already. :) )

It's there now. Sometimes it takes a minute.
(i don't know how to quote stuff you've said above so assume i have :))

I think that pessimism and rationality are close cousins. In that modern terms like 'be rational' tend to really mean that we should 'be skeptical'. Which tend to mean that we should 'be pessimistic'

That's true about "Be more rational." (ie "Your idea is stupid; quit being adventurous."). That's why I hesitate to say "rational optimist," because rational as an adjective has such skeptical, pessimistic connotations. Some "skeptics" drive me nuts.
I think you might be confusing instinct with intuition.

Intuition is a means of taking in information. Psychologists call it irrational because it isn't really a decision making process.

Instinct is very rational, we just don't usually recognize it as such because it isn't concerned with verbalizing its logic. For instance, the game of basketball actually requires a lot of logic if you think about it. It's just that it requires a very fast-acting form of logic. Imagine how ridiculous it would be for a basketball player to say something like "I know I can make this goal because of Jordan's theorem". By the time they finished that thought, the other team might have already scored.

Intuition + rational thinking = valuable/powerful
Rational thinking can sometimes be like a wall...

Intuition will sometimes lead to ludicrous solutions...

Guess you have to use rationality to filter out the ridiculous ideas you can come up with intuitively...

"The intuitive mind is a sacred gift and the rational mind is a faithful servant.

We have created a society that honors the servant and has forgotten the gift."

Albert Einstein

Einstein has some great quotes about intuition and creativity.

I also like "Logic will get you from A to B. Imagination will take you everywhere."

His quotes are basically the proof of the pudding that rationality needs intuition, since he's thought of as one of the greatest scientific minds ever.

His quotes don't prove that "rationality needs intuition", they only prove that he could be one of the greatest scientific minds ever while also saying things people like to hear.
I can't track down a source for this. Do you have one? It's not that far from things that Einstein said (for example, he did say that imagination is more important than knowledge), but it's different in tone. He didn't typically speak in terms of the sacred and he wasn't this kind of social critic, so it would surprise me if it were authentic.

Off topic but interesting: the wonderful definition of insanity that's always attributed to Einstein (doing the same thing over again while expecting different results) never came from Einstein at all. It has been traced to a 1983 novel by mystery writer (and one-time partner of Martina Navratilova, how's that for trivia) Rita Mae Brown.

I found it here, but I've seen it elsewhere (although neither one I would quote as a source in a scholarly paper): https://notes.utk.edu/Bio/greenberg.nsf/0/25f4f2f5e0cc667485...

Secondly, he did speak of the sacred very frequently in fact, especially later in life: http://www.time.com/time/magazine/article/0,9171,1607298,00....

Regardless, it's a good quote either way, don't you think?

I found it here

Most such quotes on the internet are fake. I'm fascinated by how catchy lines get attributed to famous people, so this is a bit of a hobby.

Secondly, he did speak of the sacred very frequently in fact

The article you link to doesn't include the word "sacred". I think the word is significant. It doesn't quite seem like a word Einstein would use. Especially in the context of a "sacred gift", which implies a gift-giver. Einstein's deism was resolutely impersonal.

As you doubtless are aware, Einstein's religious views or lack thereof are the subject of perennial quarreling among camps eager to claim his name for their own. It's all rather tedious. But it's at least a credit to Einstein's open-mindedness and tolerance that he wasn't a finger-wagging scientistic scold of the likes of Dawkins.

Regardless, it's a good quote either way, don't you think?

Not quite, no. Certainly my sympathies are all with this line of thinking, so I ought to like it, but it feels like it hits the nail askew. I mean, if the intuitive mind is a sacred gift, why isn't the rational mind also? Presumably there can be more than one gift. Also, the implied symmetry between "intuitive mind" and "rational mind" seems slightly facile. I'm a big relier on intuition but I'm not sure I'd call it a mind. But I'm just rambling out loud here. Thanks for an interesting discussion.

Edit: do you know Eugene Gendlin's work on intuition? One of these days I want to read him in greater depth. But I'm familiar with his book Focusing which was an original contribution to psychotherapy. He speaks of intuition (actually, he uses the phrase felt sense) as a kind of bodily knowing distinct from cognitive knowing.

Intuition and rational thinking are most powerful when you get them to agree. If I reason my way to a conclusion that doesn't feel right, that's a good indication that I missed something or discounted some aspect that I shouldn't have. And if I have a gut feeling, I won't act on it until I can rationalize it.*

* Of course, rationalizing a gut feeling is far from objective. But at least it makes you think things through.

The only thing is that, for me, rationalizing the intuition before I act on it can waste time and the opportunity, and kill inspiration. So I think it's important to act first sometimes (then go back and understand rationally later, as one other poster mentioned).
Logic is great for answering life's questions; intuition is great for knowing which questions to ask.
Though doing it the other way around makes for more interesting cocktail parties.
Intuition is very often a direct result of experience--- I still remember my math professors all chanting various mantras about training my 'mathematical intuition' and over the years, I'd have to agree with them. I don't think in terms on one versus the other, if you are not using both, something is wrong. Easy to understand if you don't have any intuition, but if you do and you ignore it for the sake of 'rationality', I'm not sure that would in fact be rational! We get our ideas from a lot of different places, some more off the wall than others--- once we have them we can examine them and proceed or discard based on some presumably rational evaluation. Is intuition as valuable as rational thinking? You betcha!
I've found that there is a trend in software development to throw out both reason and intuition, and rely upon a form of retarded "test driven" empiricism. You can't possibly be smart or experienced enough to KNOW how your for loop is going to work, it has to be thoroughly tested. The same goes for product development. We can't possibly come up with an idea that people might want, without first taking a few polls where we ask them what they want...
I think that is in some way flawed.

For instance, it's possible to mathematically prove in some cases that one algorithm is better than another; a set of ten nested for loops simply has greater time complexity than one. You don't need to actually test which algorithm is better.

And secondly, your intuition can be bad, but it's not guaranteed to be wrong, either. If you're a very experienced developer you might have a feeling about what's a more efficient way to code something up that could be in general, correct. Not every decision you make needs to be tested.

However, there is absolutely no point in arguing whose algorithm is better if there IS an argument about it since it can be tested easily. Also, if you personally are not sure which approach is better, test it.

And finally, you're actually in luck if you have two algorithms that you can test and find the better one. That's an easy situation to deal with. It's actually much harder if you only have one algorithm and it's a slow memory hog. Testing is only as good as the options you give it.

(On a related note, this is especially important to remember in science, too- testing hypotheses is only as good as the hypotheses you come up with to test. There could always be a correct hypothesis out there and you never even conceived of)

> For instance, it's possible to mathematically prove in some cases that one algorithm is better than another; a set of ten nested for loops simply has greater time complexity than one. You don't need to actually test which algorithm is better.

At the risk of being pedantic, I want to point out that it's not always so clear-cut. Take sorting, for example. Everybody knows that quicksort is quick; it says so right there in the name. It runs in O(n lg n) time with small constant factors. But for small arrays, or arrays which are mostly sorted already, you can do better by using insertion sort, which runs in O(n^2) time. Somewhere in the bowels of glibc is a highly-optimized quicksort which does exactly this: it drops down to insertion sort for subarrays of size 6 or less.

And don't even get me started on the effects of cache locality. The point is, sometimes intuition and analysis of algorithms can only go so far; at some point you've got to either test it or just call it "good enough" and think about something else.

At the risk of being pedantic: quicksort has a worst-case runtime of O(n^2).
At the risk of being even more pedantic, quicksort with the O(n) deterministic median finding algorithm has a worst-case runtime of O(n log n) -- you use that algorithm to find the median each time and use that as the pivot.

The constants would make it less efficient for most cases, though.

empiricism has the potential benefit of including unconsidered factors, or exposing misleading priors. Cache locality is a great example of a possibly overlooked confounding factor.

there is no pure or complete ordering of reason, intuition or empiricism. Wisdom is knowing when each approach is the best fit, and understanding that even the best approach selection heuristic is not 100% reliable.

Intuition, analysis, and testing are all ways that you can make predictions about future results. I hope you're not disputing this, but just arguing that a lot of people put too much weight on testing while undervaluing intuition and analysis?

If so, that's an interesting hypothesis. Is it true?

They are two different tools for different scenarios. Intuition is only valuable when you are experienced in something. Rational thinking, however, can be applied to areas where you have no or little experience.

Say, if a person doesn't know programming, his 'intuition' in programming would just be wild guesses and unlikely to be useful. However, he can still gather facts on programming and think rationally on it, no matter how slow and painful.

So in your original context of your post, I would suggest that we should only use intuition when we have extensive experience in that market or working with the target users. Otherwise, stay close with rationality.

Hm, good point.

What about general life decisions? It's hard to say if you have enough "experience" in life to have good intuition about it.

Life decisions are super tough. Study logic and philosophy to think rationally, and listen to intuition from older dudes and veterans, I guess? :P
It is by logic we prove, it is by intuition that we invent. - Henri Poincaré
Is intuition as valuable as rational thinking?

At first glance, yes.

Upon some reflection, though...
I've definitely found intuition to be valuable, in the sense that my own intuition has been correct more often than otherwise. But intuition is basically the result of my unconscious reasoning based on lots of past experience, so it absolutely has to be trained--it's worthless without that background.

However, if I've made an important choice intuitively and it turns out right, I absolutely dig back into it and try to discover why it was the right choice in a rational fashion. Understanding that choice rationally lets me learn how to apply what I learned later, and sometimes helps me see second- and third-order effects which I can't see intuitively.

I think intuition is the only way to proceed, actually.

-- But let me clarify! I want to directly attack those who you refer to thinking that "if you can't explain or prove something rationally then it's not of any value". I don't think anyone is a constant calculator like that. It's important to learn because we're building computers that operate that way, but it doesn't appear that strict rationality (whatever that is) is our true operating mode.

So if you want to get the gains of rationality, the best you can do is use rational structure to train and shape your intuition. If you're skilled at the math required then you can use it to empower your intuition -- but never replace it.

I say this with strong fear of thought paralysis. Those who spend too long rationalizing every thing seem likely to trap themselves in local minima, to argue endlessly over two similar choices while missing out benefit of either.

I like to think about MCMC algorithms, actually. They're guaranteed to converge to the most liable posterior beliefs, but do so by jumping randomly. Each step forward is technically blind and hopeful, but by keeping a goal in mind and learning from every jump you improve, even considering the immense ignorance that Markov methods maintain.

Intuition can do better.

Yea, people who insist that everything should be thought out rationally do seem pretty insane, since no one, no matter how rational, could ever be like that all the time, and it would actually limit them a lot.

It feels empowering to hear from a fellow intuition enthusiast, too! :)

i found out that most times my intuition is right, even when rationally thinking about something would come up with a different decision.

but i guess this strongly depends on your intuition :)

(comment deleted)
The value of the two are intricately linked but ultimately not comparable.

Is money as valuable as a marketable skill? Is getting somewhere quickly as valuable as a vehicle?

The intuition of a person who doesn't value rational thinking is going to be worthless in an empirical field. The gut feeling of someone who can't show they are right is not likely to be correct.

Intuition is just the fast-read cache of pre-computed notions. If a problem looks similar but not exactly like a dozen or so others that you have solved in the past, you take a sort of snapshot of all that past work and distill it into an intuitive grasp of the problem.

If you see a problem unlike any you have ever encountered, you are unlikely to have an intuitive idea of the solution. Sometimes people will pull past-solved problems out of their fast-read cache and apply them to unrelated problems in an irrational way; sometimes people will feel their intuition guiding them in a certain way and rationally realize they are projecting subconsciously an unrelated situation onto the problem.

So intuition is only as valuable as its rational basis. Intuition is much more efficient, much like using a rainbow table to crack a password; the table is only as effective as its precomputed hashes; it will never crack a password that hasn't been precomputed. However, compared to a traditional brute-force approach, it's orders of magnitudes more efficient. A brute-force approach however, with enough time will crack any password.

Well, the powerful thing about intuition is that you actually can intuit something totally new. Of course it draws on past experiences, but it can connect past experiences and solutions in new ways, to create a brand new solution. So, I think intuition is not as simple as being a faster way of pulling out an old solution.

I, for one, often struggle to explain to others why my gut feeling is right, but it often is.

New, yes.. but just 'out of the blue'.. I doubt it. A life long plumber is not going to suddenly intuit a better algorithm for full text search; but a dataminer in the accounting world might.

I agree that it can connect past experiences and solutions in new ways; that's obviously what it does, but my point is those past experiences and solutions have to exist already; it's literally what they are drawing from. If your brain categorized failures as 'solutions' due to irrational thinking, whatever you intuit from those 'solutions' is going to be a failure as well.

Struggling to explain why your gut feeling 'is right' when it pops into your head is normal and completely separate than being absolutely unable to make a good argument for it when people offer contradictory solutions.

Personally, when my intuition is ahead of my reasoning, yet I have a strong personal belief my intuition 'is right' I will often later, in a spontaneous way rationally link it all together in a sort of "ohh thats why it's like that."

I think the hard part about working off of intuition is communicating it to others. I often find myself working backwards to justify out my intuition, and I think it comes across as me just making stuff up.
Intuition, for me, is just natural rationality that has been 'learned'.
Each approach has liabilities that should be recognized. Intuitive decisions might "feel right" but there are so many cognitive biases that can make something intuitively appealing but surprisingly wrong. Analytical, rational approaches are likewise poor at developing creative solutions but is good at removing bias from reasoning by clearly stating every step.
People who believe that they make all their decisions rationally are delusional.

I say this with confidence because there is a large amount of research showing that people make decisions with a good deal of input- if not entirely- from the non-conscious parts of their brain. In fact, there are some people that argue that our conscious brains don't make decisions at all, they merely rationalize it post facto. (This goes too far, for me)

The classic example of this are the split brain studies, where they would show one half of a person's brain a sign that said "stand up." The patient would stand up. Then they would ask the other half of the brain (the one that was capable of speaking; in most humans, only one half of the brain can) why they stood up, and they would be completely convinced it was because they wanted to get a drink or water, or go to the bathroom.

That said, I'm pretty much the most gung-ho person on reason I know. The reason for this is that, like someone mentioned on a blog post on here, intuition is not transferable. If someone wants to convince me of anything at all, they're going to have to make reasoned arguments, not emotional ones.

The reason for this is that, like someone mentioned on a blog post on here, intuition is not transferable. If someone wants to convince me of anything at all, they're going to have to make reasoned arguments, not emotional ones.

Hmm, I'm not as sure on that one. Aren't there studies that show that convincing people via logical argument is just about the least effective possible means of persuasion? Politicians might be seen as something like professional intuition-transferrers: they want you to come around to their way of thinking, and they don't stick to only using rational arguments as the primary way of making that happen.

Even in philosophy, arguments by analogy often seem aimed at least partly aimed at transferring intuition, by mapping a situation to one where that you hope your reader has the intuition you want.

Intuition represents all the reasoning that your brain does but which you aren't able to put into words. In many cases, that includes important information and heuristics which you would be ill advised to ignore. However, that also includes information and heuristics that may be incorrect; so if your intuition disagrees with your explicit reasoning, you should debug both to figure out which one's wrong and how.
This is what I was thinking as well as I followed this thread. What we call "intuition" is often a conclusion from our subconscious mind based on cues and observations of which we may not be explicitly aware.

In other words, our mind is constantly watching and learning, and then matching that data to patterns we've observed in the past; not all of this information reaches the front of our consciousness.

Of course, if it's subconscious, it is easy to get misled, or match patterns inaccurately since there is no rigorous examination involved about the underlying assumptions.

I'm not sure I see the distinction. If following your intuition leads to better results than a more explicitly analytical method, then obviously the rational thing to do is to place more weight on your intuition. If "rationality" systematically underperforms an "irrational" approach, then your definitions are exactly backwards.
An intuitive decision making skill worth having is always based in reason.

We might not base those intuitive decisions on clear cut reasons (that guarantee results, 100%), but we base them on past experiences and observed phenomena (that increase the likelihood of the result, sometime even to 100%.)

If you are asking about an intuitive decision that is not based on any of the above, then your question is really, "Should I make random decisions?" Sure, just because something has a minute chance doesn't mean it won't happen. It might just work.

Emotions seem to be essential to decision-making. People with brain injuries preventing them from having emotions find many things impossible to decide. [1]

But however much we rely on emotions and intuition in our own thinking, they're not easy to communicate, especially to skeptics. Those of us with a scientific and skeptical mindset try not to accept irrational arguments from other people. [2]

So, in some sense, an idea without a rational justification isn't worth very much (yet), because you can't convince most people that it's correct. But it still might have a lot of potential! And if we're talking about hacking then there are other forms of persuasion (code and demos).

[1] http://changingminds.org/explanations/emotions/emotion_decis...

[2] This is especially true of mathematics where rational arguments (that is, proofs) are valued far above any other kind of argument.

Nature (and evolution) can be both abundant and parsimonious. Abundant might refer to the explosion of life-forms around the time of the pre-Cambrian. Or, in our day, the extraordinary way that insects and flowering plants interact (and drive the speciation of each). Maybe one can think of these as evolutionary windows of opportunity.

In this case (emotion), my guess is that parsimonious applies. When there’s all that useful circuitry in the cerebellum (emotion), why reinvent it in the cortex? The cortex obviously has new and very useful circuitry but there will still be many applications where the old circuitry - and thus the cerebellum and emotion - are what’s needed.

Emotion has been around a much longer time than reason (and is found in a wider range of animals). It’s true that it was probably easier for evolution to invent emotion but history is also telling you that the evolutionary advantages of emotion are longer-standing and better tested than reason. Current events tell me that the evolutionary jury is still out as regards human-type reason - or at least the way these various quantities (reason, emotion, intuition, etc) are wired together in the case of human beings. Evolution may need a redo.

I think it depends on the kind of person you are. Use what you have.

I'm the type that will routinely head off to a restaurant with only vague information about where it is or what its name is.

"It's probably down here, this seems like a street that would have mexican restaurants on it..."

"I've been there once before, and I remember it was on a block that was on the edge of a hill that sloped off toward the morning sun..."

It seems crazy, but the reason I end up doing this is because it works a surprising amount of the time. I end up getting there, somehow.

With work, I find that I end up relying on intuition the same way. The downside is that until I'm familiar with the problem space, I tend to be more unsure of myself than my rational peers. The upside is that once I learn the space, I can move more quickly with less information than they do.

Edit: Like others said below, the other downside is that this can sometimes lead to surprisingly bad results, especially in new and unfamiliar areas. I've been trying to exercise my logic muscles more recently to help with this.