Ask HN: Best resources to gain math intuition?

389 points by fluroblue ↗ HN
In high school I did the lowest tier maths and then jumped in the deep end by doing a year of electrical engineering. I’ve now done those harder math classes but I feel like there’s holes here and there. I think when I took physics it really brought out these flaws and lack of intuition.

Would anyone have a good resource for building this up?

Thanks

91 comments

[ 3.1 ms ] story [ 155 ms ] thread
Pure Mathematics for Beginners by Steve Warner runs through the (very) introductory elements of major branches of math [0]. If you want even more leisurely intro to math intuition without worrying about elements of topology/abstract algebra or whatever, Book of Proof by Hammack is great and free [1].

[0] https://www.amazon.com/Pure-Mathematics-Beginners-Rigorous-I...

[1] https://www.people.vcu.edu/~rhammack/BookOfProof/

Like most people he's probably referring to applied math. It's really what most people outside of graduate students or math majors are interested in.
Plug, but I have a blog for exactly this. As an EE/physics student you may appreciate this one on Euler's Formula:

https://betterexplained.com/articles/intuitive-understanding...

Thanks I’ve enjoyed your work especially the one on imaginary numbers
Thanks, one of my favorite aha! moments :).
Your aha! moment helped me to have my own aha moment when I was having a hard time building a mental model to really get phasors, so thank you too :).
I often quote/link your article on the Adjective Fallacy [0], about once a month since I first saw it nearly ~4 years ago! Thanks for a great resource.

[0] https://betterexplained.com/articles/adjective-fallacy/

Wow, that's awesome to hear! One of my fears is having to keep blogging continuously, but luckily math is pretty evergreen, so my intermittent writing schedule doesn't punish me too much.
Hey Kalid, I didn't know you roamed here. I love your site. I have recommended it to everyone who asked me for math resources. I really like your site. Thank you for building an amazing resource.
That's awesome to hear, thanks for helping share it :).
I second this, with emphasis. His videos cover the vast majority of topics at the intersection of math and hn. He has written custom software for the creation of the animations.

It’s on another level imo.

3blue1brown is a special kind of awesome.

I'd love to filter the internet by "content that can give you insights right now that would otherwise take years of study in a specific discipline to even know exists".

Another that I saw recently on an HN comment (thanks tptacek) is https://www.youtube.com/watch?v=nfY0lrdXar8

A quick google for "3blue1brown awesome github" (my usual strategy for finding good similar content) landed me here: https://github.com/rossant/awesome-math

The awesome lists are pretty good starting points for finding good content, but there's a ton of them of variable quality, so you end up with stuff like this: https://github.com/jonatasbaldin/awesome-awesome-awesome (which has 68 forks...)

The video on L'Hopital's rule, and the one on Fourier transform, helped me intuitively understand those topics for the very first time ever. And I'm years out of school and have no need to use those concepts in work again, yet I watched them just to understand what was always a mystery to me in class at the time.
If you are doing signal processing (Laplace and Fourier transforms especially) and want to gain an intuitive sense of Complex Analysis, I recommend the book Visual Complex Analysis by Tristan Needham.
If you mean "gaps in my education" or "basic things that I don't quite understand", you could try studying some high-quality texts. Look for books written by extremely smart people who are trying to explain the ideas rather than taking you through the standard topics. Hamming's books on probability and signal processing and Strang's books on linear algebra and applied math come to mind.

Alternatively if you're really interested in intuition, you could also look at the Math Olympiads. Pick a problem, beat your head on it, finally look at the solution, repeat. There are web sites and prep books.

Are the Math olympiads similar to competitive coding?
Yeah.

At the high school and college level, the Olympiads for math and CS are pretty analogous. But there's really popular semi-formal coding contests which exist outside academia which don't really have a math equivalent.

I'd say math contests are more popular among high schoolers, and semi-formal coding contests more popular among college students.

Art of Problem Solving (AoPS) [https://artofproblemsolving.com/] is a really good resource, and there's a very healthy online community.

They're also similar in how olympiads are different from the "real thing" (TM).

Academia.SE discussion about this [https://academia.stackexchange.com/questions/86451/does-the-...]

As someone who did math olympiads in high school, my 2 cents is that they're a fantastic way to learn how to solve and approach problems and gain intuition. And I'd say intuition mainly comes from solving problems.

Learn linear algebra properly. Like many folks on HN, I really enjoyed Axler's Linear Algebra Done Right, but ymmv. I got a ton out of going through each of the proofs + practice problems and really taking the time to work through the solutions. It wasn't enough for me to just read the text.

There's a linear algebra lurking everywhere in the realm of applied math (some people like to joke that machine learning is really just linear algebra) so it really is worth your time to have a firm understanding of it.

I used to love the abstract symbolic manipulation of pure math, but have not worked with it in many years and find it unintuitive now. I have a harder time trusting the abstractions. I wonder how to get my old sense back - it never, ever came from practice problems for example in the past. I miss proofs
It's probably too hard to answer the general question about "how to gain math intuition". Mathematics is just too vast.

However, you have written

> I think when I took physics it really brought out these flaws and lack of intuition

which suggests you have some good practical experience with physics problem solving which has precipitated a certain feeling that you need to learn more about some kind of math. I would advise that you try to exploit this. In the same breath I want to recognize (as someone who did their BS and MS in physics) that physicists are not always so careful or explicit in how they are doing their mathematics. So learning means eventually going beyond physics sources and into a much wider world of mathematical thought. The particular things that mathematicians care about may or may not be relevant to the problem you are trying to solve in physics, and a good part of developing that intuition is to figure out which particular caveats that a mathematician expounds upon (more often than not, some esoterica about the space(s) that they are working in or the class of isomorphisms under which their results are invariant) matter physically. As you develop and intuition about these things a bonus is that you will be able to skim through mathematics resources much faster.

My suggestion would be this. Assume that you have your intuition, already, and it is good.

May be it is distinct from others, may be you will not be 'narrowing' to the right answer within seconds -- like many folks who do Olympiads...

Just do basic things, but every other day. Get books/materials that have solutions (not just problems). use those, compare your results, and then try again.

If you feel like you do not understand 'why', you will need a particular subject area. Switch to read about applications of that area, how historically it came about and so.

And then back to problem solving, proofs, and reading other people's papers (when you can..).

It is hard work, but over time you will build up your version of the so called intuition, it will be powerful, you will be able to apply it all over the place.

Also there are a number of math forums where you can reach out, if you are really stuck and cannot figure out how a particular proof, or solution was obtained.

A lot of intuition in math is from geometry. High school plane geometry is a good start, but high school solid geometry, where get good tools and intuition for seeing things in 3D instead of just the 2D of plane geometry, is quite a bit better.

Another part of intuition is from Max Zorn (from Zorn's lemma statement of the axiom of choice):

"Be wise, generalize."

E.g., for the set of real numbers R and a positive integer n, a lot that goes on in the n-dimensional vector space R^n is a generalization of what can see in 3D, e.g., from solid geometry.

E.g., in both cases, a biggie is a perpendicular (orthogonal) projection and, again, the Pythagorean theorem. E.g., regression in statistics is a perpendicular projection.

Perpendicular (orthogonality) is a biggie and is a major part of, say, Fourier series. I.e., each of the sine/cosine waves used is an orthogonal axis, and to find the corresponding Fourier series coefficient just project onto that axis. The projection is an integral of a product, and that is commonly an inner product which close to just a cosine of an angle as in plane and solid geometry and a perpendicular projection and close to correlation in statistics, etc.

E.g., a huge fraction of applied math is from analysis in pure math, and from G. F. Simmons the two pillars of analysis are "continuity and linearity". Linearity generalizes enormously: The quantum mechanics super position is essentially linearity. Under meager assumptions, differentiation and integration in calculus are linear operators. In probability theory, expectation is a linear operator. The wave equation is a linear partial differential equation. Linear programming works on linear equations. Of course, in linear algebra, matrix multiplication is a linear operator. When something is not linear, it may be locally linear which can be enough to get useful results.

For more, a good lesson is to approximate: Commonly we can't get just what we want in just one step but can iterate and approximate as closely as we please. So, can use simple things, sine waves, polynomials, continuous functions, and more, as means of approximation. Such approximation gets us close to more in continuity and, in particular, completeness -- the real numbers are complete and the rational numbers are not but via iteration can approximate the reals as closely as we please. Then this generalizes: The big point about Hilbert space (as mathematicians but not always physicists define it) is completeness. A joke, partly correct, is that "calculus is the elementary consequences of the completeness property of the real number system". E.g., the integral in calculus (and its better version in measure theory) is defined in terms of an iterative approximation. So, if you are good with sine waves, polynomials, continuous functions, wavelets, and more, then you can iterate and approximate a lot, in many cases, everything there is in that case.

I'm going to answer this assuming you mean gaining number sense, which is something I didn't realize I was missing until I gained it.

I got my undergrad in math and physics. I was good at math. It wasn't until I had been teaching high school for 3-4 years when some gave me a copy of Shortcut Math by Gerard Kelly. After reading it and practicing the techniques, arithmetic made so much sense. I was able to easily add, subtract, and multiply larger numbers in my head.

Interestingly enough, many of the techniques taught in this book are also part of the common core math curriculum. It's a way to help students gain number sense.

What exactly is your goal?

I think that the way to get math intuition is to learn a mathematical language, like Julia, and play around with it. Plot things. Change parameters.

Also learn a theorem prover. Maybe Agda or Coq or Lean.

For a small buffet of abstract math topics (with lots of exposition putting ideas into historical context and an emphasis on building geometric intuition) try Courant & Robbins "What is Mathematics?". Covers number theory, number systems, geometry, topology, optimization, algebra, and knots, among others. You could also play around with branches of math like Knot and Braid Theory, which are interesting in their own right, give insight into lots of different branches of math, and many interesting problems are still accessible to lay people. Number theory is also like this

I think it can also be helpful to learn some things about the history of math and the historical context that different ideas came from. Here's a nice example covering complex numbers https://www.youtube.com/watch?v=T647CGsuOVU

Maybe tangential to your ends, but the Crest of the Peacock is a nice book on non-European mathematical traditions, which provides some insight into how the process of establishing and validating mathematical knowledge works in other cultures.

You might try books written by physicists or that are about mathematical physics (an author to look out for depending on your level is VI Arnold), since arguments will be of a more geometric or physical nature and appeal more to intuition. Stillwell is another author (not a physicist) that tends to write books that give context and geometric intuition

You might like playing around with Pinter & Humphreys for Algebra, or Jänich for Topology (fantastic book for building intuition around topology).

Math is big. A good place to start building your intuition may be by learning proofs. I‘m currently revisiting math by working through Chartrand [0]. As a non-mathematician, I would recommend this text as a foundation, and a possible bridge to advanced subjects.

[0] Mathematical Proofs: A Transition to Advanced Mathematics https://g.co/kgs/stSmxJ

I'm interested in building up math intuition too. I'm engaging with math very slowly and just as a hobby, but part of what got me interested was encountering resources that are unreasonably effective at building intuition.

A common theme I have noticed is whatever it is, getting a geometric understanding of it aids intuition significantly. Others have mentioned the 3Blue1Brown videos. They are an excellent example of this.

These HN threads always bear out great resources and I've made note of (and acquired) a few of these, so I'll list them here.

Burn Maths Class - https://www.goodreads.com/book/show/26195956-burn-math-class

Book of Proof - https://www.people.vcu.edu/~rhammack/BookOfProof/

The Topology Of Numbers (number theory)- http://pi.math.cornell.edu/~hatcher/TN/TNpage.html

The Evolution of Trust (game theory) - https://ncase.me/trust/

Visual Information Theory - https://colah.github.io/posts/2015-09-Visual-Information/

Information Theory For Smarties - http://tuvalu.santafe.edu/~simon/it.pdf

Abstract Algebra - https://www.youtube.com/playlist?list=PLi01XoE8jYoi3SgnnGorR...

Algebra Cheatsheet - https://argumatronic.com/posts/2019-06-21-algebra-cheatsheet...

Control Theory Basics - https://www.youtube.com/user/ControlLectures/playlists

Related question, anyone know any good resources for learning and developing intuition in Abstract Algebra? Especially ones that explain it well, like Calculus Made Easy did for Calculus. AA is a prereq for cryptography, category theory and and other areas of interest for CompSci.

I asked this a few weeks ago but at an off peak time and not many folks saw the question. But I know HN probably has good recommendations so trying again here. Should still be relevant and helpful to OP.

https://news.ycombinator.com/item?id=20733422

Take a look at "A Book of Abstract Algebra" by Charles Pinter. It's published by Dover, so very affordable. I've seen it criticized as too verbose, but that worked for me.
Thanks! Verbose is fine, the more explanatory the better.
It has been my experience that complaints about a source being "too verbose" rarely come from people learning the subject.
The YouTube playlist on AA I linked has some extremely clear explanations. Depending on your level of familiarity already ymmv. I certainly got quite a lot out of it.
I run a 1-on-1 remote mentoring/teaching business where I teach the intuition and reasoning (including some history) behind mathematics, physics, and computer science. If you are interested in a full level overview into higher level mathematics, starting with set theory, reach out to me. We can organize an arrangement that suits your needs, desires, and schedule.

Shoot an email over to codertutor@gmail.com or text or call +1-718-360-3176 if you are interested or if you have any questions.

This is my print flyer for reference: https://i.imgur.com/Gdwa7m9.png

Looking forward to hearing from you.

Try finding a cool research paper that contains a lot of math you don’t understand. Then spend a few months learning the math in that one paper until you get it. That is a highly motivating and enjoyable way to learn. Far better than textbooks. I did this to learn algebraic topology.
I've been trying to penetrate algebraic topology for a bit now (learning barcodes and such). Any suggestions on papers you think are particularly good?
I was obsessed with topological data analysis which is basically applied algebraic topology, so I read every paper I could find on TDA. All of them were mostly incomprehensible to me at first, but by working backward, e.g. "What's a homology group?" Oh I need to learn some basic group theory first. Oh what's a Cayley graph? I kept working backward and forward until I could piece it all together. Working backward from a specific goal was very motivating compared to just working through a textbook aimlessly.
I think this is an awesome idea.

Im sort of taking the approach of learning the definitions of things via Anki in a real exploratory way. Just read about something that takes my fancy then I keep finding I run into definitions I've learned before and this time something that was previously gibberish made more and more sense.

Recently I read the paper posted here about how an optimal regulator needs to model what it's trying to regulate. I was amazed at how much more of it I had access to due to learning some definitions here and there.

I've picked up a Rubik's cube lately and am learning group theoretic concepts to help me solve it. I'm finding it a neat way to engage with the maths in a practical way too!

This isn't an answer, but an observation. I taught an EE course many years ago -- the second semester of electrodynamics. This was after being a college math major, and getting a physics degree.

It doesn't shock me that there are holes. I noticed that some math topics are very important to engineering and physics coursework, but given short shrift in the math department. Examples are the way that complex numbers are used, and specific kinds of differential equations such as the general harmonic oscillator.

My college physics coursework actually had its own "math methods" class, intended to fill some of those gaps, and to get us prepared for the higher level physics courses.

You'll find the complementary opinion in Mathematics departments -- a general chagrin about the type of mathematics that they have to teach in their service courses for engineers.

Mathematics is a very general tool. As with any very general tool, a lot of the devil is in the details of how to use it in any particular domain.

For this reason, in-sourcing mathematics service courses is best for everyone. The very best math-adjacent departments in every field tend to do this either directly or indirectly. E.g., in the direct model, many CS departments internalize the Discrete Mathematics course and some combinatorics. And an example of the indirect model is Mathematics departments that hire Math Finance professors to cover the service load for econ/fin/bus depts.

I think this in-sourcing (either directly or indirectly) is best for everyone -- mathematics depts don't do a good job at teaching those service courses and often don't do a great job of it in any case. Unfortunately, most departments don't have the headcount (in students or faculty) for a specialized mathematics curriculum, so they have to share the math faculty with N other majors to predictable effect.