It's not so much an explanation of magnetism as a meta-discursive about explanations, and why a "simple" explanation is often not really possible. (In this case because our notion of what is weird and requiring of an explanation ("things pushing things at a distance") and what is normal and not requiring one ("the glass doesn't fall through the table") aren't scientifically grounded).
I think it's precisely the situation seanhunter is describing in their example
An explanation can be simple yet difficult to understand.
At some point, you have a body of knowledge, your 'understanding' that satisfies your curiosity (or you get exhausted and move on).
If you can't think of an example of the first case, most machine learning models suffice. Take a simple feed forward ReLU model. It's trivial to understand ReLU. It's nearly trivial to understand the individual neuron. Yet I, as someone who wrote their PhD thesis on neural architectures, would call bullshit on anyone claiming they "really" understand what's going on in a deep network.
And in physics, everything is reduced down to 'simple' forces of nature. A bunch of interactions and relationships that add up, and if you can keep up and perceive it all, you can sometimes stay ahead of all those interactions and imagine how it works through intelligence.
Eventually, you reach a state where you understand enough about the environment to translate ideas from one mind to another through language and your understanding of the world.
And so some will have deeper understandings, and in different areas, and all manner of conflict and resolution arises as people with different understandings try and understand one another.
There's no end in either direction you look, but zooming in always reveal some simple interactions at work.
> There's no end in either direction you look, but zooming in always reveal some simple interactions at work.
This is why I actually hate the phrase "from first principles". I can't tell you what the first principles are, but I can sure tell you that when someone says that they almost certainly are not starting from first principles and almost surely are (often unknowingly) making major assumptions. First principles are something you need to find, not start with.If you're in charge of budget, you probably put budget before some other minor concern. If you're in charge of delivering a software feature, bug, patch, etc, you probably put something else first. It all depends on when something is due, or if something could jeopardize long-term prospects.
Everyone is on the hook for something. First principles thinking might be: think of your customer, and what they expect. Will whatever it is I'm doing affect them over the long-term? What about short-term?
If there's no clear answer, there's a lot of latitude to do whatever you think is best.
I actually think this is why a lot of software is going to shit now (even before AI slop). There's supposed to be contention between marketers and engineers (and even contention between types of engineers). If the engineer has too much say you build a great product but make no money and the business flops. If the marketers have too much say you build absolute shit and make money but you also forefeet a lot of potential revenue (opportunity cost). I think currently we've given the marketers too much say. Every time I talk to engineers they ask me where the "value" of something is and there's a constant followup with "no, I understand this helps the user, but how does it make money?" That's not the primary job of the engineer. This also creates problems because if a marketer can't understand the "value" of something then it just doesn't get built. So it shifts the objectives while people don't recognize that there is this baked in bias.
To tie back, I think a lot of arguments come to an impasse because people are working with different priors but assuming the other party has the same priors. It isn't uncommon to see people on HN (or Reddit) arguing what are essentially duals of problems. We just think that because we are using the same language that we're actually communicating. Like you said, there's no clear answer. Most of the problems in the world have no global optima. So how do you solve them? You have to define your constraints. But I rarely see that actually happen, though when it does conversations are really efficient.
"Simple" therefore means "reduced in information content".
The topic being explained has a certain minimal information content, and if you reduce beyond that, you are telling a fiction which bears analogies to the topic.
A simpler description is not necessarily short; rather, it is a description of something simpler.
When descriptions (of a given complexity, being held constant) are short, that can make them harder to follow, because encodings have to be clever in order to achieve compression, and that has a complexity of its own.
The way I understand the problem with explaining things in simple terms is this: We usually introduce quantum mechanics students to a toy model -the infinite square well- to build up intuition. However, depending on the teacher and the students, it may well take years for those students to recognize and understand that the boundary conditions we apply to literally every other QM calculation are violated by the infinite square well, and while we ultimately recover the expected conclusion via successive approximations, it takes a much deeper understanding of the material to understand why the "simple" explanation is actually wrong. That is, while it turns out that the solution to the infinite-square well is, at the limit, identical to a very deep square well, showing that is actually quite a bit harder.
The simple explanation causes incorrect intution about the situation.
This is also where the ironic part of simple explanations arises. Whether the explanation serves any purpose depends on the alignment of the speaker and listener background knowledge. An explanation between two experts versed in the topic may seem coherent, concise, and meaningful while it fails to teach the concept to someone new.
Sadly, it also works between cranks, who can agree on misleading or incorrect explanations. Or, sometimes novice listeners can believe they've learned, but they learn a different crank concept than what the expert believes was being states. A good teacher needs to be aware of these potential problems, attempt to ascertain the background knowledge of the listener, and adjust the explanation for that background rather than their own teaching knowledge. And followup testing attempts to ascertain whether the new concept got delivered or not.
Now that we have novices asking LLMs for explanations, I find this all quite troubling in a practical sense.
I am a fan of old Science/Mathematics/CS books precisely for the reason that they are generally concise and succinct. There are no rambling asides/anecdotes, silly analogies, unnecessary pretty colourful pictures etc.
The best examples are the books from old Soviet-era "MIR Titles" and Dover Publications.
> There are no rambling asides/anecdotes, silly analogies, unnecessary pretty colourful pictures etc.
Obviously some go overboard and I won't defend that, but this style has been around for centuries. They won out because it's effective. People are "multimodal" if you willFor example, this video explaining fire, uploaded in January with a clickbait title, is AI: https://www.youtube.com/watch?v=vdop32yJqWg
Whereas this video explaining fire, uploaded 14 years ago, is real: https://www.youtube.com/watch?v=edQ08Eze0jM
14 years at least rules out certain techniques of video generation. With a little digging, we can find the original source is a 1983 BBC series called Fun to Imagine: https://www.bbc.co.uk/webarchive/https%3A%2F%2Fwww.bbc.co.uk...