Lay question about entropy
Moderators: gmalivuk, Moderators General, Prelates
Lay question about entropy
Greetings,
I don't understand something. According to what I've read, there's a law that states things progress from an ordered state to a disordered state. But according to some shows I've seen, early after or during the Big Bang, there was just a sort of chaotic energy soup before atoms formed and began to clump together forming stars which in turn formed more complex elements and eventually led to the complexity of the human brain, which in spite of all appearances to the contrary in the YouTube comments section, seems to be pretty damned ordered. Like, incredibly ordered.
So how does entropy hold up when we've gone from chaos to a bunch of brains that can work together to discover the secrets of the universe? What am I missing?
I don't understand something. According to what I've read, there's a law that states things progress from an ordered state to a disordered state. But according to some shows I've seen, early after or during the Big Bang, there was just a sort of chaotic energy soup before atoms formed and began to clump together forming stars which in turn formed more complex elements and eventually led to the complexity of the human brain, which in spite of all appearances to the contrary in the YouTube comments section, seems to be pretty damned ordered. Like, incredibly ordered.
So how does entropy hold up when we've gone from chaos to a bunch of brains that can work together to discover the secrets of the universe? What am I missing?
Re: Lay question about entropy
That's life for you.
Entropy increases for the whole system, but it can always decrease locally, at the cost of even more entropy somewhere else (aka expenditure of energy).
Life could be defined as such an ordering process. In fact, everything life does is directed towards gathering energy and expending it to create order.
Entropy increases for the whole system, but it can always decrease locally, at the cost of even more entropy somewhere else (aka expenditure of energy).
Life could be defined as such an ordering process. In fact, everything life does is directed towards gathering energy and expending it to create order.
Re: Lay question about entropy
Entropy is not order.
I know that entropy is often explained as being a measure of order, and that works out for a few simple examples.
But is it really more ordered to have all the particles of the universe randomly strewn about on planets and stars? I know that when my socks are randomly dispersed across the room, I consider that less ordered than a homogenous stack of socks. So shall we consider the homogenous particle soup ordered or unordered?
tl;dr: You can't use an intuition of order to determine entropy. You need to count microstates, put them into the formula and then you have it. And then you'll figure out that the total entropy has continually increased since the big bang. Local decreases are not a problem, only the total entropy of a system counts.
I know that entropy is often explained as being a measure of order, and that works out for a few simple examples.
But is it really more ordered to have all the particles of the universe randomly strewn about on planets and stars? I know that when my socks are randomly dispersed across the room, I consider that less ordered than a homogenous stack of socks. So shall we consider the homogenous particle soup ordered or unordered?
tl;dr: You can't use an intuition of order to determine entropy. You need to count microstates, put them into the formula and then you have it. And then you'll figure out that the total entropy has continually increased since the big bang. Local decreases are not a problem, only the total entropy of a system counts.
- doogly
- Dr. The Juggernaut of Touching Himself
- Posts: 5362
- Joined: Mon Oct 23, 2006 2:31 am UTC
- Location: Somerville, MA
- Contact:
Re: Lay question about entropy
We don't need the word life at all though, we just need the universe to be expanding and cooling. The entropy of the whole system is still increasing during this process. It is totally a very exciting chapter in Mukhanov's book. I recommend it if you are not in fact a lay person, but a grad student testing us.
https://www.amazon.com/Physical-Foundat ... DG7W1AF3B9
If you are actually a lay person, Carroll's book is p aight
https://www.amazon.com/Eternity-Here-Qu ... an+carroll
The only thing unsatisfying with this story is that maybe you also don't want the initial state to be very low entropy. You might like to think that a good initial state would be one that is "generic", and since low entropy states are "special", we are doing a shell game with our explanations. But we really do like entropy increasing, so thinking it was initially v v low is not a weird thought. Just, yeah, the cosmological implications do have some prickles.
https://www.amazon.com/Physical-Foundat ... DG7W1AF3B9
If you are actually a lay person, Carroll's book is p aight
https://www.amazon.com/Eternity-Here-Qu ... an+carroll
The only thing unsatisfying with this story is that maybe you also don't want the initial state to be very low entropy. You might like to think that a good initial state would be one that is "generic", and since low entropy states are "special", we are doing a shell game with our explanations. But we really do like entropy increasing, so thinking it was initially v v low is not a weird thought. Just, yeah, the cosmological implications do have some prickles.
LE4dGOLEM: What's a Doug?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Re: Lay question about entropy
doogly wrote:If you are actually a lay person, Carroll's book is p aight
Can confirm that his book "The Big Picture" is a good read for lay persons. His older book "From Eternity to Here" probably has more details on entropy, but I haven't read it. Can also recommend searching talks from Sean Carroll on youtube. His talks (i.e. not his lectures) are pretty laymen friendly. Can also recommend his blog.
- Eebster the Great
- Posts: 2893
- Joined: Mon Nov 10, 2008 12:58 am UTC
Re: Lay question about entropy
doogly wrote:The only thing unsatisfying with this story is that maybe you also don't want the initial state to be very low entropy. You might like to think that a good initial state would be one that is "generic", and since low entropy states are "special", we are doing a shell game with our explanations. But we really do like entropy increasing, so thinking it was initially v v low is not a weird thought. Just, yeah, the cosmological implications do have some prickles.
More specifically, the same statistical argument that shows that entropy is likely to be higher in the future also shows that, if we knew nothing about the past, we would expect it to be higher in the past as well. There ought to be some good reason why it was lower in the past (indeed, why it was extremely low following the Big Bang).
- doogly
- Dr. The Juggernaut of Touching Himself
- Posts: 5362
- Joined: Mon Oct 23, 2006 2:31 am UTC
- Location: Somerville, MA
- Contact:
Re: Lay question about entropy
I think you'd only expect that if the past were also infinite.
LE4dGOLEM: What's a Doug?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
- Eebster the Great
- Posts: 2893
- Joined: Mon Nov 10, 2008 12:58 am UTC
Re: Lay question about entropy
doogly wrote:I think you'd only expect that if the past were also infinite.
How do you figure?
- doogly
- Dr. The Juggernaut of Touching Himself
- Posts: 5362
- Joined: Mon Oct 23, 2006 2:31 am UTC
- Location: Somerville, MA
- Contact:
Re: Lay question about entropy
Normally, forward in time is increase in entropy. You'd only say forward and backwards in time are going to look the same if you are in some eternal steady state, and you think it's just as likely that you're on the upswing or the downswing of a fluctuation.
LE4dGOLEM: What's a Doug?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
- somitomi
- Posts: 526
- Joined: Fri Nov 06, 2015 11:21 pm UTC
- Location: can be found in Hungary
- Contact:
Re: Lay question about entropy
Despite having passed Thermodynamics I. at university, my understanding of entropy comes mainly from this video The gist of it is that things can be disordered and complex at the same time (see also: my room).
—◯-◯
- doogly
- Dr. The Juggernaut of Touching Himself
- Posts: 5362
- Joined: Mon Oct 23, 2006 2:31 am UTC
- Location: Somerville, MA
- Contact:
Re: Lay question about entropy
"Complexity" is just very difficult to define in any physically meaningful way.
LE4dGOLEM: What's a Doug?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
- Eebster the Great
- Posts: 2893
- Joined: Mon Nov 10, 2008 12:58 am UTC
Re: Lay question about entropy
doogly wrote:Normally, forward in time is increase in entropy.
Well empirically, yes, but there is nothing in statistical mechanics that demonstrates that this ought to be the case in general, classical physics being time-symmetrical and all.
- doogly
- Dr. The Juggernaut of Touching Himself
- Posts: 5362
- Joined: Mon Oct 23, 2006 2:31 am UTC
- Location: Somerville, MA
- Contact:
Re: Lay question about entropy
Passing to the statistical case breaks the reversability of the microphysics though
LE4dGOLEM: What's a Doug?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
- Eebster the Great
- Posts: 2893
- Joined: Mon Nov 10, 2008 12:58 am UTC
Re: Lay question about entropy
doogly wrote:Passing to the statistical case breaks the reversability of the microphysics though
What do you mean? Microscopic physics is still reversible, unless you think weak CP violation explains the arrow of time.
- doogly
- Dr. The Juggernaut of Touching Himself
- Posts: 5362
- Joined: Mon Oct 23, 2006 2:31 am UTC
- Location: Somerville, MA
- Contact:
Re: Lay question about entropy
Right, but entropy isn't a thing in the microscopic picture, it's only defined in a statistical sense, at which point you break the reversability.
LE4dGOLEM: What's a Doug?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Re: Lay question about entropy
I think they meant something like (and I'm going to say this very poorly)
that even if the "time progressing" function is a bijection, that if some macrostates have more possible microstates than others, that the output of the function will be a microstate of a macrostate with more possible microstates more often than of one with fewer possible microstates.
I think?
whoops, they explained themself while I was writing this
that even if the "time progressing" function is a bijection, that if some macrostates have more possible microstates than others, that the output of the function will be a microstate of a macrostate with more possible microstates more often than of one with fewer possible microstates.
I think?
whoops, they explained themself while I was writing this
I found my old forum signature to be awkward, so I'm changing it to this until I pick a better one.
-
- Posts: 7073
- Joined: Thu Jun 03, 2010 12:21 am UTC
Re: Lay question about entropy
Well that got technical really quickly. Ginsberg's Theorem is an amusing take on it. In a practical sense it's why, no matter how long you wait, your coffee will never get any warmer, unless you add heat. The most common use of of the principle, at least that most people will recognize, is in their AC. The concept is enshrined in the bureaucracy, it's used by the patent office to weed out perpetual motion machines. Our brain had a chance to evolve because because we had a heat source.
- Eebster the Great
- Posts: 2893
- Joined: Mon Nov 10, 2008 12:58 am UTC
Re: Lay question about entropy
doogly wrote:Right, but entropy isn't a thing in the microscopic picture, it's only defined in a statistical sense, at which point you break the reversability.
But the statistics of reversible physics can only be irreversible in peculiar circumstances. In the overwhelming majority of circumstances, they will be symmetrical. So that does not answer the question of why our particular circumstance is so extremely peculiar. It is predictable only in reference to another even more peculiar circumstance at another point in time (which we call the past). The fact that entropy is lower in the past and higher in the future cannot be predicted by statistics alone.
To put it another way, if we take a tenseless view of the universe, and we pick some point in time at random, we can equally well predict that the entropy at any other nearby point in time will be equal or greater. There is no law saying that it must be higher moving in one direction and lower moving in the other.
Re: Lay question about entropy
Eebster the Great wrote:To put it another way, if we take a tenseless view of the universe, and we pick some point in time at random, we can equally well predict that the entropy at any other nearby point in time will be equal or greater. There is no law saying that it must be higher moving in one direction and lower moving in the other.
Careful with "picking at random". If we live in a universe where the overwhelming parts are in thermal equilibrium, then we predict the opposite - entropy in either direction from a random point should be equal or less.
- Eebster the Great
- Posts: 2893
- Joined: Mon Nov 10, 2008 12:58 am UTC
Re: Lay question about entropy
Tub wrote:Eebster the Great wrote:To put it another way, if we take a tenseless view of the universe, and we pick some point in time at random, we can equally well predict that the entropy at any other nearby point in time will be equal or greater. There is no law saying that it must be higher moving in one direction and lower moving in the other.
Careful with "picking at random". If we live in a universe where the overwhelming parts are in thermal equilibrium, then we predict the opposite - entropy in either direction from a random point should be equal or less.
In such a universe, what I said is still technically true. Entropy cannot decrease any more often than it increases in such a case, and regardless, most of the time it will remain constant.
- Zamfir
- I built a novelty castle, the irony was lost on some.
- Posts: 7384
- Joined: Wed Aug 27, 2008 2:43 pm UTC
- Location: Nederland
Re: Lay question about entropy
But the statistics of reversible physics can only be irreversible in peculiar circumstances. In the overwhelming majority of circumstances, they will be symmetrical. So that does not answer the question of why our particular circumstance is so extremely peculiar.
Is 'majority of circumstances' really a meaningful concept, here? For all we know, every theoretically possible universe has to start out like this. 'Start' is perhaps not the right word, just that every universe has to have a big-bang state somewhere, and the region of time near that event will have an observable arrow of time.
- doogly
- Dr. The Juggernaut of Touching Himself
- Posts: 5362
- Joined: Mon Oct 23, 2006 2:31 am UTC
- Location: Somerville, MA
- Contact:
Re: Lay question about entropy
Zamfir wrote:Is 'majority of circumstances' really a meaningful concept, here?
Is it time for the measure problem? Is it time?

LE4dGOLEM: What's a Doug?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
-
- Posts: 855
- Joined: Fri Feb 07, 2014 3:15 pm UTC
Re: Lay question about entropy
Just wondering, does empty space* count as high entropy or low entropy?
*To anyone about to bring up quantum physics: shut up, you know what I mean and this is hard enough as it is without you bringing up a technicality from a different branch of physics.
*To anyone about to bring up quantum physics: shut up, you know what I mean and this is hard enough as it is without you bringing up a technicality from a different branch of physics.
- doogly
- Dr. The Juggernaut of Touching Himself
- Posts: 5362
- Joined: Mon Oct 23, 2006 2:31 am UTC
- Location: Somerville, MA
- Contact:
Re: Lay question about entropy
The entropy of classical empty space is 0.
A classical vacuum is super boring, and you cannot avoid quantum mechanics for very long here.
A classical vacuum is super boring, and you cannot avoid quantum mechanics for very long here.
LE4dGOLEM: What's a Doug?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
- Eebster the Great
- Posts: 2893
- Joined: Mon Nov 10, 2008 12:58 am UTC
Re: Lay question about entropy
Zamfir wrote:But the statistics of reversible physics can only be irreversible in peculiar circumstances. In the overwhelming majority of circumstances, they will be symmetrical. So that does not answer the question of why our particular circumstance is so extremely peculiar.
Is 'majority of circumstances' really a meaningful concept, here? For all we know, every theoretically possible universe has to start out like this. 'Start' is perhaps not the right word, just that every universe has to have a big-bang state somewhere, and the region of time near that event will have an observable arrow of time.
That might be true, but it's not something you can derive from statistical mechanics, which is my point. Statistical mechanics do not explain the arrow of time as is often claimed. The low entropy of the Big Bang does.
- WibblyWobbly
- Can't Get No
- Posts: 506
- Joined: Fri Apr 05, 2013 1:03 pm UTC
Re: Lay question about entropy
doogly wrote:The entropy of classical empty space is 0.
A classical vacuum is super boring, and you cannot avoid quantum mechanics for very long here.
So, quantum mechanics in a vacuum is like Liam Neeson looking for his daughter?

- doogly
- Dr. The Juggernaut of Touching Himself
- Posts: 5362
- Joined: Mon Oct 23, 2006 2:31 am UTC
- Location: Somerville, MA
- Contact:
Re: Lay question about entropy
It is probably not the worst analogy someone has tried to use for quantum mechanics.
LE4dGOLEM: What's a Doug?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
Noc: A larval Doogly. They grow the tail and stinger upon reaching adulthood.
Keep waggling your butt brows Brothers.
Or; Is that your eye butthairs?
- WibblyWobbly
- Can't Get No
- Posts: 506
- Joined: Fri Apr 05, 2013 1:03 pm UTC
Re: Lay question about entropy
doogly wrote:It is probably not the worst analogy someone has tried to use for quantum mechanics.
Oh, I've certainly heard worse. Mostly from mainstream reporting on quantum mechanics. But they generally try to succeed and fail, where as I was trying to fail and succeeded. We're all winners.
- Soupspoon
- You have done something you shouldn't. Or are about to.
- Posts: 2963
- Joined: Thu Jan 28, 2016 7:00 pm UTC
- Location: 53-1
Re: Lay question about entropy
WibblyWobbly wrote:doogly wrote:The entropy of classical empty space is 0.
A classical vacuum is super boring, and you cannot avoid quantum mechanics for very long here.
So, quantum mechanics in a vacuum is like Liam Neeson looking for his daughter?
"I don't know who you are. I don't know what you want. At least not at the same time. If you are looking for discrete values, I can tell you I don't have precision. But what I do have are a very particular set of interference patterns, interference patterns I have acquired over a very large light-cone. Interference patterns that make me a probability amplitude for superpositions like you. If you let my wave/particle duality go now, that'll be the end of it. I will not collapse your waveform for you, I will not entangle you. But if you don't, I will observe you, I will resolve your momentum, and I will cohere you."
- WibblyWobbly
- Can't Get No
- Posts: 506
- Joined: Fri Apr 05, 2013 1:03 pm UTC
Re: Lay question about entropy
Soupspoon wrote:WibblyWobbly wrote:doogly wrote:The entropy of classical empty space is 0.
A classical vacuum is super boring, and you cannot avoid quantum mechanics for very long here.
So, quantum mechanics in a vacuum is like Liam Neeson looking for his daughter?
"I don't know who you are. I don't know what you want. At least not at the same time. If you are looking for discrete values, I can tell you I don't have precision. But what I do have are a very particular set of interference patterns, interference patterns I have acquired over a very large light-cone. Interference patterns that make me a probability amplitude for superpositions like you. If you let my wave/particle duality go now, that'll be the end of it. I will not collapse your waveform for you, I will not entangle you. But if you don't, I will observe you, I will resolve your momentum, and I will cohere you."
Good luck.
Who is online
Users browsing this forum: No registered users and 6 guests