Statistical mechanics
Heat an empty oven and its walls glow, filling the inside with light. Classical physics can predict how much light of each colour there should be, and its answer is absurd: an infinite amount of energy, piling up at ever shorter wavelengths, in every warm oven in the world. Physicists called it the ultraviolet catastrophe.
The prediction rested on a principle of statistical mechanics called equipartition. This chapter builds statistical mechanics from counting, shows where equipartition comes from, and shows exactly where it breaks. In 1900 Max Planck fixed the oven by assuming energy comes in lumps, and quantum physics was born.
Entropy is counting
A solid can be pictured as many atoms, each jiggling as an oscillator that holds whole units of energy, as Einstein assumed in 1907. Share a fixed number of units among the oscillators at random and keep letting them pass units back and forth. .
Whatever the start, the system settles into the most likely kind of arrangement, the one that can happen in the most ways. Ludwig Boltzmann defined entropy as the logarithm of that count, :
The histogram on the plate shows how many oscillators hold 0, 1, 2… units. It falls off exponentially, the fingerprint of thermal equilibrium.
The Boltzmann factor
That exponential is general. A small system in contact with a large one at temperature is found in a state of energy with probability
The normalizing sum , the partition function, turns out to contain all of thermodynamics. For a system with just two levels a gap apart, set the temperature to 1.00 times : the upper level holds 27%. Cold, everything sits at the bottom. Hot, the two levels approach equal shares, but never more up than down.
How fast molecules move
Apply the Boltzmann factor to the kinetic energy of gas molecules and you get the Maxwell–Boltzmann distribution of speeds. At 300 K, nitrogen molecules, most of the air around you, most often move at 422 m/s: faster than a passenger jet, colliding billions of times a second.
Equipartition, and where it fails
A consequence of the Boltzmann factor is equipartition: at temperature , every independent quadratic term in the energy, such as or , holds on average . It predicts that the heat capacity of a solid is , which works well at room temperature.
But cold solids, and diamond even at room temperature, have heat capacities far below that. Einstein explained this in 1907 by letting each oscillator hold only whole quanta of energy: when is smaller than one quantum, the oscillators cannot take any heat, and the heat capacity collapses. The plate compares the classical prediction with Einstein’s curve.
The oven is the same story. Light in a box has infinitely many modes of ever shorter wavelength; giving each one gives infinite energy. Planck’s quanta freeze out the short-wavelength modes, and the catastrophe disappears. Established
A magnet that decides
The Ising model is a grid of tiny magnets, each pointing up or down, each preferring to agree with its neighbours. The plate runs it with the Metropolis method: pick a magnet, flip it if that lowers the energy, and if it raises the energy, flip it anyway with probability .
Set the temperature to 1.80. Below about 2.27 (Lars Onsager’s exact result for this grid) large domains form and the whole grid magnetizes; above it, order dissolves into noise. A sudden change like this, emerging from simple local rules, is a phase transition.
Seeing atoms jostle
A pollen grain in water jiggles endlessly. In 1905 Einstein explained this Brownian motion as the grain being kicked at random by water molecules, and predicted that its typical distance from the start grows as the square root of time. The plate shows such a walker. In 1908–09 Jean Perrin measured the motion under a microscope, extracted Avogadro’s number from it, and convinced the remaining sceptics that atoms are real. Established
A preview: quantum counting
Quantum particles of the same kind are truly identical, and that changes the counting. Particles like electrons, fermions, cannot share a state, and fill levels according to the Fermi–Dirac distribution. Particles like photons, bosons, prefer to crowd into the same state, following Bose–Einstein. At high temperature both reduce to Boltzmann. These two rules explain metals, white dwarf stars, lasers and superfluids, and they are the subject of Part One.
What you now have
Entropy as counting, the Boltzmann factor and partition function, the Maxwell–Boltzmann speeds, equipartition and its quantum failure, phase transitions, and Brownian motion.
· · ·
Three questions to carry with you.
And one to work out. For two levels with , what is the ratio of upper to lower population?
Sources: D. V. Schroeder, An Introduction to Thermal Physics. A. Einstein, Ann. Phys. 17, 549 (1905) and 22, 180 (1907). J. Perrin, Ann. Chim. Phys. 18, 5 (1909). L. Onsager, Phys. Rev. 65, 117 (1944). Checked by code: Tc = 2.269; N₂ most probable speed 422 m/s at 300 K.