Entropy as a Measure of the Multiplicity of a System

The probability of finding a system in a given state depends upon the multiplicity of that state. That is to say, it is proportional to the number of ways you can produce that state. Here a "state" is defined by some measurable property which would allow you to distinguish it from other states. In throwing a pair of dice, that measurable property is the sum of the number of dots facing up. The multiplicity for two dots showing is just one, because there is only one arrangement of the dice which will give that state. The multiplicity for seven dots showing is six, because there are six arrangements of the dice which will show a total of seven dots.

One way to define the quantity "entropy" is to do it in terms of the multiplicity.

where k is Boltzmann's constant. The k is included as part of the historical definition of entropy and gives the units Joule/Kelvin in the SI system of units. The logarithm is used to make the defined entropy of reasonable size. The multiplicity for ordinary collections of matter are on the order of Avogadro's number, so using the logarithm of the multiplicity is convenient.

For a system of a large number of particles, like a mole of atoms, the most probable state will be overwhelmingly probable. You can with confidence expect that the system at equilibrium will be found in the state of highest multiplicity since fluctuations from that state will usually be too small to measure. As a large system approaches equilibrium, its multiplicity (entropy) tends to increase. This is a way of stating the second law of thermodynamics.

Entropy in Terms of Heat and Temperature

The relationship which was originally used to define entropy S is

This is often a sufficient definition of entropy if you don't need to know about the microscopic details. It can be integrated to calculate the change in entropy during a part of an engine cycle. For the case of an isothermal process it can be evaluated simply by ΔS = Q/T.

In this context, a the change in entropy can be described as the heat added per unit temperature and has the units of Joules/Kelvin (J/K) or eV/K.