Skip to main content
Article
Maximum Entropy and Constraints in Composite Systems
Physical Review E
  • John D. Ramshaw, Portland State University
Document Type
Article
Publication Date
2-14-2022
Subjects
  • Composite Systems
Disciplines
Abstract

The principle of maximum entropy (PME), as expounded by Jaynes, is based on the maximization of the Boltzmann-Gibbs-Shannon (BGS) entropy subject to linear constraints. The resulting probability distributions are of canonical (exponential) form. However, the rationale for linear constraints is nebulous, and probability distributions are not always canonical. Here we show that the correct noncanonical distribution for a system in equilibrium with a finite heat bath is implied by the unconstrained maximization of the total BGS entropy of the system and bath together. This procedure is shown to be equivalent to maximizing the BGS entropy of the system alone subject to a contrived nonlinear constraint which reduces to (a) the usual linear constraint for an infinite heat bath, and (b) a previously enigmatic logarithmic constraint which implies a power-law distribution for a large but finite heat bath. This procedure eliminates the uncertainty as to the proper constraints, and easily generalizes to arbitrary composite systems, for which it provides a simpler alternative to the Jaynes PME.

Description

This is the publisher's final pdf. Article appears in Physical Review E (http://pre.aps.org/) and is copyrighted by APS Journals (http://publish.aps.org/)

DOI
10.1103/PhysRevE.105.024138
Persistent Identifier
https://archives.pdx.edu/ds/psu/37396
Citation Information
Ramshaw, J. D. (2022). Maximum entropy and constraints in composite systems. Physical Review E, 105(2), 024138.