Thermodynamics of Prediction

A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations, and a fraction of this information is predictive of future ones. The remaining nonpredictive information reflects model complexity that does not improve predictive power, and thus represents the ineffectiveness of the model. We expose the fundamental equivalence between this model inefficiency and thermodynamic inefficiency, measured by dissipation. Our results hold arbitrarily far from thermodynamic equilibrium and are applicable to a wide range of systems, including biomolecular machines. They highlight a profound connection between the effective use of information and efficient thermodynamic operation: any system constructed to keep memory about its environment and to operate with maximal energetic efficiency has to be predictive.

A mathematical theory ofcommunicationA mathematical theory of communicationOn Information andSufficiencyOn Information and SufficiencyInferring statisticalcomplexityInferring statistical complexityProbability of secondlaw violations in…Probability of second law violations in shearing steady statesNonequilibriumMeasurements of Free…Nonequilibrium Measurements of Free Energy Differences for Microscopically Reversible Markovian SystemsEntropy productionfluctuation theorem and…Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differencesEquilibrium Informationfrom Nonequilibrium…Equilibrium Information from Nonequilibrium Measurements in an Experimental Test of Jarzynski's EqualityVerification of theCrooks fluctuation…Verification of the Crooks fluctuation theorem and recovery of RNA folding free energiesInformation-theoreticapproach to interactive…Information-theoretic approach to interactive learningEqualities andInequalities…Equalities and Inequalities: Irreversibility and the Second Law of Thermodynamics at the NanoscaleAn information-theoreticapproach to…An information-theoretic approach to curiosity-driven reinforcement learningBiophysics: Searchingfor PrinciplesBiophysics: Searching for PrinciplesInformationThermodynamics on Causa…Information Thermodynamics on Causal NetworksRole of mutualinformation in entropy…Role of mutual information in entropy production under information exchangesEfficiency of cellularinformation processingEfficiency of cellular information processingThermodynamic Costs ofInformation Processing…Thermodynamic Costs of Information Processing in Sensory AdaptationInformation BottleneckApproach to Predictive…Information Bottleneck Approach to Predictive InferenceThermodynamics withContinuous Information…Thermodynamics with Continuous Information FlowThermodynamic andlogical reversibilities…Thermodynamic and logical reversibilities revisitedThermodynamics ofinformationThermodynamics of informationSensory capacity: Aninformation theoretical…Sensory capacity: An information theoretical measure of the performance of a sensorThe Free EnergyRequirements of…The Free Energy Requirements of Biological Organisms; Implications for EvolutionStochastic TimeEvolution, Information…Stochastic Time Evolution, Information Geometry, and the Cramér-Rao BoundEnergy and informationflows in autonomous…Energy and information flows in autonomous systemsThermodynamics ofPredictionThermodynamics of PredictionEarlier referencesFocus paperCiting papersOlderNewer

Click a node to pin it, click the empty canvas to go back to this paper, or hover to preview. Open a node’s page from its title.