Amortized Inference in Probabilistic Reasoning

Recent studies of probabilistic reasoning have postulated general-purpose inference algorithms that can be used to answer arbitrary queries.These algorithms are memoryless, in the sense that each query is processed independently, without reuse of earlier computation.We argue that the brain operates in the setting of amortized inference, where numerous related queries must be answered (e.g., recognizing a scene from multiple viewpoints); in this setting, memoryless algorithms can be computationally wasteful.We propose a simple form of flexible reuse, according to which shared inferences are cached and composed together to answer new queries.We present experimental evidence that humans exploit this form of reuse: the answer to a complex query can be systematically predicted from a person's response to a simpler query if the simpler query was presented first and entails a sub-inference (i.e., a sub-component of the more complex query).People are also faster at answering a complex query when it is preceded by a sub-inference.Our results suggest that the astonishing efficiency of human probabilistic reasoning may be supported by interactions between inference and memory.

“Memo” Functions andMachine Learning“Memo” Functions and Machine LearningThe Intelligent EyeThe Intelligent EyeOn the study ofstatistical intuitionsOn the study of statistical intuitionsFluid Concepts andCreative Analogies…Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of ThoughtPROBabilities fromEXemplars (PROBEX): a…PROBabilities from EXemplars (PROBEX): a "lazy" algorithm for probabilistic inference from generic knowledgeProbabilistic GraphicalModels - Principles and…Probabilistic Graphical Models - Principles and TechniquesExemplar models as amechanism for performin…Exemplar models as a mechanism for performing Bayesian inferenceMultistability andPerceptual InferenceMultistability and Perceptual InferenceBridging Levels ofAnalysis for…Bridging Levels of Analysis for Probabilistic Models of CognitionLearning StochasticInversesLearning Stochastic InversesSimulation as an Engineof Physical Scene…Simulation as an Engine of Physical Scene UnderstandingProbabilistic brains:knowns and unknownsProbabilistic brains: knowns and unknownsStochasticBack-propagation and…Stochastic Back-propagation and Variational Inference in Deep Latent Gaussian ModelsVariational Inferencewith Normalizing FlowsVariational Inference with Normalizing FlowsControlling proceduralmodeling programs with…Controlling procedural modeling programs with stochastically-ordered sequential Monte CarloInference Networks forSequential Monte Carlo…Inference Networks for Sequential Monte Carlo in Graphical ModelsComplex ProbabilisticInferenceComplex Probabilistic InferenceWhere do hypotheses comefrom?Where do hypotheses come from?Auto-Encoding SequentialMonte CarloAuto-Encoding Sequential Monte CarloAn Introduction toVariational AutoencodersAn Introduction to Variational AutoencodersGMNN: Graph MarkovNeural NetworksGMNN: Graph Markov Neural NetworksA theory of learning toinfer.A theory of learning to infer.The Bayesian sampler:Generic Bayesian…The Bayesian sampler: Generic Bayesian inference causes incoherence in human probability judgments.Some Formal Structuresin Probability (Invited…Some Formal Structures in Probability (Invited Talk)Amortized Inference inProbabilistic ReasoningAmortized Inference in Probabilistic ReasoningEarlier referencesFocus paperCiting papersOlderNewer

Click a node to pin it, click the empty canvas to go back to this paper, or hover to preview. Open a node’s page from its title.