A* Sampling

The problem of drawing samples from a discrete distribution can be converted into a discrete optimization problem [1, 2, 3, 4]. In this work, we show how sampling from a continuous distribution can be converted into an optimization problem over continuous space. Central to the method is a stochastic process recently described in mathematical statistics that we call the Gumbel process. We present a new construction of the Gumbel process and A ⇤ Sampling, a practical generic sampling algorithm that searches for the maximum of a Gumbel process using A ⇤ search. We analyze the correctness and convergence time of A ⇤ Sampling and demonstrate empirically that it makes more efficient use of bound and likelihood evaluations than the most closely related adaptive rejection sampling-based algorithms. 1

Statistical Theory ofExtreme Values and Some…Statistical Theory of Extreme Values and Some Practical Applications : A Series of LecturesThe relationship betweenLuce's Choice Axiom…The relationship between Luce's Choice Axiom, Thurstone's Theory of Comparative Judgment, and the double exponential distributionAdaptive RejectionSampling for Gibbs…Adaptive Rejection Sampling for Gibbs SamplingExact sampling withcoupled Markov chains…Exact sampling with coupled Markov chains and applications to statistical mechanicsExpectation Propagationfor approximate Bayesia…Expectation Propagation for approximate Bayesian inferenceSlice SamplingSlice SamplingPerturb-and-MAP randomfields: Using discrete…Perturb-and-MAP random fields: Using discrete optimization to learn and sample from energy modelsRandomized OptimumModels for Structured…Randomized Optimum Models for Structured PredictionOn the PartitionFunction and Random…On the Partition Function and Random Maximum A-Posteriori PerturbationsThe OS* Algorithm: aJoint Approach to Exact…The OS* Algorithm: a Joint Approach to Exact Optimization and SamplingOn Sampling from theGibbs Distribution with…On Sampling from the Gibbs Distribution with Random Maximum A-Posteriori PerturbationsEmbed and Project:Discrete Sampling with…Embed and Project: Discrete Sampling with Universal HashingLearning and Inferencevia Maximum Inner…Learning and Inference via Maximum Inner Product SearchCategoricalReparameterization with…Categorical Reparameterization with Gumbel-SoftmaxLearning to Explain: AnInformation-Theoretic…Learning to Explain: An Information-Theoretic Perspective on Model InterpretationKDGAN: KnowledgeDistillation with…KDGAN: Knowledge Distillation with Generative Adversarial NetworksSelective Sensor Fusionfor Neural…Selective Sensor Fusion for Neural Visual-Inertial OdometryDirect Optimizationthrough arg max for…Direct Optimization through arg max for Discrete Variational Auto-EncoderSearching for A RobustNeural Architecture in…Searching for A Robust Neural Architecture in Four GPU Hourswav2vec 2.0: A Frameworkfor Self-Supervised…wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsGradient Estimation withStochastic Softmax…Gradient Estimation with Stochastic Softmax TricksAncestral Gumbel-Top-kSampling for Sampling…Ancestral Gumbel-Top-k Sampling for Sampling Without ReplacementLearning GraphStructures With…Learning Graph Structures With Transformer for Multivariate Time-Series Anomaly Detection in IoTA Review of theGumbel-max Trick and it…A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine LearningA* SamplingA* Sampling過去の参考文献中心の論文この論文を引用する論文古い新しい

ノードをクリックするとフォーカスを固定、空白をクリックすると本論文に戻ります。ホバーで一時的にプレビューできます。各ノードのページはタイトルから開けます。