Stochastic Video Generation with a Learned Prior

Generating video frames that accurately predict future world states is challenging. Existing approaches either fail to capture the full distribution of outcomes, or yield blurry generations, or both. In this paper we introduce an unsupervised video generation model that learns a prior model of uncertainty in a given environment. Video frames are generated by drawing samples from this prior and combining them with a deterministic estimate of the future frame. The approach is simple and easily trained end-to-end on a variety of datasets. Sample generations are both varied and sharp, even many frames into the future, and compare favorably to those from existing approaches.

Video (language)modeling: a baseline fo…Video (language) modeling: a baseline for generative models of natural videosGenerating Videos withScene DynamicsGenerating Videos with Scene DynamicsVisual Dynamics:Probabilistic Future…Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional NetworksVideo Pixel NetworksVideo Pixel NetworksSelf-Supervised VisualPlanning with Temporal…Self-Supervised Visual Planning with Temporal Skip ConnectionsDecomposing Motion andContent for Natural…Decomposing Motion and Content for Natural Video Sequence PredictionGenerating the Futurewith Adversarial…Generating the Future with Adversarial TransformersUnsupervised Learning ofDisentangled…Unsupervised Learning of Disentangled Representations from VideoDeep Predictive CodingNetworks for Video…Deep Predictive Coding Networks for Video Prediction and Unsupervised LearningLearning to GenerateLong-term Future via…Learning to Generate Long-term Future via Hierarchical PredictionRecurrent EnvironmentSimulatorsRecurrent Environment SimulatorsStochastic VariationalVideo PredictionStochastic Variational Video PredictionStochastic AdversarialVideo PredictionStochastic Adversarial Video PredictionLearning Latent Dynamicsfor Planning from PixelsLearning Latent Dynamics for Planning from PixelsTime-AgnosticPrediction: Predicting…Time-Agnostic Prediction: Predicting Predictable Video FramesVideoFlow: A ConditionalFlow-Based Model for…VideoFlow: A Conditional Flow-Based Model for Stochastic Video GenerationTrain Sparsely, GenerateDensely…Train Sparsely, Generate Densely: Memory-Efficient Unsupervised Training of High-Resolution Temporal GANExploringSpatial-Temporal…Exploring Spatial-Temporal Multi-Frequency Analysis for High-Fidelity and Temporal-Consistency Video PredictionStochastic VideoLong-term InterpolationStochastic Video Long-term InterpolationFitVid: Overfitting inPixel-Level Video…FitVid: Overfitting in Pixel-Level Video PredictionLatent Video TransformerLatent Video TransformerVideoGPT: VideoGeneration using VQ-VAE…VideoGPT: Video Generation using VQ-VAE and TransformersClockwork VariationalAutoencodersClockwork Variational AutoencodersMastering Atari withDiscrete World ModelsMastering Atari with Discrete World ModelsStochastic VideoGeneration with a…Stochastic Video Generation with a Learned Prior過去の参考文献中心の論文この論文を引用する論文古い新しい

ノードをクリックするとフォーカスを固定、空白をクリックすると本論文に戻ります。ホバーで一時的にプレビューできます。各ノードのページはタイトルから開けます。