Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups

Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.

Reducing theDimensionality of Data…Reducing the Dimensionality of Data with Neural NetworksA Fast LearningAlgorithm for Deep…A Fast Learning Algorithm for Deep Belief NetsPhone Recognition withthe Mean-Covariance…Phone Recognition with the Mean-Covariance Restricted Boltzmann MachineInvestigation offull-sequence training…Investigation of full-sequence training of deep belief networks for speech recognitionRoles of Pre-Trainingand Fine-Tuning in…Roles of Pre-Training and Fine-Tuning in Context-Dependent DBN-HMMs for Real-World Speech RecognitionAcoustic Modeling UsingDeep Belief NetworksAcoustic Modeling Using Deep Belief NetworksContext-DependentPre-Trained Deep Neural…Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech RecognitionDeep Belief Networksusing discriminative…Deep Belief Networks using discriminative features for phone recognitionFeature engineering inContext-Dependent Deep…Feature engineering in Context-Dependent Deep Neural Networks for conversational speech transcriptionOn optimization methodsfor deep learningOn optimization methods for deep learningApplication ofPretrained Deep Neural…Application of Pretrained Deep Neural Networks to Large Vocabulary Speech RecognitionApplying ConvolutionalNeural Networks concept…Applying Convolutional Neural Networks concepts to hybrid NN-HMM model for speech recognitionImproving DNN speakerindependence with…Improving DNN speaker independence with I-vector inputsDeep learningapplications and…Deep learning applications and challenges in big data analyticsSAT-LHUC: Speakeradaptive training for…SAT-LHUC: Speaker adaptive training for learning hidden unit contributionsJoint CTC-Attentionbased End-to-End Speech…Joint CTC-Attention based End-to-End Speech Recognition using Multi-task LearningDeep ConvolutionalNeural Networks for…Deep Convolutional Neural Networks for mental load classification based on EEG dataA Genetic ProgrammingApproach to Designing…A Genetic Programming Approach to Designing Convolutional Neural Network ArchitecturesDesign and analyze thestructure based on deep…Design and analyze the structure based on deep belief network for gesture recognitionAutoImpute: Autoencoderbased imputation of…AutoImpute: Autoencoder based imputation of single-cell RNA-seq dataDeep Learning inAlzheimer's disease…Deep Learning in Alzheimer's disease: Diagnostic Classification and Prognostic Prediction using Neuroimaging DataA Novel Method ofHyperspectral Data…A Novel Method of Hyperspectral Data Classification Based on Transfer Learning and Deep Belief NetworkArtificial Intelligenceto Power the Future of…Artificial Intelligence to Power the Future of Materials Science and EngineeringBackground selectionschema on deep…Background selection schema on deep learning-based classification of dermatological diseaseDeep Neural Networks forAcoustic Modeling in…Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups過去の参考文献中心の論文この論文を引用する論文古い新しい

ノードをクリックするとフォーカスを固定、空白をクリックすると本論文に戻ります。ホバーで一時的にプレビューできます。各ノードのページはタイトルから開けます。