Erich Elsen
Active 2006–2026
- 36
- Papers
- 19,823
- Citations
- 30
- h-index
- 33
- i10-index
Citations
Citation sources
Countries
Institutions
Fields
- Computer Science80.7%
- Engineering5.8%
- Social Sciences2%
- Medicine2%
- Biochemistry, Genetics and Molecular Biology1.3%
- Neuroscience1.3%
- Other6.9%
Topics
- Topic Modeling8.5%
- Natural Language Processing Techniques7.4%
- Speech Recognition and Synthesis6.1%
- Advanced Neural Network Applications5%
- Music and Audio Processing4.3%
- Speech and Audio Processing4%
- Other64.7%
Coauthors
- Karen Simonyan14
- Simon Osindero9
- George van den Driessche7
- Jordan Hoffmann7
- Aidan Clark6
- Eliza Rutherford6
- Jack W. Rae6
- Oriol Vinyals6
- Sebastian Borgeaud6
- Trevor Cai6
- Arthur Mensch5
- Aurelia Guy5
- Bogdan Damoc5
- Jacob Menick5
- Laurent Sifre5
- Sander Dieleman5
- Tom Hennigan5
- Utku Evci5
- Bryan Catanzaro4
- Diego de Las Casas4
- Eric Darve4
- Greg Diamos4
- Jesse H. Engel4
- Johannes Welbl4
All papers
- Training Compute-Optimal Large Language Models
Authors: Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katie Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, Erich Elsen, Jack W. Rae, Oriol Vinyals, Laurent Sifre - arXiv (Cornell University), CoRR 2022 cited by 2,743
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Authors: Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant M. Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew J. Johnson, Blake A. Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Edward Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving - arXiv (Cornell University), CoRR 2021 cited by 1,133
- Mixed Precision Training
Authors: Paulius Micikevicius, Sharan Narang, Jonah Alben, Gregory F. Diamos, Erich Elsen, David García, Boris Ginsburg, Michael Houston, Oleksii Kuchaiev, Ganesh Venkatesh, Hao Wu - ICLR (Poster) 2018 cited by 2,457
- The State of Sparsity in Deep Neural Networks
Authors: Trevor Gale, Erich Elsen, Sara Hooker - arXiv (Cornell University), CoRR 2019 cited by 624
- Improving Language Models by Retrieving from Trillions of Tokens
Authors: Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia Guy, Jacob Menick, Roman Ring, Tom Hennigan, Saffron Huang, Loren Maggiore, Chris Jones, Albin Cassirer, Andy Brock, Michela Paganini, Geoffrey Irving, Oriol Vinyals, Simon Osindero, Karen Simonyan, Jack W. Rae, Erich Elsen, Laurent Sifre - ICML 2022 cited by 1,785
- Intelligent Query Answering with Contextual Knowledge for Relational Databases
Authors: Awni Y. Hannun, Carl Case, Jared Casper, Bryan Catanzaro, Greg Diamos, Erich Elsen, Ryan Prenger, Sanjeev Satheesh, Shubho Sengupta, Adam Coates, Andrew Y. Ng - SLATE 2021 cited by 1,519
- Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin
Authors: Dario Amodei, Sundaram Ananthanarayanan, Rishita Anubhai, Jingliang Bai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse H. Engel, Linxi Fan, Christopher Fougner, Awni Y. Hannun, Billy Jun, Tony Han, Patrick LeGresley, Xiangang Li, Libby Lin, Sharan Narang, Andrew Y. Ng, Sherjil Ozair, Ryan Prenger, Sheng Qian, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Chong Wang, Yi Wang, Zhiqian Wang, Bo Xiao, Yan Xie, Dani Yogatama, Jun Zhan, Zhenyao Zhu - ICML 2016 cited by 3,180
- Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset
Authors: Curtis Hawthorne, Andriy Stasyuk, Adam Roberts, Ian Simon, Cheng-Zhi Anna Huang, Sander Dieleman, Erich Elsen, Jesse H. Engel, Douglas Eck - ICLR 2019 cited by 596
- Rigging the Lottery: Making All Tickets Winners
Authors: Utku Evci, Trevor Gale, Jacob Menick, Pablo Samuel Castro, Erich Elsen - International Conference on Machine Learning, ICML 2020 cited by 758
- Step-unrolled Denoising Autoencoders for Text Generation
Authors: Nikolay Savinov, Junyoung Chung, Mikolaj Binkowski, Erich Elsen, Aäron van den Oord - ICLR 2022 cited by 152
- Unified Scaling Laws for Routed Language Models
Authors: Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew J. Johnson, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Marc'Aurelio Ranzato, Jack W. Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan - ICML 2022 cited by 285
- Training Compute-Optimal Large Language Models
Authors: Sebastian Borgeaud, Sebastian Borgeaud, Trevor Cai, Aidan Clark, Bogdan Damoc, Diego Couto de Las Casas, Erich Elsen, Aurelia Guy, Lisa Anne Hendricks, Thomas Hennigan, Jordan Hoffmann, Arthur Mensch, Katherine Millican, George Van Den Driessche, Simon Osindero, Jack Rae, Eliza Rutherford, Laurent Sifre, Karen Simonyan, Oriol Vinyals, Oriol Vinyals, Johannes Welbl - Advances in Neural Information Processing Systems 35 2022 cited by 56
- High Fidelity Speech Synthesis with Adversarial Networks
Authors: Mikolaj Binkowski, Jeff Donahue, Sander Dieleman, Aidan Clark, Erich Elsen, Norman Casagrande, Luis C. Cobo, Karen Simonyan - ICLR 2020 cited by 264
- Parallel WaveNet: Fast High-Fidelity Speech Synthesis
Authors: Aäron van den Oord, Yazhe Li, Igor Babuschkin, Karen Simonyan, Oriol Vinyals, Koray Kavukcuoglu, George van den Driessche, Edward Lockhart, Luis C. Cobo, Florian Stimberg, Norman Casagrande, Dominik Grewe, Seb Noury, Sander Dieleman, Erich Elsen, Nal Kalchbrenner, Heiga Zen, Alex Graves, Helen King, Tom Walters, Dan Belov, Demis Hassabis - ICML 2018 cited by 913
- Onsets and Frames: Dual-Objective Piano Transcription
Authors: Curtis Hawthorne, Erich Elsen, Jialin Song, Adam Roberts, Ian Simon, Colin Raffel, Jesse H. Engel, Sageev Oore, Douglas Eck - ISMIR 2018 cited by 70
- The Difficulty of Training Sparse Neural Networks
Authors: Utku Evci, Fabian Pedregosa, Aidan N. Gomez, Erich Elsen - arXiv (Cornell University), CoRR 2019 cited by 64
- Exploring Sparsity in Recurrent Neural Networks
Authors: Sharan Narang, Greg Diamos, Shubho Sengupta, Erich Elsen - ICLR (Poster) 2017 cited by 328
- Sparse GPU Kernels for Deep Learning
Authors: Trevor Gale, Matei Zaharia, Cliff Young, Erich Elsen - SC20: International Conference for High Performance Computing 2020 cited by 36
- DSD: Regularizing Deep Neural Networks with Dense-Sparse-Dense Training Flow
Authors: Song Han, Jeff Pool, Sharan Narang, Huizi Mao, Enhao Gong, Shijian Tang, Erich Elsen, Peter Vajda, Manohar Paluri, John Tran, Bryan Catanzaro, William J. Dally - ICLR (Poster) 2017 cited by 219
- On the Generalization Benefit of Noise in Stochastic Gradient Descent
Authors: Samuel L. Smith, Erich Elsen, Soham De - ICML 2020 cited by 129
- End-to-End Adversarial Text-to-Speech
Authors: Jeff Donahue, Sander Dieleman, Mikolaj Binkowski, Erich Elsen, Karen Simonyan - ICLR 2021 cited by 197
- The State of Sparse Training in Deep Reinforcement Learning
Authors: Laura Graesser, Utku Evci, Erich Elsen, Pablo Samuel Castro - ICML 2022 cited by 73
- Liszt: a domain specific language for building portable mesh-based PDE solvers
Authors: Zach DeVito, Niels Joubert, Francisco Palacios, Stephen Oakley, Montserrat Medina, Mike Barrientos, Erich Elsen, Frank Ham, Alex Aiken, Karthik Duraisamy, Eric Darve, Juan J. Alonso, Pat Hanrahan - IEEE International Conference on High Performance Computing, Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis 2011 cited by 203
- A Practical Sparse Approximation for Real Time Recurrent Learning
Authors: Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero, Karen Simonyan, Alex Graves - arXiv (Cornell University), CoRR 2020 cited by 13
