Proceedings of the Fourth Conference on Machine Translation (Volume 1: Research Papers)

Authors: Ondej Bojar, Rajen Chatterjee, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Yepes, Philipp Koehn, Andr Martins, Christof Monz, Matteo Negri, Aurlie Nvol, Mariana Neves, Matt Post, Marco Turchi, Karin Verspoor, Tamer Alkhouli, Antonios Anastasopoulos, Yuki Arase, Mihael Arcan, Duygu Ataman, Eleftherios Avramidis, Amittai Axelrod, Parnia Bahar, Ankur Bapna, Rachel Bawden, Graeme Blackwood, Frdric Blain, Chris Brockett, Sheila Castilho, Boxing Chen, Colin Cherry, Mara Chinea-Rios, Ann Clifton, Marta Costa-Juss, Josep Crego, Michael Denkowski, Mattia Gangi, Bruno Kessler, Miguel Domingo, Kevin Duh, Sergey Edunov, Marcello Federico, Yang Feng, Andrew Finch, Alexander Fraser, Atsushi Fujita, Juri Ganitkevitch, Mercedes Garca-Martnez, Ekaterina Garmash, Jess Gonzlez-Rubio, Isao Goto, Miguel Graa, Mandy Guo, Jeremy Gwinnup, Greg Hanneman, Eva Hasler, Yifan He, John Henderson, Felix Hieber, Hieu Hoang, Vu Cong, Duy Hoang, Junjie Hu, Mika Hmlinen, Gonzalo Iglesias, Kenji Imamura, Julia Ive, Marcin Junczys, Shahram Khadivi, Huda Khayrallah, Douwe Kiela, Yunsu Kim, Rebecca Knowles, Julia Kreutzer, Shankar Kumar, Anoop Kunchukuttan, Surafel Lakew, Alon Lavie, Gregor Leusch, William Lewis, Patrick Littell, Qun Liu, Andreas Maletti, Saab Mansour, Sameen Maruf, Arne Mauser, Arya Mccarthy, Antonio Valerio, Miceli Barone, Paul Michel, Aaron Mueller, Tom Musil, Mathias Mller, Masaaki Nagata, Toshiaki Nakazawa, Graham Neubig, Jan Niehues, Nikola Nikolov, Xing Niu, Tsuyoshi Okita, Daniel Ortiz-Martnez, Myle Ott, Santanu Pal, Carla Parra, Pavel Pecina, Stephan Peitz, Martin Popel, Maja Popovi, Annette Rios, Raphael Rubino, Devendra Sachan, Elizabeth Salesky, Hassan Sawaf, Jean Senellart, Patrick Simianer, Felix Stahlberg, Dario Stojanovski, Felipe Snchez-Martnez, Jrg Tiedemann, Antonio Toral, Ke Tran, Ferhan Ture, Nicola Ueffing, Masao Utiyama, Duan Vari, David Vilar, Ivan Vuli, Ekaterina Vylomova, Wei Wang, Taro Watanabe, Philip Williams, Hua Wu, Joern Wuebker, Franois Yvon, Shuoyang Ding, Hainan Xu, Daniel Smilkov, Nikhil Thorat, Been Kim, Fernanda Vigas, Tamer Alkhouli, Gabriel Bretschner, Hermann Ney, Marco Mihael Arcan, Sara Turchi, Paul Tonelli, Buitelaar, Sebastian Bach, Alexander Binder, Grgoire Montavon, Frederick Klauschen, Klaus-Robert Mller, Wojciech Samek, F Peter, Stephen Brown, Vincent Della Pietra, Robert Della Pietra, Mercer, William Chan, Navdeep Jaitly, Quoc Le, Oriol Vinyals, Jan Chorowski, Dzmitry Bahdanau, Dmitriy Serdyuk, Kyunghyun Cho, Yoshua Bengio, Yanzhuo Ding, Yang Liu, Huanbo Luan, Maosong Sun, Chris Dyer, Victor Chahuneau, Noah Smith, Mauro Cettolo, Marcello Federico, Luisa Bentivogli, Niehues Jan, Stker Sebastian, Sudoh Katsuitho, Yoshino Koichiro, Federmann Christian, Yun Chen, Yang Liu, O Victor, Li, Raj Dabre, Fabien Cromieres, Sadao Kurohashi, Tobias Domhan, Felix Hieber, Yarin Gal, Zoubin Ghahramani, Roee Aharoni, Yoav Goldberg, Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio, Joost Bastings, Ivan Titov, Wilker Aziz, Diego Marcheggiani, Khalil Sima'an, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Raphael Rubino, Lucia Specia, Marco Turchi, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Aurlie Nvol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi, Karin Verspoor, Marcos Zampieri, Ondej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Philipp Koehn, Christof Monz, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Oriol Vinyals, ukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, Geoffrey Hinton, Shuangzhi Wu, Dongdong Zhang, Zhirui Zhang, Nan Yang, Mu Li, Ming Zhou, Meishan Zhang, Zhenghua Li, Guohong Fu, Min Zhang, Mikel Artetxe, Gorka Labaka, Eneko Agirre, Mikel Artetxe, Gorka Labaka, Eneko Agirre, Kyunghyun Cho, Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio, Mona Baker, Colin Bannard, Chris Callison-Burch, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Thorsten Brants, C Ashok, Peng Popat, Franz Xu, Jeffrey Och, Dean, Rajen Chatterjee, Matteo Negri, Raphael Rubino, Marco Turchi, Yong Cheng, Wei Xu, Zhongjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu, Tobias Domhan, Felix Hieber, Sergey Edunov, Myle Ott, Michael Auli, David Grangier, Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann Dauphin, Martin Gellerstam, C aglar Glc ehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Yoshua Bengio, Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tieyan Liu, Wei-Ying Ma, Matthieu Hermet, Dsilets Alain, Duy Vu Cong, Philipp Hoang, Gholamreza Koehn, Trevor Haffari, Cohn, Maria Holmqvist, Sara Stymne, Jody Foo, Lars Ahrenberg, Marcin Junczys-Dowmunt, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Moshe Koppel, Noam Ordan, Guillaume Lample, Alexis Conneau, Ludovic Denoyer, Marc'aurelio Ranzato, Guillaume Lample, Myle Ott, Alexis Conneau, Ludovic Denoyer, Marc'aurelio Ranzato, Gennadi Lembersky, Noam Ordan, Shuly Wintner, Nitin Madnani, Joel Tetreault, Martin Chodorow, Jonathan Mallinson, Rico Sennrich, Mirella Lapata, Xing Niu, Michael Denkowski, Marine Carpuat, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Jan-Thorsten Peter, Tamer Alkhouli, Hermann Ney, Matthias Huck, Fabienne Braune, Alexander Fraser, Ale Tamchyna, Ondej Bojar, Barry Haddow, Rico Sennrich, Frdric Blain, Lucia Specia, Jan Niehues, Alex Waibel, Alexandre Allauzen, Lauriane Aufrant, Franck Burlot, Thomas Lavergne, Mrcis Franc ois Yvon, Stella Pinnis, Frank, Alberto Poncelas, Dimitar Shterionov, Andy Way, Gideon Maillette De Buy, Peyman Wenniger, Passban, Martin Popel, Matt Post, Friedrich Schleiermacher, Larry Selinker, Rico Sennrich, Barry Haddow, Alexandra Birch, Rico Sennrich, Barry Haddow, Alexandra Birch, Peter Shaw, Jakob Uszkoreit, Ashish Vaswani, Felix Stahlberg, Adri De Gispert, Bill Byrne, Sara Stymne, Gideon Toury, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Marina Warner, Tian Wu, Zhongjun He, Enhong Chen, Haifeng Wang, Yingce Xia, Tao Qin, Wei Chen, Jiang Bian, Nenghai Yu, Tie-Yan Liu, Zhirui Zhang, Shujie Liu, Mu Li, Ming Zhou, Enhong Chen, Vincent J Della Peter F Brown, Stephen Pietra, Pietra Della, Robert Mercer, Franck Burlot, Franc ois Yvon, Jonathan H Clark, Chris Dyer, Alon Lavie, Noah Smith, Geoffrey Hinton, Peter Dayan, Brendan Frey, M Radford, Neal, Duy Vu Cong, Philipp Hoang, Gholamreza Koehn, Trevor Haffari, Cohn, Kenji Imamura, Atsushi Fujita, Eiichiro Sumita, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Josef Franz, Hermann Och, Ney, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Jan-Thorsten Peter, Eugen Beck, Hermann Ney, Rico Sennrich, Barry Haddow, Alexandra Birch, Rico Sennrich, Barry Haddow, Alexandra Birch, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Amittai Axelrod, Xiaodong He, Jianfeng Gao, Yong Cheng, Wei Xu, Zhongjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu, Anna Currey, Antonio Valerio Miceli, Kenneth Barone, Heafield, Tao Qin, Liwei Wang, Nenghai Yu, Tieyan Liu Di He, Yingce Xia, Wei-Ying Ma, Tobias Domhan, Felix Hieber, Sergey Edunov, Myle Ott, Michael Auli, David Grangier, Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann Dauphin, Martin Gellerstam, C aglar Glc ehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Yoshua Bengio, Wei He, Zhongjun He, Hua Wu, Haifeng Wang, Kenji Imamura, Atsushi Fujita, Eiichiro Sumita, Yoon Kim, Alexander Rush, James Kuczmarski, Melvin Johnson, Patrik Lambert, Holger Schwenk, Christophe Servan, Sadaf Abdul-Rauf, Guillaume Lample, Alexis Conneau, Ludovic Denoyer, Marc'aurelio Ranzato, Guillaume Lample, Myle Ott, Alexis Conneau, Ludovic Denoyer, Marc'aurelio Ranzato, Xing Niu, Michael Denkowski, Marine Carpuat, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Alberto Poncelas, Dimitar Shterionov, Andy Way, Gideon Maillette De Buy, Peyman Wenniger, Passban, Rico Sennrich, Barry Haddow, Alexandra Birch, Brian Thompson, Huda Khayrallah, Antonios Anastasopoulos, D Arya, Kevin Mccarthy, Rebecca Duh, Paul Marvin, Jeremy Mcnamee, Tim Gwinnup, Philipp Anderson, Koehn, Nicola Ueffing, Gholamreza Haffari, Anoop Sarkar, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Gholamreza Haffari, Vu Cong, Duy Hoang, Philipp Koehn, Trevor Cohn, Arianna Marlies Van Der Wees, Christof Bisazza, Monz, Yingce Xia, Tao Qin, Wei Chen, Jiang Bian, Nenghai Yu, Tie-Yan Liu, Hayahide Yamagishi, Shin Kanouchi, Takayuki Sato, Mamoru Komachi, Alexandra Antonova, Alexey Misyurev, Jiang Chen, Jian-Yun Nie, Minmin Chen, Mandy Guo, Qinlan Shen, Yinfei Yang, Heming Ge, Daniel Cer, Gustavo Hernandez Abrego, Keith Stevens, Noah Constant, Yun-Hsuan Sung, Brian Strope, Ray Kurzweil, Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, Hal Daum, Iii, Quoc Le, Tomas Mikolov, Lesly Miculicich, Dhananjay Ram, Nikolaos Pappas, James Henderson, Stefan Dragos, Daniel Munteanu, Marcu, Stefan Dragos, Daniel Munteanu, Marcu, Philip Resnik, Noah Smith, Holger Schwenk, Lei Shi, Cheng Niu, Ming Zhou, Jianfeng Gao, Jakob Uszkoreit, Jay Ponte, C Ashok, Moshe Popat, Dubiner, U Guyon, S Luxburg, Bengio, Longyue Wang, Zhaopeng Tu, Andy Way, Qun Liu, Lingfei Wu, Ian En-Hsu Yen, Kun Xu, Fangli Xu, Avinash Balakrishnan, Pin-Yu Chen, Pradeep Ravikumar, Michael Witbrock, C Christopher, Kar Yang, Li Wing, Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy, Mona Baker, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Ondej Bojar, Mark Fishel, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Christof Monz, Ondej Bojar, Christian Buck, Chris Callison-Burch, Christian Federmann, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, Lucia Specia, D John, Byrum, Christian Federmann, Yvette Graham, Timothy Baldwin, Alistair Moffat, Justin Zobel, Yvette Graham, Timothy Baldwin, Alistair Moffat, Justin Zobel, Yvette Graham, Timothy Baldwin, Alistair Moffat, Justin Zobel, David Kurokawa, Cyril Goutte, Pierre Isabelle, Sara Laviosa-Braithwaite, Gennadi Lembersky, Noam Ordan, Shuly Wintner, Patrick Littell, Ke David R Mortensen, Katherine Lin, Carlisle Kairis, Lori Turner, Levin, Sara Stymne, Martn Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dandelion Man, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Vigas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, Xiaoqiang Zheng, Aitor lvarez, Carlos-D Martnez-Hinarejos, Haritz Arzelus, Marina Balenciaga, Arantza Del Pozo, Aitor lvarez Muniain, Marina Balenciaga, Arantza Del Pozo, Haritz Echezarreta, Anna Arzelus Irazusta, Carlos D Martnez Matamala, Hinarejos, Parnia Bahar, Jan Rosendahl, Nick Rossenbach, Hermann Ney, Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio, Lindsay Thierry Etchegoyhen, Mark Bywood, Panayota Fishel, Jie Georgakopoulou, Gerard Jiang, Arantza Van Loenhout, Mirjam Del Pozo, Anja Sepesy Maucec, Martin Turner, Volk, Michael Farrell, P Diederik, Jimmy Kingma, Ba, Taku Kudo, John Richardson, Pierre Lison, Raveesh Meena, Pierre Lison, Jrg Tiedemann, Minh-Thang Luong, Christopher Manning, Lesly Miculicich, Dhananjay Ram, Nikolaos Pappas, James Henderson, Mathias Mller, Martin Volk, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Hye-Jeong Song, Hong-Ki Kim, Jong-Dae Kim, Chan-Young Park, Yu-Seop Kim, Ottokar Tilk, Tanel Alume, Martin Volk, Rico Sennrich, Christian Hardmeier, Frida Tidstrm, Weiyue Wang, Jan-Thorsten Peter, Hendrik Rosendahl, Hermann Ney, Albert Zeyer, Tamer Alkhouli, Hermann Ney, Rajen Chatterjee, Matteo Negri, Marco Turchi, Marcello Federico, Lucia Specia, Frdric Blain, Chenhui Chu, Rui Wang, Sergey Edunov, Myle Ott, Michael Auli, David Grangier, Marc'aurelio Ranzato, Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann Dauphin, Daniel Gile, P Hart, N Nilsson, B Raphael, R Garnett, Liang Huang, Kai Zhao, Mingbo Ma, Philipp Koehn, Philipp Koehn, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondej Bojar, Alexandra Constantin, Evan Herbst, Philipp Koehn, Rebecca Knowles, Pierre Lison, Jrg Tiedemann, Harry Mcgurk, John Macdonald, Alp ktem, Mireia Farrs, Antonio Bonafonte, Myle Ott, Michael Auli, David Grangier, Marc'aurelio Ranzato, Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Matt Post, Rico Sennrich, Barry Haddow, Alexandra Birch, Xing Shi, Kevin Knight, Deniz Yuret, Yilin Yang, Liang Huang, Mingbo Ma, Ondej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Christof Monz, Angela Yann N Dauphin, Michael Fan, David Auli, Grangier, Barry Haddow, Nikolay Bogoychev, Denis Emelin, Ulrich Germann, Roman Grundkiewicz, Kenneth Heafield, Antonio Valerio Miceli, Rico Barone, Sennrich, Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, Gao Huang, Zhuang Liu, Laurens Van Der Maaten, Kilian Weinberger, Chen-Yu Lee, Saining Xie, Patrick Gallagher, Zhengyou Zhang, Zhuowen Tu, Xipeng Peng Qian, Xuanjing Qiu, Huang, Annette Rios, Laura Mascarell, Rico Sennrich, Helmut Schmid, Xing Shi, Inkit Padhi, Kevin Knight, Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, Ruslan Salakhutdinov, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Lijun Wu, Fei Tian, Li Zhao, Jianhuang Lai, Tie-Yan Liu, Ne&num Ne&num Ne&num Ne&num Bleu Precision, Roee References, Yoav Aharoni, Goldberg, Rachel Bawden, Rico Sennrich, Alexandra Birch, Barry Haddow, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Christof Monz, Matteo Negri, Aurlie Nvol, Mariana Neves, Matt Post, Lucia Specia, Marco Turchi, Karin Verspoor, Akiko Eriguchi, Kazuma Hashimoto, Yoshimasa Tsuruoka, Akiko Eriguchi, Yoshimasa Tsuruoka, Kyunghyun Cho, Jiatao Gu, Yong Wang, Kyunghyun Cho, O Victor, Li, Hakan Inan, Khashayar Khosravi, Richard Socher, Melvin Johnson, Mike Schuster, Quoc Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Vigas, Martin Wattenberg, Greg Corrado, Macduff Hughes, Jeffrey Dean, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, Evan Herbst, Taku Kudo, John Richardson, Chaitanya Malaviya, Pedro Ferreira, F Andr, Martins, Christopher Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven Bethard, David Mcclosky, Paul Michel, Graham Neubig, Lesly Miculicich, Dhananjay Ram, Nikolaos Pappas, James Henderson, Mathias Mller, Annette Rios, Elena Voita, Rico Sennrich, Graham Neubig, Yosuke Nakata, Shinsuke Mori, Y Oda, H Fudaba, G Neubig, H Hata, S Sakti, T Toda, S Nakamura, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Ankur Parikh, Oscar Tckstrm, Dipanjan Das, Jakob Uszkoreit, Ofir Press, Lior Wolf, Abigail See, Peter Liu, Christopher Manning, Andrea Silvestre, Baquero, Ruslan Mitkov, Inguna Skadina, Mrcis Pinnis, Daniel Varga, Laszlo Nmeth, Peter Halcsy, Andras Kornai, Victor Viktor Trn, Nagy, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, Ukasz Kaiser, Illia Polosukhin, Jiacheng Zhang, Huanbo Luan, Maosong Sun, Feifei Zhai, Jingfang Xu, Min Zhang, Yang Liu - 2019 cited by 13

Despite their original goal to jointly learn to align and translate, Neural Machine Translation (NMT) models, especially Transformer, are often perceived as not learning interpretable word alignments. In this paper, we show that NMT models do learn interpretable word alignments, which could only be revealed with proper interpretation methods. We propose a series of such methods that are model-agnostic, are able to be applied either offline or online, and do not require parameter update or architectural change. We show that under the force decoding setup, the alignments induced by our interpretation method are of better quality than fast-align for some systems, and when performing free decoding, they agree well with the alignments induced by automatic alignment tools.