Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2)

Authors: Ondej Bojar, Rajen Chatterjee, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Yepes, Philipp Koehn, Andr Martins, Christof Monz, Matteo Negri, Aurlie Nvol, Mariana Neves, Matt Post, Marco Turchi, Karin Verspoor, Tamer Alkhouli, Antonios Anastasopoulos, Yuki Arase, Mihael Arcan, Duygu Ataman, Eleftherios Avramidis, Amittai Axelrod, Parnia Bahar, Ankur Bapna, Rachel Bawden, Graeme Blackwood, Frdric Blain, Chris Brockett, Sheila Castilho, Boxing Chen, Colin Cherry, Mara Chinea-Rios, Ann Clifton, Marta Costa-Juss, Josep Crego, Michael Denkowski, Mattia Gangi, Bruno Kessler, Miguel Domingo, Kevin Duh, Sergey Edunov, Marcello Federico, Yang Feng, Andrew Finch, Alexander Fraser, Atsushi Fujita, Juri Ganitkevitch, Mercedes Garca-Martnez, Ekaterina Garmash, Jess Gonzlez-Rubio, Isao Goto, Miguel Graa, Mandy Guo, Jeremy Gwinnup, Greg Hanneman, Eva Hasler, Yifan He, John Henderson, Felix Hieber, Hieu Hoang, Vu Cong, Duy Hoang, Junjie Hu, Mika Hmlinen, Gonzalo Iglesias, Kenji Imamura, Julia Ive, Marcin Junczys, Shahram Khadivi, Huda Khayrallah, Douwe Kiela, Yunsu Kim, Rebecca Knowles, Julia Kreutzer, Shankar Kumar, Anoop Kunchukuttan, Surafel Lakew, Alon Lavie, Gregor Leusch, William Lewis, Patrick Littell, Qun Liu, Andreas Maletti, Saab Mansour, Sameen Maruf, Arne Mauser, Arya Mccarthy, Antonio Valerio, Miceli Barone, Paul Michel, Aaron Mueller, Tom Musil, Mathias Mller, Masaaki Nagata, Toshiaki Nakazawa, Graham Neubig, Jan Niehues, Nikola Nikolov, Xing Niu, Tsuyoshi Okita, Daniel Ortiz-Martnez, Myle Ott, Santanu Pal, Carla Parra, Pavel Pecina, Stephan Peitz, Martin Popel, Maja Popovi, Annette Rios, Raphael Rubino, Devendra Sachan, Elizabeth Salesky, Hassan Sawaf, Jean Senellart, Patrick Simianer, Felix Stahlberg, Dario Stojanovski, Felipe Snchez-Martnez, Jrg Tiedemann, Antonio Toral, Ke Tran, Ferhan Ture, Nicola Ueffing, Masao Utiyama, David Vilar, Ivan Vuli, Ekaterina Vylomova, Wei Wang, Taro Watanabe, Philip Williams, Hua Wu, Joern Wuebker, Franois Yvon, Erick Fonseca, Lisa Yankovskaya, David Blei, Andrew Ng, Michael Jordan, John Lafferty, Latent, Varvara Logacheva, Aure- Lie Neveol, Carolina Scarton, Lucia Spe- Cia, Shujian Huang, H Abdi, Shamil Chollampatt, Hwee Tou Ng, Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, Chris Dyer, Victor Chahuneau, Noah Smith, Fbio Kepler, Jonay Trnous, Marcos Treviso, Miguel Vera, F Andr, Martins, F Andr, Marcin Martins, Fabio Junczys-Dowmunt, Ramn Kepler, Chris Astudillo, Roman Hokamp, Grundkiewicz, B Matthews, Lucia Specia, Gustavo Paetzold, Carolina Scarton, Wonkee Lee, Jaehun Shin, Jong-Hyeok Lee, Jindich Libovick, Jindich Helcl, Marek Tlust, Ondej Bojar, Pavel Pecina, V Antnio, M Lopes, Gonc Amin Farajian, M Correia, Jonay Trnous, F Andr, Martins, Matteo Negri, Marco Turchi, Rajen Chatterjee, Nicola Bertoldi, Santanu Pal, Nico Herbig, Antonio Krger, Josef Van Genabith, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Sadaf Abdul-Rauf, Holger Schwenk, Patrik Lambert, Mohammad Nawaz, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Aurelie Neveol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi, Karin Verspoor, Marcos Zampieri, Pi-Chuan Chang, Michel Galley, Christopher Manning, Mirela-Stefania Duma, Wolfgang Menzel, Mirela-Stefania Duma, Wolfgang Menzel, Mirela-Stefania Duma, Wolfgang Menzel, Christian Federmann, Antonio Jimeno, Yepes, Aurelie Neveol, Mariana Neves, Karin Verspoor, Ondrej Bojar, Arthur Boyer, Cristian Grozea, Barry Haddow, Madeleine Kittner, Yvonne Lichtblau, Pavel Pecina, Roland Roller, Rudolf Rosa, Amy Siu, Philippe Thomas, Saskia Trescher, Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, F Andr, Alexandra Martins, Birch, Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander Rush, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondej Bojar, Alexandra Constantin, Evan Herbst, Quoc Le, Tomas Mikolov, Robert Leaman, Rezarta Islamaj Dogan, Zhiyong Lu, Roberto Navigli, Simone Paolo, Ponzetto, Aurlie Nvol, Antonio Yepes, Mariana Neves, Karin Verspoor, Mariana Neves, Mariana Neves, Antonio Jimeno Yepes, Aurlie Nvol, Cristian Grozea, Amy Siu, Madeleine Kittner, Karin Verspoor, Mariana Neves, Antonio Jimeno Yepes, Aurlie Nvol, Sadaf Noor-E-Hira, Kiran Abdul Rauf, Ammara Kiani, Raheel Zafar, Nawaz, Pavel Pecina, Ondej Duek, Lorraine Goeuriot, Jan Haji, Jaroslava Hlavov, J Gareth, Liadh Jones, Johannes Kelly, David Leveling, Michal Mareek, Martin Novk, Rudolf Popel, Ale Rosa, Zdeka Tamchyna, Ureov, Pavel Pecina, Antonio Toral, Vassilis Papavassiliou, Prokopis Prokopidis, Ales Tamchyna, Andy Way, Josef Van Genabith, Casimiro Pio Carrino, Bardia Rafieian, Marta Costajuss, Jos Fonollosa, Danielle Saunders, Felix Stahlberg, Bill Byrne, Felipe Soares, Martin Krallinger, Felipe Soares, Viviane Moreira, Karin Becker, Felipe Soares, Gabrielli Harumi Yamashita, Michel Jose, Anzanello, Jrg Tiedemann, Anne M Turner, Yong Choi, Kristin Dew, Ming-Tse Tsai, Alyssa Bosold, Shuyang Wu, Donahue Smith, Hendrika Meischke, Ashish Vaswani, Samy Bengio, Eugene Brevdo, Francois Chollet, Aidan Gomez, Stephan Gouws, Llion Jones, ukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Marta Villegas, Ander Intxaurrondo, Aitor Gonzalez-Agirre, Montserrat Marimn, Martin Krallinger, Mingxuan Wang, Li Gong, Wenhuan Zhu, Jun Xie, Chao Bian, Peng Wei, Liu Jianfeng, Li Liangyou, Liu Qun, Cuijun Wu, Fei Xia, Louise Deleger, Imre Solti, Weijia Xu, Marine Carpuat, Micha Ziemski, Marcin Junczys-Dowmunt, Bruno Pouliquen, Ergun Bic, ici, Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio, Kyunghyun Cho, Bart Van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio, Hyun Kim, Hun-Young Jung, Hongseok Kwon, Jong-Hyeok Lee, Seung-Hoon Na, Hyun Kim, Jong-Hyeok Lee, Hyun Kim, Jong-Hyeok Lee, Hyun Kim, Jong-Hyeok Lee, Seung-Hoon Na, Hyun Kim, Jong-Hyeok Lee, Seung-Hoon Na, L Maoxi, Xiang Qingyu, Chen Zhiming, Mingwen Wang, Lucia Specia, Kashif Shah, G Jose, Trevor De Souza, Cohn, Jiayi Wang, Kai Fan, Bo Li, Fengming Zhou, Boxing Chen, Yangbin Shi, Luo Si, Edouard Grave, Piotr Bojanowski, Prakhar Gupta, Armand Joulin, Tomas Mikolov, Julia Ive, Carolina Scarton, Frdric Blain, Lucia Specia, Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander Rush, John Lafferty, Andrew Mccallum, Fernando Pereira, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Lucia Specia, Frdric Blain, Varvara Logacheva, Ramn Astudillo, F Andr, Martins, Sepp Hochreiter, Jrgen Schmidhuber, Hyun Kim, Hun-Young Jung, Hongseok Kwon, Jong-Hyeok Lee, Seung-Hoon Na, Hyun Kim, Jong-Hyeok Lee, Hyun Kim, Jong-Hyeok Lee, Seung-Hoon Na, Anna Kozlova, Mariya Shmatova, Anton Frolov, Maoxi Li, Qingyu Xiang, Zhiming Chen, Mingwen Wang, Mike Schuster, Kuldip K Paliwal, Kashif Shah, Fethi Bougares, Loc Barrault, Lucia Specia, Kashif Shah, W Raymond, Fethi Ng, Lucia Bougares, Specia, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Lucia Specia, Gustavo Paetzold, Carolina Scarton, Lucia Specia, Kashif Shah, Jos Gc De Souza, Trevor Cohn, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Jiayi Wang, Kai Fan, Bo Li, Fengming Zhou, Boxing Chen, Yangbin Shi, Luo Si, John Blatz, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, Nicola Ueffing, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Ondrej Bojar, Rajen Chatterjee, Christian Federmann, Barry Haddow, Matthias Huck, Chris Hokamp, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Carolina Scarton, Lucia Specia, Marco Turchi, Ondej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Philipp Koehn, Christof Monz, Ondej Bojar, Yvette Graham, Amir Kamran, Ondej Bojar, Yvette Graham, Amir Kamran, Milo Stanojevi, Erick Fonseca, Lisa Yankovskaya, F Andr, Mark Martins, Christian Fishel, Federmann, Yvette Graham, Timothy Baldwin, Alistair Moffat, Justin Zobel, Julia Ive, Frdric Blain, Lucia Specia, Hyun Kim, Jong-Hyeok Lee, Seung-Hoon Na, P Diederik, Lei Kingma, Ba, Qingsong Ma, Ondej Bojar, Yvette Graham, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Maja Popovi, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Lucia Specia, Frdric Blain, Varvara Logacheva, Ramn Astudillo, Andr Martins, Lucia Specia, Marco Turchi, Nicola Cancedda, Marc Dymetman, Nello Cristianini, Milo Stanojevi, Amir Kamran, Philipp Koehn, Ondej Bojar, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Martn Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dandelion Man, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Vigas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, Xiaoqiang Zheng, Rajen Chatterjee, Matteo Negri, Raphael Rubino, Marco Turchi, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Hyun Kim, Jong-Hyeok Lee, Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, Luke Zettlemoyer, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Ilya Sutskever, Oriol Vinyals, Quoc V Le, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Jiayi Wang, Kai Fan, Bo Li, Fengming Zhou, Boxing Chen, Yangbin Shi, Luo Si, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Rajen Chatterjee, Matteo Negri, Raphael Rubino, Marco Turchi, Marcin Junczys-Dowmunt, Roman Grundkiewicz, Marcin Junczys-Dowmunt, Roman Grundkiewicz, Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander Rush, Taku Kudo, Jindich Libovick, Jindich Helcl, Marek Tlust, Ondej Bojar, Pavel Pecina, Matteo Negri, Marco Turchi, Rajen Chatterjee, Nicola Bertoldi, Santanu Pal, Nico Herbig, Antonio Krger, Josef Van Genabith, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Jaehun Shin, Jong-Hyeok Lee, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Amirhossein Tebbifakhr, Ruchit Agrawal, Matteo Negri, Marco Turchi, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Barret Zoph, Kevin Knight, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Aurelie Neveol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi, Karin Verspoor, Marcos Zampieri, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Barry Haddow, Matthias Huck, Chris Hokamp, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Carolina Scarton, Lucia Specia, Marco Turchi, Rajen Chatterjee, Matteo Negri, Raphael Rubino, Marco Turchi, Rajen Chatterjee, Matteo Negri, Raphael Rubino, Marco Turchi, Correia Gonc, Andr Martins, Marcin Junczys-Dowmunt, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Fabio Kepler, Jonay Trnous, Marcos Treviso, Miguel Vera, Antnio Gis, M Amin Farajian, Antnio Lopes, F Andr, Martins, Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander Rush, Kevin Knight, Ishwar Chander, Matteo Negri, Marco Turchi, Rajen Chatterjee, Nicola Bertoldi, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Ofir Press, Lior Wolf, Rico Sennrich, Barry Haddow, Alexandra Birch, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Amirhossein Tebbifakhr, Ruchit Agrawal, Matteo Negri, Marco Turchi, Amittai Axelrod, Xiaodong He, Jianfeng Gao, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Raphael Rubino, Lucia Specia, Marco Turchi, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Barry Haddow, Matthias Huck, Chris Hokamp, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Carolina Scarton, Lucia Specia, Marco Turchi, M Rajen Chatterjee, Matteo Amin Farajian, Marco Negri, Ankit Turchi, Santanu Srivastava, Pal, Rajen Chatterjee, Matteo Negri, Raphael Rubino, Marco Turchi, Jonathan Clark, Chris Dyer, Alon Lavie, Noah Smith, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Kevin Knight, Ishwar Chander, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondej Bojar, Alexandra Constantin, Evan Herbst, Jindich Libovick, Jindich Helcl, Marek Tlust, Ondej Bojar, Pavel Pecina, Matteo Negri, Marco Turchi, Rajen Chatterjee, Nicola Bertoldi, Jan Niehues, Eunah Cho, Thanh-Le Ha, Alex Waibel, Santanu Pal, Nico Herbig, Antonio Krger, Josef Van Genabith, Santanu Pal, Sudip Naskar, Josef Van Genabith, Santanu Pal, Sudip Kumar Naskar, Josef Van Genabith, Santanu Pal, Sudip Kumar Naskar, Mihaela Vela, Josef Van Genabith, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Carla Parra, Escartn, Manuel Arcedillo, Carla Parra, Escartn, Manuel Arcedillo, Rico Sennrich, Barry Haddow, Alexandra Birch, Jaehun Shin, Jong-Hyeok Lee, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Amirhossein Tebbifakhr, Ruchit Agrawal, Rajen Chatterjee, Matteo Negri, Marco Turchi, Dusan Varis, Ondej Bojar, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Arianna Bisazza, Mauro Cettolo, Marcello Federico, David Blei, Andrew Ng, Michael Jordan, Rajen Chatterjee, Matteo Negri, Raphael Rubino, Marco Turchi, Kenneth Heafield, Melvin Johnson, Mike Schuster, Quoc Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Vigas, Martin Wattenberg, Greg Corrado, Macduff Hughes, Jeffrey Dean, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, Evan Herbst, Giulia Mattoni, Pat Nagle, Carlos Collantes, Dimitar Shterionov, Tomas Mikolov, Geoffrey Zweig, Matteo Negri, Marco Turchi, Rajen Chatterjee, Nicola Bertoldi, Josef Franz, Och, Josef Franz, Hermann Och, Ney, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Daria Pylypenko, Raphael Rubino, Rico Sennrich, Barry Haddow, Alexandra Birch, Rico Sennrich, Barry Haddow, Alexandra Birch, Dimitar Shterionov, Riccardo Superbo, Pat Nagle, Laura Casanellas, O' Tony, Andy Dowd, Way, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, M Rajen Chatterjee, Matteo Amin Farajian, Marco Negri, Ankit Turchi, Santanu Srivastava, Pal, Rajen Chatterjee, Matteo Negri, Raphael Rubino, Marco Turchi, Rajen Chatterjee, Matteo Negri, Marco Turchi, Frdric Blain, Lucia Specia, Boxing Chen, Colin Cherry, Marco Amin Farajian, Matteo Turchi, Marcello Negri, Federico, Melvin Johnson, Mike Schuster, Quoc Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Vigas, Martin Wattenberg, Greg Corrado, Macduff Hughes, Jeffrey Dean, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander Rush, Santanu Pal, Sudip Kumar Naskar, Mihaela Vela, Josef Van Genabith, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Rico Sennrich, Barry Haddow, Alexandra Birch, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Amirhossein Tebbifakhr, Ruchit Agrawal, Matteo Negri, Marco Turchi, Marco Turchi, Matteo Negri, Marcello Federico, Marco Turchi, Matteo Negri, Marcello Federico, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Curran Associates, Alexandre Berard, Laurent Besacier, Olivier Pietquin, Rajen Chatterjee, Matteo Negri, Raphael Rubino, Marco Turchi, Mia Xu, Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes, Yong Cheng, Zhaopeng Tu, Fandong Meng, Junjie Zhai, Yang Liu, Zi-Yi Dou, Zhaopeng Tu, Xing Wang, Shuming Shi, Tong Zhang, Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann Dauphin, Xinwei Geng, Xiaocheng Feng, Bing Qin, Ting Liu, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, Marcin Junczys, -Dowmunt, Roman Grundkiewicz, P Diederik, Jimmy Kingma, Ba, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, Evan Herbst, Minh-Thang Luong, Christopher Manning, Matteo Negri, Marco Turchi, Rajen Chatterjee, Nicola Bertoldi, Santanu Pal, Sudip Kumar Naskar, Mihaela Vela, Josef Van Genabith, Rico Sennrich, Barry Haddow, Alexandra Birch, C Szegedy, V Vanhoucke, S Ioffe, J Shlens, Z Wojna, Rajen Chatterjee, Matteo Negri, Marco Turchi, Marcello Federico, Lucia Specia, Frdric Blain, Anna Currey, Antonio Valerio Miceli, Kenneth Barone, Heafield, Tobias Domhan, Felix Hieber, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondej Bojar, Alexandra Constantin, Evan Herbst, Philipp Koehn, Rebecca Knowles, Roberto Navigli, Simone Paolo, Ponzetto, Mariana Neves, Antonio Jimeno Yepes, Aurlie Nvol, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Felipe Soares, Viviane Moreira, Karin Becker, Jrg Tiedemann, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, Ukasz Kaiser, Illia Polosukhin, Marta Villegas, Ander Intxaurrondo, Aitor Gonzalez-Agirre, Montserrat Marimon, Martin Krallinger, Rui Wang, Andrew Finch, Masao Utiyama, Eiichiro Sumita, Sadaf Abdul, -Rauf, Holger Schwenk, Sadaf Abdul-Rauf, Holger Schwenk, Patrik Lambert, Mohammad Nawaz, Sadaf Abdul-Rauf, Holger Schwenk, Mohammad Nawaz, Tagyoung Chung, Daniel Gildea, Praveen Dakwale, Christof Monz, Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann Dauphin, Cristian Grozea, Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tieyan Liu, Wei-Ying Ma, Almut Silja Hildebrand, Matthias Eck, Stephan Vogel, Alex Waibel, Matthias Huck, Fabienne Braune, Alexander Fraser, Matthias Huck, Dario Stojanovski, Viktor Hangya, Alexander Fraser, Nal Kalchbrenner, Phil Blunsom, Abdul Khan, Subhadarshi Panda, Jia Xu, Lampros Flokas, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Patrik Lambert, Holger Schwenk, Christophe Servan, Sadaf Abdul-Rauf, Yajuan Lu, Jin Huang, Qun Liu, Mariana Neves, Antonio Jimeno Yepes, Aurlie Nvol, Ilya Sutskever, Oriol Vinyals, Quoc V Le, Jrg Tiedemann, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Yijun Wang, Yingce Xia, Li Zhao, Jiang Bian, Tao Qin, Guiquan Liu, Liu, Antonio Jimeno, Yepes, Aurlie Nvol, Mariana Neves, Karin Verspoor, Ondrej Bojar, Arthur Boyer, Cristian Grozea, Barry Haddow, Madeleine Kittner, Yvonne Lichtblau, Nasser Zalmout, Nizar Habash, Chenhui Chu, Rui Wang, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, Evan Herbst, Philipp Koehn, Rebecca Knowles, Minh-Thang Luong, Christopher Manning, Mariana Neves, Antonio Jimeno-Yepes, Aurlie Nvol, Cristian Grozea, Amy Siu, Madeleine Kittner, Karin Verspoor, Rico Sennrich, Barry Haddow, Alexandra Birch, Derek Liang Tian, Lidia Wong, Paulo Chao, Francisco Quaresma, Yi Oliveira, Shuo Lu, Yiming Li, Longyue Wang, Wang, Jrg Tiedemann, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Cyril Allauzen, Michael Riley, Chenhui Chu, Raj Dabre, Sadao Kurohashi, Kenneth Heafield, Marcin Junczys-Dowmunt, Tomasz Dwojak, Rico Sennrich, Abdul Khan, Subhadarshi Panda, Jia Xu, Lampros Flokas, Catherine Kobus, Josep Crego, Jean Senellart, Minh-Thang Luong, Christopher Manning, Mariana Neves, Antonio Jimeno-Yepes, Aurlie Nvol, Antonio Jimeno, Yepes, Aurlie Nvol, Mariana Neves, Karin Verspoor, Ondrej Bojar, Arthur Boyer, Cristian Grozea, Barry Haddow, Madeleine Kittner, Yvonne Lichtblau, Barret Zoph, Deniz Yuret, Jonathan May, Kevin Knight, Cristina Marta R Costa-Juss, Pranava Espaa-Bonet, Carlos Madhyastha, Jos Ar Escolano, Fonollosa, Julia Ive, Aurlien Max, Franc ois Yvon, Mariana Neves, Antonio Jimeno Yepes, Aurlie Nvol, Cristian Grozea, Amy Siu, Madeleine Kittner, Karin Verspoor, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Rico Sennrich, Barry Haddow, Alexandra Birch, Felipe Soares, Karin Becker, Felipe Soares, Viviane Moreira, Karin Becker, Felipe Soares, Gabrielli Yamashita, Michel Anzanello, Jrg Tiedemann, Brian Tubay, Marta Costa-Juss, Olatz Perez-De Viaspre, Gorka Labaka, Parnia Bahar, Christopher Brix, Hermann Ney, Maha Elbayad, Laurent Besacier, Jakob Verbeek, P Diederik, Jimmy Kingma, Ba, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, Evan Herbst, Minh-Thang Luong, Christopher Manning, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Rico Sennrich, Barry Haddow, Alexandra Birch, Rico Sennrich, Barry Haddow, Alexandra Birch, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, Ruslan Salakhutdinov, Andreas Stolcke, Jing Zheng, Wen Wang, Victor Abrash, Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, Zbigniew Wojna, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, Lukasz Kaiser, Illia Polosukhin, Mikel Artetxe, Gorka Labaka, Eneko Agirre, Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio, Loc Barrault, Ondej Bojar, Marta Costa-Juss, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Mller, Santanu Pal, Matt Post, Marcos Zampieri, Kyunghyun Cho, Bart Van Merrienboer, aglar Glehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio, Anna Currey, Antonio Valerio Miceli, Kenneth Barone, Heafield, Pablo Gamallo, Jos Pichel, Iaki Alegria, Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann Dauphin, Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tie-Yan Liu, Wei-Ying Ma, Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, Sepp Hochreiter, Jrgen Schmidhuber, Nal Kalchbrenner, Phil Blunsom, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Philipp Koehn, Franz Och, Daniel Marcu, Shankar Kumar, William Byrne, Guillaume Lample, Myle Ott, Alexis Conneau, Ludovic Denoyer, Marc'aurelio Ranzato, Thang Luong, Hieu Pham, Christopher Manning, Benjamin Marie, Atsushi Fujita, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Rico Sennrich, Barry Haddow, Alexandra Birch, Rico Sennrich, Barry Haddow, Alexandra Birch, Ilya Sutskever, Oriol Vinyals, Quoc V Le, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Jie Zhou, Ying Cao, Xuguang Wang, Peng Li, Wei Xu, Aliya Deri, Kevin Knight, Chris Dyer, Victor Chahuneau, Noah Smith, Kenneth Heafield, Ivan Pouzyrevsky, Jonathan Clark, Philipp Koehn, Klra Jgrov, Melvin Johnson, Mike Schuster, V Quoc, Maxim Le, Yonghui Krikun, Zhifeng Wu, Nikhil Chen, Fernanda Thorat, Martin Vigas, Greg Wattenberg, Corrado, Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, F Andr, Alexandra Martins, Birch, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondej Bojar, Alexandra Constantin, Evan Herbst, Josef Franz, Och, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Rico Sennrich, Barry Haddow, Alexandra Birch, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, Ukasz Kaiser, Illia Polosukhin, Curran Associates, Mikel Artetxe, Gorka Labaka, Eneko Agirre, Loc Barrault, Ondej Bojar, Marta Costa-Juss, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Mller, Santanu Pal, Matt Post, Marcos Zampieri, Piotr Bojanowski, Edouard Grave, Armand Joulin, Tomas Mikolov, Franck Burlot, Franc ois Yvon, Yong Cheng, Qian Yang, Yang Liu, Maosong Sun, Wei Xu, Anna Currey, Antonio Valerio Miceli, Kenneth Barone, Heafield, Tobias Domhan, Felix Hieber, Duy Vu Cong, Philipp Hoang, Gholamreza Koehn, Trevor Haffari, Cohn, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Anoop Kunchukuttan, Pratik Mehta, Pushpak Bhattacharyya, Guillaume Lample, Myle Ott, Alexis Conneau, Ludovic Denoyer, Thang Luong, Hieu Pham, Christopher Manning, Rico Sennrich, Barry Haddow, Alexandra Birch, Rico Sennrich, Barry Haddow, Alexandra Birch, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Jiajun Zhang, Chengqing Zong, Barret Zoph, Deniz Yuret, Jonathan May, Kevin Knight, Loc Barrault, Ondej Bojar, Marta Costa-Juss, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Mller, Santanu Pal, Matt Post, Marcos Zampieri, Kyunghyun Cho, Bart Van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio, Jignashu Shachi Dave, Pushpak Parikh, Bhattacharyya, Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, F Andr, Alexandra Martins, Birch, Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander Rush, Thang Luong, Hieu Pham, Christopher Manning, Sainik Kumar Mahata, Dipankar Das, Sivaji Bandyopadhyay, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Amarnath Pathak, Partha Pakray, Amarnath Pathak, Partha Pakray, Jereemi Bentham, Mikel Artetxe, Gorka Labaka, Eneko Agirre, Mikel Artetxe, Gorka Labaka, Eneko Agirre, Colin Cherry, George Foster, Kenneth Heafield, Ivan Pouzyrevsky, Jonathan Clark, Philipp Koehn, Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, F Andr, Alexandra Martins, Birch, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, Evan Herbst, Philipp Koehn, Rebecca Knowles, Benjamin Marie, Atsushi Fujita, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Rico Sennrich, Barry Haddow, Alexandra Birch, Rico Sennrich, Barry Haddow, Alexandra Birch, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Loc Barrault, Ondej Bojar, Marta Costa-Juss, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Mller, Santanu Pal, Matt Post, Marcos Zampieri, Kenneth Heafield, Sepp Hochreiter, Jrgen Schmidhuber, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Philipp Koehn, Franz, Josef Och, Daniel Marcu, Toshiaki Nakazawa, Shohei Higashiyama, Chenchen Ding, Raj Dabre, Anoop Kunchukuttan, W Pa, Isao Goto, K Hideya Mino, Sadao Sudoh, Kurohashi, Josef Franz, Hermann Och, Ney, Atul Kr Ojha, Dutta Koel, Chao-Hong Chowdhury, Karan Liu, Saxena, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Amittai Axelrod, Xiaodong He, Jianfeng Gao, Loc Barrault, Ondej Bojar, Marta Costa-Juss, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Mller, Santanu Pal, Matt Post, Marcos Zampieri, Ondej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Ondrej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Marta Costa-Juss, Marta Costa-Juss, Marcos Zampieri, Santanu Pal, Federico Fancellu, Andy Way, Morgan Obrien, Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, P Diederik, Jimmy Kingma, Ba, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondej Bojar, Alexandra Constantin, Evan Herbst, Santanu Pal, Sudip Naskar, Josef Van Genabith, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Rico Sennrich, Barry Haddow, Alexandra Birch, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, Ruslan Salakhutdinov, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Marcos Zampieri, Shervin Malmasi, Preslav Nakov, Ahmed Ali, Suwon Shon, James Glass, Yves Scherrer, Tanja Samardi, Nikola Ljubei, Jrg Tiedemann, Chris Van Der Lee, Stefan Grondelaers, Nelleke Oostdijk, Dirk Speelman, Antal Van Den, Ritesh Bosch, Bornini Kumar, Mayank Lahiri, Jain, Marcos Zampieri, Shervin Malmasi, Yves Scherrer, Tanja Samardi, Francis Tyers, Miikka Silfverberg, Natalia Klyueva, Tung-Le Pan, Chu-Ren Huang, Radu, Tudor Ionescu, Andrei Butnaru, Tommi Jauhiainen, Loc Barrault, Ondej Bojar, Marta Costa-Juss, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Mller, Santanu Pal, Matt Post, Marcos Zampieri, Ondej Bojar, Vojtch Diatka, Pavel Rychl, Pavel Strak, Vt Suchomel, Ale Tamchyna, Daniel Zeman, Ondej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Philipp Koehn, Christof Monz, Vishal Goyal, Gurpreet Singh, Lehal, Jan Haji, Petr Homola, Vladislav Kubo, Duy Vu Cong, Philipp Hoang, Gholamreza Koehn, Trevor Haffari, Cohn, Sepp Hochreiter, Jrgen Schmidhuber, Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander Rush, Philipp Koehn, Nima Pourdamghani, Kevin Knight, Rudolf Rosa, Ralf Steinberger, Bruno Pouliquen, Anna Widiger, Camelia Ignat, Toma Erjavec, Dan Tufis, Dniel Varga, Jrg Tiedemann, Oriol Vinyals, ukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, Geoffrey Hinton, Matteo Duygu Ataman, Marco Negri, Marcello Turchi, Federico, Jonathan Clark, Chris Dyer, Alon Lavie, Noah Smith, Marta Costa-Juss, Carlos Escolano, Jos Fonollosa, Marta Costa-Juss, A Jos, Fonollosa, Mathias Creutz, Teemu Hirsimki, Mikko Kurimo, Antti Puurula, Janne Pylkknen, Vesa Siivola, Matti Varjokallio, Ebru Arisoy, Murat Sarac, Andreas Stolcke, Mathias Creutz, Krista Lagus, Mathias Creutz, Krista Lagus, Philip Gage, Stig-Arne Grnroos, Sami Virpioja, Mikko Kurimo, Stig-Arne Grnroos, Sami Virpioja, Mikko Kurimo, Stig-Arne Grnroos, Sami Virpioja, Peter Smit, Mikko Kurimo, Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander Rush, Sami Oskar Kohonen, Krista Virpioja, Lagus, Taku Kudo, Taku Kudo, John Richardson, Mikko Kurimo, Antti Puurula, Ebru Arisoy, Vesa Siivola, Teemu Hirsimki, Janne Pylkknen, Tanel Alume, Murat Saraclar, Jason Lee, Kyunghyun Cho, Thomas Hofmann, Robert stling, Jrg Tiedemann, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Maja Popovi, Matt Post, Nima Pourdamghani, Kevin Knight, Alessandro Raganato, Yves Scherrer, Tommi Nieminen, Arvi Hurskainen, Jrg Tiedemann, Rico Sennrich, Barry Haddow, Alexandra Birch, Peter Smit, Sami Virpioja, Mikko Kurimo, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Gongbo Tang, Fabienne Cap, Eva Pettersson, Joakim Nivre, Jrg Tiedemann, Matti Varjokallio, Mikko Kurimo, Sami Virpioja, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, Ukasz Kaiser, Illia Polosukhin, Weiyue Wang, Jan-Thorsten Peter, Hendrik Rosendahl, Hermann Ney, Mikel Artetxe, Holger Schwenk, Amittai Axelrod, Xiaodong He, Jianfeng Gao, Andoni Azpeitia, Eva Thierry Etchegoyhen, Garcia Martnez, Christian Buck, Philipp Koehn, Grant Erdmann, Jeremy Gwinnup, Kenneth Heafield, Marcin Junczys-Dowmunt, Philipp Koehn, Francisco Guzmn, Vishrav Chaudhary, Juan Pino, Philipp Koehn, Huda Khayrallah, Kenneth Heafield, Mikel Forcada, Taku Kudo, John Richardson, Chi-Kiu Lo, Michel Simard, Darlene Stewart, Samuel Larkin, Cyril Goutte, Patrick Littell, C Robert, William Moore, Lewis, Kishore Papineni, Salim Roukos, Todd Ward, Weijing Zhu, Luca Santamara, Amittai Axelrod, Abhinav Sethy, G Panayiotis, Shrikanth Georgiou, Narayanan, Xuan Zhang, Pamela Shapiro, Gaurav Kumar, Paul Mcnamee, Marine Carpuat, Kevin Duh, Mikel Artetxe, Gorka Labaka, Eneko Agirre, Cyril Goutte, Marine Carpuat, George Foster, Philipp Koehn, Huda Khayrallah, Kenneth Heafield, Mikel Forcada, Samuel Larkin, Boxing Chen, George Foster, Uli Germann, Eric Joanis, J Johnson, Roland Kuhn, Chi-Kiu Lo, Chi-Kiu Lo, Cyril Goutte, Michel Simard, Chi-Kiu Lo, Michel Simard, Darlene Stewart, Samuel Larkin, Cyril Goutte, Patrick Littell, Minh-Thang Luong, Hieu Pham, Christopher Manning, Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, Jeffrey Dean, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Rico Sennrich, Barry Haddow, Alexandra Birch, Rico Sennrich, Barry Haddow, Alexandra Birch, Michel Simard, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser, Illia Polosukhin, Philip Williams, Rico Sennrich, Maria Nadejde, Matthias Huck, Barry Haddow, Ondej Bojar, Hainan Xu, Philipp Koehn, Mikel Artetxe, Gorka Labaka, Eneko Agirre, Kyunghyun Cho, Kenneth Heafield, Ivan Pouzyrevsky, Jonathan Clark, Philipp Koehn, Marcin Junczys-Dowmunt, Huda Khayrallah, Philipp Koehn, Huda Khayrallah, Hainan Xu, Philipp Koehn, Philipp Koehn, Francisco Guzmn, Vishrav Chaudhary, Juan Pino, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Ondrej Bojar, Chris Dyer, Alexandra Constantin, Evan Herbst, Philipp Koehn, Huda Khayrallah, Kenneth Heafield, Mikel Forcada, Guillaume Lample, Myle Ott, Alexis Conneau, Ludovic Denoyer, Marc'aurelio Ranzato, Fantine Mordelet, J-P Vert, Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli, Matt Post, M Vctor, Marta Snchez-Cartagena, Sergio Ban, Gema Rojas, Ramrez, Holger Schwenk, Hainan Xu, Philipp Koehn, Ondej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Christof Monz, Michael Denkowski, Alon Lavie, Nadir Durrani, Helmut Schmid, Alexander Fraser, Grant Erdmann, Jeremy Gwinnup, Michel Galley, Christopher Manning, Jeremy Gwinnup, Tim Anderson, Grant Erdmann, Katherine Young, Michaeel Kazi, Elizabeth Salesky, Brian Thompson, Jeremy Gwinnup, Tim Anderson, Grant Erdmann, Katherine Young, Christina May, Michaeel Kazi, Elizabeth Salesky, Brian Thompson, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondej Bojar, Alexandra Constantin, Evan Herbst, Taku Kudo, John Richardson, Maja Popovi, Milo Stanojevi, Khalil Sima'an, Hainan Xu, Philipp Koehn, Ondej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Christof Monz, Mathias Mller, Matt Post, F Peter, Brown, J Vincent, Stephen Della Pietra, Robert Della Pietra, Mercer, Guillem Gasc, Martha-Alicia Rocha, Germn Sanchis-Trilles, Jess Andrs-Ferrer, Francisco Casacuberta, Barry Haddow, Philipp Koehn, Gholamreza Haffari, Maxim Roy, Anoop Sarkar, Marcin Junczys-Dowmunt, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, Evan Herbst, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Nick Rossenbach, Jan Rosendahl, Yunsu Kim, Miguel Graa, Aman Gokrani, Hermann Ney, Rico Sennrich, Barry Haddow, Alexandra Birch, Piotr Bojanowski, Edouard Grave, Armand Joulin, Tomas Mikolov, Houda Bouamor, Hassan Sajjad, Philipp Koehn, Huda Khayrallah, Kenneth Heafield, Mikel Forcada, Robert stling, Jrg Tiedemann, Marcis Pinnis, Milo Radovanovi, Alexandros Nanopoulos, Mirjana Ivanovi, Holger Schwenk, Hainan Xu, Philipp Koehn, Raivis Ieva Zarin a, Skadin, Amittai Axelrod, Xiaodong He, Jianfeng Gao, Mara Chinea-Rios, Germn Sanchis-Trilles, Francisco Casacuberta, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chin-Yew Lin, Franz Josef, Och, Robert Moore, William Lewis, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Matt Post, Rico Sennrich, Barry Haddow, Alexandra Birch, Mikel Artetxe, Gorka Labaka, Eneko Agirre, Kyunghyun Cho, Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio, Kyunghyun Cho, Bart Van Merrinboer, Dzmitry Bahdanau, Yoshua Bengio, Christos Christodouloupoulos, Mark Steedman, Kenneth Heafield, Nal Kalchbrenner, Phil Blunsom, Huda Khayrallah, Philipp Koehn, Reinhard Kneser, Hermann Ney, Philipp Koehn, Francisco Guzmn, Vishrav Chaudhary, Juan Pino, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Philipp Koehn, Franz, Josef Och, Daniel Marcu, Guillaume Lample, Alexis Conneau, Ludovic Denoyer, Marc'aurelio Ranzato, Vladimir I Levenshtein, Pierre Lison, Jrg Tiedemann, Milen Kouylekov, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Matt Post, Ilya Sutskever, Oriol Vinyals, Quoc V Le, Hirotugu Akaike, Huda Khayrallah, Philipp Koehn, Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondej Bojar, Alexandra Constantin, Evan Herbst, Philipp Koehn, Huda Khayrallah, Kenneth Heafield, Mikel Forcada, Marco Lui, Timothy Baldwin, Robert stling, Jrg Tiedemann, Gideon Schwarz, Rico Sennrich, Barry Haddow, Alexandra Birch, Vesa Siivola, Mathias Creutz, Mikko Kurimo, Vesa Siivola, Teemu Hirsimki, Sami Virpioja - 2019 cited by 30

We report the results of the WMT19 shared task on Quality Estimation, i.e. the task of predicting the quality of the output of machine translation systems given just the source text and the hypothesis translations. The task includes estimation at three granularity levels: word, sentence and document. A novel addition is evaluating sentence-level QE against human judgments: in other words, designing MT metrics that do not need a reference translation. This year we include three language pairs, produced solely by neural machine translation systems. Participating teams from eight institutions submitted a variety of systems to different task variants and language pairs.