Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval@ACL 2016, Berlin, Germany, August 2016

著者: Omer Levy, Anna Korhonen, Billy Chiu, Sampo Pyysalo, Ondřej Bojar, Christian Buck, Christian Federmann, Barry Haddow, Philipp Koehn, Miroslav Batchkarov, Thomas Kober, Jeremy Reffin, Julie Weeds, David Weir, Jens Kober, D Weeds, Noam Shazeer, Ryan Doherty, Colin Evans, Chris Waterson, Andreas Stolcke, Noah Coccaro, Rebecca L. Bates, Paul Taylor, Carol Van Ess-Dykema, Klaus Ries, Tal Linzen, Lscp Ijn, Gabor Angeli, Christopher D. Manning, Nasrin Mostafazadeh, Lucy Vanderwende, Wen-tau Yih, Pushmeet Kohli, James Allen, Manaal Faruqui, Yulia Tsvetkov, Pushpendre Rastogi, Chris Dyer, Anna Gladkova, Eneko Agirre, Enrique Alfonseca, Keith Hall, Jana Kravalova, Marius Pas, Aitor Soroa, Steven Bird, Joseph Turian, Lev Ratinov, Yoshua Bengio, D Peter, Turney, Dongqiang Yang, David Mw Powers, Elia Bruni, Nam-Khanh Tran, Marco Baroni, Marco Baroni, Silvia Bernardini, Adriano Ferraresi, Eros Zanchetta, Marco Baroni, Georgiana Dinu, Germn Kruszewski, Ewan Dunbar, Gabriel Synnaeve, Emmanuel Dupoux, Manaal Faruqui, Jesse Dodge, Sujay Kumar Jauhar, Chris Dyer, Eduard Hovy, Noah Smith, Anna Gladkova, Aleksandr Drozd, Satoshi Matsuoka, Omer Levy, Yoav Goldberg, Omer Levy, Yoav Goldberg, Ido Dagan, Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, Phil Blunsom, Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck, Marco Marelli, Stefano Menini, Marco Baroni, Luisa Bentivogli, Raffaella Bernardi, Roberto Zamparelli, Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory Corrado, Jeffrey Dean, Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen, Matthew Richardson, J Christopher, Erin Burges, Renshaw, Eneko Agirre, Enrique Alfonseca, Keith Hall, Jana Kravalova, Marius Paca, Aitor Soroa, Simon Baker, Roi Reichart, Anna Korhonen, Taylor Berg-Kirkpatrick, David Burkett, Dan Klein, Elia Bruni, Gemma Boleda, Marco Baroni, Nam-Khanh Tran, Jonathan H Clark, Chris Dyer, Alon Lavie, Noah Smith, Ronan Collobert, Jason Weston, Manaal Faruqui, Chris Dyer, Manaal Faruqui, Chris Dyer, Lev Finkelstein, Evgeniy Gabrilovich, Yossi Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, Eytan Ruppin, Guy Halawi, Gideon Dror, Evgeniy Gabrilovich, Yehuda Koren, Zellig Harris, Eric Huang, Richard Socher, Christopher Manning, Andrew Ng, Sujay Kumar, Jauhar, Chris Dyer, Eduard Hovy, Omer Levy, Yoav Goldberg, Omer Levy, Yoav Goldberg, Omer Levy, Yoav Goldberg, Ido Dagan, Ang Lu, Weiran Wang, Mohit Bansal, Kevin Gimpel, Karen Livescu, Minh-Thang Luong, Richard Socher, Christopher Manning, Tomas Mikolov, Wen-Tau Yih, Geoffrey Zweig, George Miller, Walter Charles, Arvind Neelakantan, Jeevan Shankar, Alexandre Passos, Andrew Mccallum, Jeffrey Pennington, Richard Socher, Christopher Manning, Kira Radinsky, Eugene Agichtein, Evgeniy Gabrilovich, Shaul Markovitch, Milo Radovanovi, Alexandros Nanopoulos, Mirjana Ivanovi, Pushpendre Rastogi, Benjamin Van Durme, Raman Arora, Joseph Reisinger, Raymond Mooney, Sascha Rothe, Hinrich Schtze, Herbert Rubenstein, John Goodenough, Tobias Schnabel, Igor Labutov, David Mimno, Thorsten Joachims, Anders Sgaard, Anders Johannsen, Barbara Plank, Dirk Hovy, Hctor Martnez, Alonso, H James, Steiger, Karl Stratos, Michael Collins, Daniel Hsu, Nenad Tomaev, Milo Radovanovic, Dunja Mladenic, Mirjana Ivanovic, Yulia Tsvetkov, Manaal Faruqui, Wang Ling, Guillaume Lample, Chris Dyer, Joseph Turian, Lev Ratinov, Yoshua Bengio, D Peter, Patrick Turney, Pantel, Dongqiang Yang, David Powers, Marco Baroni, Alessandro Lenci, Marco Baroni, Silvia Bernardini, Adriano Ferraresi, Eros Zanchetta, Tobias Schnabel, Igor Labutov, David Mimno, Thorsten Joachims, Yulia Tsvetkov, Manaal Faruqui, Wang Ling, Guillaume Lample, Chris Dyer, D Peter, Patrick Turney, Pantel, Others, Christian Wartena, Daniele Alfarone, Jesse Davis, Marco Baroni, Georgiana Dinu, Germn Kruszewski, Miroslav Batchkarov, Thomas Kober, Jeremy Reffin, Julie Weeds, David Weir, Antoine Bordes, Jason Weston, Ronan Collobert, Yoshua Bengio, Antoine Bordes, Sumit Chopra, Jason Weston, Jos Camacho-Collados, Mohammad Taher Pilehvar, Roberto Navigli, Jos Camacho-Collados, Mohammad Taher Pilehvar, Roberto Navigli, Jonathan Chang, Sean Gerrish, Chong Wang, Jordan Boyd-Graber, David Blei, Billy Chiu, Anna Korhonen, Sampo Pyysalo, C Crouch, James Curran, Marc Moens, C Scott, Susan Deerwester, Thomas Dumais, George Landauer, Richard Furnas, Harshman, Katrin Erk, Luis Espinosa-Anke, Horacio Saggion, Francesco Ronzano, Roberto Navigli, Manaal Faruqui, Yulia Tsvetkov, Dani Yogatama, Chris Dyer, Noah Smith, Lev Finkelstein, Gabrilovich Evgeniy, Matias Yossi, Rivlin Ehud, Solan Zach, Wolfman Gadi, Ruppin Eytan, Ruiji Fu, Jiang Guo, Bing Qin, Wanxiang Che, Haifeng Wang, Ting Liu, Alona Fyshe, Leila Wehbe, Partha Talukdar, Brian Murphy, Tom Mitchell, Lushan Han, Abhay Kashyap, Tim Finin, James Mayfield, Jonathan Weese, Zellig Harris, Felix Hill, Roi Reichart, Anna Korhonen, Angelos Hliaoutakis, Giannis Varelas, Epimenidis Voutsakis, G Euripides, Evangelos Petrakis, Milios, Eric Huang, Richard Socher, Christopher Manning, Andrew Ng, Ignacio Iacobacci, Mohammad Taher Pilehvar, Roberto Navigli, P Michael, James Jones, Martin, H Alberto, Laender, A Berthier, Altigran Ribeiro-Neto, Juliana Da Silva, Teixeira, Alon Lavie, Michael Denkowski, Omer Levy, Yoav Goldberg, Ido Dagan, Gideon Mann, Diana Mccarthy, Roberto Navigli, Michael Mohler, Razvan Bunescu, Rada Mihalcea, Brian Murphy, Partha Pratim Talukdar, Tom Mitchell, Roberto Navigli, Patrick Pantel, Dekang Lin, Siddharth Patwardhan, Satanjeev Banerjee, Ted Pedersen, Marco Pennacchiotti, Diego Cao, Roberto Basili, Danilo Croce, Michael Roth, Jeffrey Pennington, Richard Socher, Christopher Manning, Kira Radinsky, Eugene Agichtein, Evgeniy Gabrilovich, Shaul Markovitch, C Jack, Richards, Yulia Tsvetkov, Manaal Faruqui, Wang Ling, Guillaume Lample, Chris Dyer, D Peter, Patrick Turney, Pantel, D Peter, Michael Turney, Jeffrey Littman, Victor Bigham, Shnayder, Paola Velardi, Stefano Faralli, Roberto Navigli, David Weiss, Chris Alberti, Michael Collins, Slav Petrov, John Wieting, Mohit Bansal, Kevin Gimpel, Karen Livescu, Dan Roth, Jinxi Xu, W Croft, Will Zou, Richard Socher, Daniel Cer, Christopher Manning, Marco Baroni, Alessandro Lenci, Marco Baroni, Silvia Bernardini, Adriano Ferraresi, Eros Zanchetta, Marco Baroni, Raffaela Bernardi, Roberto Zamparelli, Marco Baroni, Georgiana Dinu, Germn Kruszewski, Miroslav Batchkarov, Thomas Kober, Jeremy Reffin, Julie Weeds, David Weir, S George, Ken Cree, Mcrae, Manaal Faruqui, Yulia Tsvetkov, Pushpendre Rastogi, Chris Dyer, Vamshi Ambati, Stephan Vogel, Jaime Carbonell, Chris Biemann, Chris Callison-Burch, Ronan Collobert, Jason Weston, Lon Bottou, Michael Karlen, Koray Kavukcuoglu, Pavel Kuksa, Bharath Dandala, Chris Hokamp, Rada Mihalcea, Razvan Bunescu, Bharath Dandala, Rada Mihalcea, Razvan Bunescu, S Paramveer, Jordan Dhillon, Dean Rodu, Lyle Foster, Ungar, S Paramveer, Dean Dhillon, Lyle Foster, Ungar, Miriam Faust, Christine Chiarello, Samuel Fernando, Mark Stevenson, Eric Huang, Richard Socher, Christopher Manning, Andrew Ng, Ignacio Iacobacci, Mohammad Taher Pilehvar, Roberto Navigli, Ping Li, Trevor Hastie, Kenneth Church, Oren Melamud, Omer Levy, Ido Dagan, Rada Mihalcea, Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, Jeff Dean, George Miller, Claudia Leacock, Randee Tengi, Ross Bunker, George Miller, Roberto Navigli, Siddharth Patwardhan, Satanjeev Banerjee, Ted Pedersen, Jeffrey Pennington, Richard Socher, Christopher Manning, Joseph Reisinger, Raymond Mooney, Tobias Schnabel, Igor Labutov, David Mimno, Thorsten Joachims, Jiri Stetina, Sadao Kurohashi, Makoto Nagao, Edward Vajda, Piek Vossen, Rubn Izquierdo, Attila Grg, Samy Bengio, Georg Heigold, Samuel Michael A Carlin, Aren Thomas, Hynek Jansen, Hermansky, Yannick Estve, Thierry Bazillon, Jean-Yves Antoine, Frdric Bchet, Jrme Farinas, Sylvain Galliano, Edouard Geoffrois, Djamel Mostefa, Khalid Choukri, Jean-Franc ois Bonastre, Guillaume Gravier, Sylvain Galliano, Guillaume Gravier, Laura Chaubard, Sahar Ghannay, Yannick Benoit Favre, Nathalie Estve, Camelin, Keith Levin, Katharine Henry, Anton Jansen, Karen Livescu, Omer Levy, Yoav Goldberg, Ido Dagan, Roland Thiolliere, Ewan Dunbar, Gabriel Synnaeve, Maarten Versteegh, Emmanuel Dupoux, Jiang Wang, Yang Song, Thomas Leung, Chuck Rosenberg, Jingbin Wang, James Philbin, Bo Chen, Ying Wu, Jason Weston, Samy Bengio, Nicolas Usunier, Danqi Chen, Christopher Manning, Felix Hill, Roi Reichart, Anna Korhonen, Arne Khn, Chun Lao, Amirali Zadeh, Kenji Sagae, Arne Khn, Tao Lei, Yu Xin, Yuan Zhang, Regina Barzilay, Tommi Jaakkola, Omer Levy, Yoav Goldberg, Andr Martins, Miguel Almeida, Noah Smith, Tom Mikolov, Martin Karafit, Luk Burget, Jan ernock, Sanjeev Khudanpur, Jeffrey Pennington, Richard Socher, Christopher Manning, David Balota, J Miachael, Susan Cortese, Daniel Sergent-Marshall, Melvin Spieler, Yap, Miroslav Batchkarov, Thomas Kober, Jeremy Reffin, Julie Weeds, David Weir, Elia Bruni, Nam-Khanh Tran, Marco Baroni, Allyson Ettinger, Naomi Feldman, Philip Resnik, Colin Phillips, Katrin Amac herdagdelen, Marco Erk, Baroni, Felix Hill, Roi Reichart, Anna Korhonen, David Keith A Hutchison, James Balota, Michael Neely, Emily Cortese, Chi-Shing Cohen-Shikora, Melvin Tse, Jesse Yap, Dale Bengson, Erin Niemeyer, Buchanan, Walter Michael N Jones, Douglas Jk Kintsch, Mewhort, Marta Kutas, Kara Federmeier, Rajendra Banjade, Danqi Chen, Christopher Manning, Billy Chiu, Anna Korhonen, Sampo Pyysalo, R Collobert, Georgiana Dinu, Angeliki Lazaridou, Marco Baroni, Anna Gladkova, Aleksandr Drozd, Lushan Han, Andrej Karpathy, Armand Joulin, Fei Fei, F Li, Andrs Kornai, Marcus Kracht, Jeffrey Pennington, Richard Socher, Christopher Manning, Carson Schtze, R Socher, John Wieting, Will Zou, Billy Chiu, Anna Korhonen, Sampo Pyysalo, Anna Gladkova, Aleksandr Drozd, Pter Halcsy, Andrs Kornai, Lszl Nmeth, Andrs Rung, Istvn Szakadt, Viktor Trn, Lushan Han, Abhay Kashyap, Tim Finin, James Mayfield, Jonathan Weese, Eric Huang, Richard Socher, Christopher Manning, Andrew Ng, Jiwei Li, Dan Jurafsky, Y Dmitrii, Manin, Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean, Arvind Neelakantan, Jeevan Shankar, Alexandre Passos, Andrew Mccallum, Joseph Reisinger, Raymond Mooney, Jrg Tiedemann, Chao Xing, Chao Liu, Riit Cslt, Dong Wang, China Tnlist, Yiye Lin, Hyejin Youna, Logan Sutton, Eric Smith, Cristopher Moore, Jon Wilkins, Ian Maddieson, William Croft, Tanmoy Bhattacharya, Marco Baroni, Alessandro Lenci, Marco Baroni, Georgiana Dinu, Germn Kruszewski, Manaal Faruqui, Jesse Dodge, Sujay Kumar Jauhar, Chris Dyer, Eduard Hovy, Noah Smith, Eric Huang, Richard Socher, Christopher Manning, Andrew Ng, Jeremy Kahn, Matthew Snover, Mari Ostendorf, Karsten Lehmann, Anni-Yasmin Turhan, David Newman, Jey, Han Lau, Karl Grieser, Timothy Baldwin, Roy Rada, Hafedh Mili, Ellen Bicknell, Maria Blettner, Tobias Schnabel, Igor Labutov, David Mimno, Thorsten Joachims, Andrew Trask, Phil Michalak, John Lui, Yulia Tsvetkov, Manaal Faruqui, Wang Ling, Guillaume Lample, Chris Dyer, Adrian Benton, Raman Arora, Mark Dredze, Bhuwan Dhingra, Zhong Zhou, Dylan Fitzpatrick, Michael Muehl, William Cohen, Jacob Eisenstein, Jacob Eisenstein, Manaal Faruqui, Yulia Tsvetkov, Pushpendre Rastogi, Chris Dyer, Stephan Gouws, Dirk Hovy, Donald Metzler, Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, Jeff Dean, Jeffrey Pennington, Richard Socher, Christopher Manning, Duyu Tang, Furu Wei, Nan Yang, Ming Zhou, Ting Liu, Bing Qin, Soroush Vosoughi, Prashanth Vijayaraghavan, Deb Roy, Katherine Ben D Amsel, Marta Delong, Kutas, Marco Baroni, Georgiana Dinu, Germn Kruszewski, Marco Baroni, Alessandro Lenci, Katherine Binder, Susan Duffy, Keith Rayner, Todd Ferretti, Ken Mcrae, Andrea Hatherell, Clayton Greenberg, Vera Demberg, Asad Sayeed, Clayton Greenberg, Asad Sayeed, Vera Demberg, Pentti Kanerva, Jan Kristofersson, Anders Holst, Alessandro Lenci, Ken Mcrae, Todd Ferretti, Liane Amyote, Ken Mcrae, J Michael, Michael Spivey-Knowlton, Tanenhaus, Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, Jeff Dean, ;, Tomas Mikolov, Wen Tau Yih, Geoffrey Zweig, Ulrike Pad, Matthew Crocker, Frank Keller, Neal Pearlmutter, Maryellen Macdonald, Asad Sayeed, Vera Demberg, Pavel Shkadzko, John Trueswell, Michael Tanenhaus, Susan Garnsey, Tim Van De Cruys, Bram Vandekerckhove, Dominiek Sandra, Walter Daelemans, Eneko Agirre, Enrique Alfonseca, Keith Hall, Jana Kravalova, Marius Pas, Aitor Soroa, Elia Bruni, Gemma Boleda, Marco Baroni, Nam-Khanh Tran, Lev Finkelstein, Evgeniy Gabrilovich, Yossi Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, Eytan Ruppin, H Hershey, Taiwo Friedman, Amoo ; Friedman, H Hershey, Taiwo Amoo, Avishai Henik, Limor Kaplan, Felix Hill, Roi Reichart, Anna Korhonen, Thang Luong, Richard Socher, Christopher Manning, Herbert Rubenstein, John Goodenough, O Rubinsten, Anaki, S Henik, Y Drori, Faran, Mohit Bansal, Kevin Gimpel, Karen Livescu, Elia Bruni, Gemma Boleda, Marco Baroni, Nam-Khanh Tran, Kenneth Church, Patrick Hanks, Chris Dyer, Miguel Ballesteros, Wang Ling, Austin Matthews, Noah Smith, Manaal Faruqui, Chris Dyer, Manaal Faruqui, Jesse Dodge, Sujay Kumar Jauhar, Chris Dyer, Noah Smith, Eduard Hovy, Lev Finkelstein, Evgeniy Gabrilovich, Yossi Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, Eytan Ruppin, Jiang Guo, Wanxiang Che, Haifeng Wang, Ting Liu, Sandor David R Hardoon, John Szedmak, Shawe-Taylor, Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, Chris Dyer, Angeliki Lazaridou, Eva Vecchi, Marco Baroni, Wang Ling, Lin Chu-Cheng, Yulia Tsvetkov, Silvio Amir, Ramon Fermandez, Chris Dyer, Alan Black, Isabel Trancoso, Wang Ling, Chris Dyer, Alan Black, Isabel Trancoso, Mary Mitchell P Marcus, Ann Marcinkiewicz, Beatrice Santorini, Martnez Hctor, Anders Alonso, Sussi Johannsen, Sanni Olsen, Nicolai Nimb, Anna Hartvig Srensen, Anders Braasch, Bolette Sgaard, Sandford Pedersen, Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean, George Miller, Claudia Leacock, Randee Tengi, Ross Bunker, Jeffrey Pennington, Richard Socher, Christopher Manning, Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher Manning, Andrew Ng, Christopher Potts, Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, Rob Fergus, Yulia Tsvetkov, Leonid Boytsov, Anatole Gershman, Eric Nyberg, Chris Dyer, Yulia Tsvetkov, Manaal Faruqui, Wang Ling, Guillaume Lample, Chris Dyer, Joseph Turian, Lev Ratinov, Yoshua Bengio, Maria Barrett, Anders Sgaard, Maria Barrett, Joachim Bingel, Anders Sgaard, Miroslav Batchkarov, Thomas Kober, Jeremy Reffin, Julie Weeds, David Weir, Billy Chiu, Anna Korhonen, Sampo Pyysalo, Ronan Collobert, Jason Weston, Lon Bottou, Michael Karlen, Koray Kavukcuoglu, Pavel Kuksa, Manaal Faruqui, Chris Dyer, Manaal Faruqui, Yulia Tsvetkov, Pushpendre Rastogi, Chris Dyer, Evgeniy Gabrilovich, Shaul Markovitch, David Juergens, Omer Levy, Yoav Goldberg, Ido Dagan, Tomas Mikolov, Martin Karafiat, Lukas Burget, Jan Cernocky, Sanjeev Khudanpur, George Miller, Christiane Fellbaum, Richard Montague, Anders Sgaard, eljko Agi, Martnez Hctor, Barbara Alonso, Bernd Plank, Anders Bohnet, Johannsen, Yulia Tsvetkov, Manaal Faruqui, Wang Ling, Guillaume Lample, Chris Dyer, Leila Wehbe, Brian Murphy, Partha Talukdar, Alona Fyshe, Aaditya Ramdas, Tom Mitchell, Boyd-Graber, S Zellig, Harris, Barbora Hladk, Ji Mrovsk, Pavel Schlesinger, Navigli Jurgens, D Jurgens, R Navigli, Cathy Douglas L Nelson, Thomas Mcevoy, Schreiber, Bob Stewart, Mihir Luis Von Ahn, Manuel Kedia, Blum, Jacob Andreas, Dan Klein, Marco Baroni, Roberto Zamparelli, Marco Baroni, Raffaela Bernardi, Roberto Zamparelli, Elia Bruni, Gemma Boleda, Marco Baroni, Nam-Khanh Tran, Nancy C Chang, Joachim De Beule, Vanessa Micelli, Ido Dagan, Shaul Marcus, Shaul Markovitch, Georgiana Dinu, Mirella Lapata, Samuel Fillenbaum, Amnon Rapoport, Lev Finkelstein, Evgeniy Gabrilovich, Yossi Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, Eytan Ruppin, John Firth, Judith Gaspers, Philipp Cimiano, Sascha Griffiths, Britta Wrede, Sascha Griffiths, Friederike Eyssel, Anja Philippsen, Christian Pietsch, Sven Wachsmuth, Ulrike Hahn, Nancy Henley, Karl Moritz, Hermann, Phil Blunsom, Felix Hill, Roi Reichart, Anna Korhonen, Ray Jackendoff, Steven Pinker, Ray Jackendoff, Nal Kalchbrenner, Phil Blunsom, Emmanuel Keuleers, David Balota, Walter Kintsch, Arthur Markman, Dedre Gentner, Arthur Markman, Dedre Gentner, Ken Mcrae, George Cree, Mark Seidenberg, Chris Mcnorgan, Robert Douglas L Medin, Dedre Goldstone, Gentner, Dmitrijs Milajevs, Matthew Purver, Dmitrijs Milajevs, Mehrnoosh Sadrzadeh, Thomas Roelleke, George Miller, Jeff Mitchell, Mirella Lapata, Jeff Mitchell, Mirella Lapata, Samuel Ritter, Cotie Long, Denis Paperno, Marco Baroni, Matthew Botvinick, Adele Goldberg, Herbert Rubenstein, John Goodenough, G Salton, A Wong, C Yang, Hinrich Schtze, Diarmuid, Anna Saghdha, Korhonen, Richard Socher, Brody Huval, Christopher Manning, Andrew Ng, Luc Steels, Luc Steels, Stefan Thater, Hagen Frstenau, Manfred Pinkal, Michael Tomasello, D Peter, Turney, Amos Tversky, J Hutchinson, Noortje Venhuizen, Valerio Basile, Kilian Evang, Johan Bos, Lyndon White, Roberto Togneri, Wei Liu, Mohammed Bennamoun, Lorna Balkan, Doug Arnold, Siety Meijer, Laura Banarescu, Claire Bonial, Shu Cai, Madalina Georgescu, Kira Griffitt, Ulf Hermjakob, Kevin Knight, Philipp Koehn, Martha Palmer, Nathan Schneider, Emily Bender, Dan Flickinger, Stephan Oepen, Yi Zhang, Luisa Bentivogli, Raffaella Bernardi, Marco Marelli, Stefano Menini, Marco Baroni, Roberto Zamparelli, Phil Blunsom, Edward Grefenstette, Karl Hermann, Ahmed Elgohary, Marine Carpuat, Katrin Erk, M Steven, Joshua Frankland, Greene, Abhijeet Gupta, Gemma Boleda, Marco Baroni, Sebastian Pad, Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, Hal Daum, Iii, Ryan Kiros, Yukun Zhu, R Ruslan, Richard Salakhutdinov, Raquel Zemel, Antonio Urtasun, Sanja Torralba, Fidler, Alice Lai, Julia Hockenmaier, Marco Marelli, Stefano Menini, Marco Baroni, Luisa Bentivogli, Raffaella Bernardi, Roberto Zamparelli, Jeffrey Pennington, Richard Socher, Christopher Manning, Sameer Hannah Rashkin, Yejin Singh, Choi, Philip Resnik, Laura Rimell, Stephen Clark, Mark Steedman, Elizabeth Scarlett, Stan Szpakowicz, O Diarmuid, Saghdha, Kai Sheng, Tai, Richard Socher, Christopher Manning, Amit Bagga, Breck Baldwin, Adrian Cosmin, Sanda Bejan, Harabagiu, Nria Bel, Maria Coll, Gabriela Resnik, C Razvan, Raymond Bunescu, Mooney, Zheng Chen, Heng Ji, William Dolan, Chris Quirk, Chris Brockett, Barbara Di, Eugenio, Michael Glass, C Fillmore, C Baker, David Graff, Junbo Kong, Ke Chen, Kazuaki Maeda, Dimitri Kartsaklis, Mehrnoosh Sadrzadeh, Marco Marelli, Luisa Bentivogli, Marco Baroni, Raffaella Bernardi, Stefano Menini, Roberto Zamparelli, Marco Marelli, Stefano Menini, Marco Baroni, Luisa Bentivogli, Raffaella Bernardi, Roberto Zamparelli, Jeff Mitchell, Mirella Lapata, Gabriela Resnik, Nria Bel, Rajendra Vasile Rus, Mihai Banjade, Lintean, Wei Xu, Alan Ritter, Chris Callison-Burch, William Dolan, Yangfeng Ji, M Bansal, K Gimpel, K Livescu, N Craswell, W Dolan, C Brockett, D Erhan, Y Bengio, A Courville, P Manzagol, P Vincent, S Bengio, K Hermann, D Das, J Weston, K Ganchev, O Levy, Y Goldberg, T Mikolov, W Yih, G Zweig, J Pennington, R Socher, C Manning, A Karpathy, L Fei-Fei, R Socher, J Pennington, E Huang, A Ng, C Manning, G Stanovsky, I Dagan, Mausam - RepEval@ACL 2016 被引用: 19

The quality of word representations is frequently assessed using correlation with human judgements of word similarity. Here, we question whether such intrinsic evaluation can predict the merits of the representations for downstream tasks. We study the correlation between results on ten word similarity benchmarks and tagger performance on three standard sequence labeling tasks using a variety of word vectors induced from an unannotated corpus of 3.8 billion words, and demonstrate that most intrinsic evaluations are poor predictors of downstream performance. We argue that this issue can be traced in part to a failure to distinguish specific similarity from relatedness in intrinsic evaluation datasets. We make our evaluation tools openly available to facilitate further study.