CQADupStack: A Benchmark Data Set for Community Question-Answering Research

This paper presents a benchmark dataset, CQADupStack, for use in community question-answering (cQA) research. It contains threads from twelve StackExchange subforums, an-notated with duplicate question information. We provide pre-defined training and test splits, both for retrieval and classification experiments, to ensure maximum comparabil-ity between different studies using the set. Furthermore, it comes with a script to manipulate the data in various ways. We give an analysis of the data in the set, and report bench-mark results on a duplicate question retrieval task using well established retrieval models.

CQADupStack: A Benchmark Data Set for Community Question-Answering Research | Litlas