Name: CQA-MD: SemEval-2016 Task 3
Description: It includes a TRAIN/DEV split with reliable double-checked DEV (1,281 original questions, and 37,795 potentially related question-answer pairs) + unannotated (163,383 question--answer pairs)
Provider: QCRI
Paper Title: SemEval-2016 Task 3: Community Question Answering
Tasks: question answering
Venue Name: International Workshop on Semantic Evaluation
Authors: Preslav Nakov, Llu´ıs Marquez, Alessandro Moschitti, `
  Walid Magdy, Hamdy Mubarak, Abed Alhakim Freihat
Abstract: This paper describes the SemEval–2016
  Task 3 on Community Question Answering, which we offered in English and Arabic. For English, we had three subtasks: Question–Comment Similarity (subtask
  A), Question–Question Similarity (B), and
  Question–External Comment Similarity (C).
  For Arabic, we had another subtask: Rerank
  the correct answers for a new question (D).
  Eighteen teams participated in the task, submitting a total of 95 runs (38 primary and 57
  contrastive) for the four subtasks. A variety
  of approaches and features were used by the
  participating systems to address the different
  subtasks, which are summarized in this paper.
  The best systems achieved an official score
  (MAP) of 79.19, 76.70, 55.41, and 45.83 in
  subtasks A, B, C, and D, respectively. These
  scores are significantly better than those for
  the baselines that we provided. For subtask A,
  the best system improved over the 2015 winner by 3 points absolute in terms of Accuracy