SemEval-2016 task 6: detecting stance in tweets

DOIResolve DOI: http://doi.org/10.18653/v1/S16-1003
AuthorSearch for: ; Search for: ; Search for: ; Search for: ; Search for:
TypeArticle
Proceedings titleProceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016)
Conference10th International Workshop on Semantic Evaluation (SemEval-2016), 16-17 June 2016, San Diego, California, USA
Pages3141
AbstractHere for the first time we present a shared task on detecting stance from tweets: given a tweet and a target entity (person, organization, etc.), automatic natural language systems must determine whether the tweeter is in favor of the given target, against the given target, or whether neither inference is likely. The target of interest may or may not be referred to in the tweet, and it may or may not be the tar- get of opinion. Two tasks are proposed. Task A is a traditional supervised classification task where 70% of the annotated data for a target is used as training and the rest for testing. For Task B, we use as test data all of the instances for a new target (not used in task A) and no training data is provided. Our shared task received submissions from 19 teams for Task A and from 9 teams for Task B. The highest classification F-score obtained was 67.82 for Task A and 56.28 for Task B. However, systems found it markedly more difficult to infer stance towards the target of interest from tweets that express opinion towards another entity.
Publication date
PublisherAssociation for Computational Linguistics
PlaceStroudsburg, PA, USA
LanguageEnglish
AffiliationInformation and Communication Technologies; National Research Council Canada
Peer reviewedYes
NPARC number23001913
Export citationExport as RIS
Report a correctionReport a correction
Record identifier3aeec8d1-d42c-44ff-aa3b-040c56fe629a
Record created2017-05-24
Record modified2017-05-24
Bookmark and share
  • Share this page with Facebook (Opens in a new window)
  • Share this page with Twitter (Opens in a new window)
  • Share this page with Google+ (Opens in a new window)
  • Share this page with Delicious (Opens in a new window)