Measuring praise and criticism : inference of semantic orientation from association

  1. (PDF, 381 KB)
  2. Get@NRC: Measuring praise and criticism : inference of semantic orientation from association (Opens in a new window)
DOIResolve DOI:
AuthorSearch for: ; Search for:
Journal titleACM Transactions on Information Systems (TOIS)
Pages315346; # of pages: 30
Subjectalgorithms; experimentation; semantic orientation; semantic association; web mining; text mining; text classification; unsupervised learning; mutual information; latent semantic analysis; expérimentation; orientation sémantique; association sémantique; exploration du Web; exploration de texte; classification de textes; apprentissage non supervisé; information mutuelle; analyse sémantique latente
AbstractThe evaluative character of a word is called its semantic orientation. Positive semantic orientation indicates praise (e.g., 'honest', 'intrepid') and negative semantic orientation indicates criticism (e.g., 'disturbing', 'superfluous'). Semantic orientation varies in both direction (positive or negative) and degree (mild to strong). An automated system for measuring semantic orientation would have application in text classification, text filtering, tracking opinions in online discussions, analysis of survey responses, and automated chat systems (chatbots). This paper introduces a method for inferring the semantic orientation of a word from its statistical association with a set of positive and negative paradigm words. Two instances of this approach are evaluated, based on two different statistical measures of word association: pointwise mutual information (PMI) and latent semantic analysis (LSA). The method is experimentally tested with 3,596 words (including adjectives, adverbs, nouns, and verbs) that have been manually labeled positive (1,614 words) and negative (1,982 words). The method attains an accuracy of 82.8% on the full test set, but the accuracy rises above 95% when the algorithm is allowed to abstain from classifying mild words.
Publication date
AffiliationNational Research Council Canada; NRC Institute for Information Technology
Peer reviewedNo
NRC number46516
NPARC number5210015
Export citationExport as RIS
Report a correctionReport a correction
Record identifier1b268840-85b3-4e70-af95-dc399b6cd2b4
Record created2008-12-02
Record modified2016-05-09
Bookmark and share
  • Share this page with Facebook (Opens in a new window)
  • Share this page with Twitter (Opens in a new window)
  • Share this page with Google+ (Opens in a new window)
  • Share this page with Delicious (Opens in a new window)