Skip to main navigation Skip to search Skip to main content

A cost sensitive part-of-speech tagging: Differentiating serious errors from minor errors

  • Hyun Je Song
  • , Jeong Woo Son
  • , Tae Gil Noh
  • , Seong Bae Park
  • , Sang Jo Lee
  • Kyungpook National University
  • Heidelberg University 
  • University of Illinois at Chicago

Research output: Contribution to conferenceConference paperpeer-review

Abstract

All types of part-of-speech (POS) tagging errors have been equally treated by existing taggers. However, the errors are not equally important, since some errors affect the performance of subsequent natural language processing (NLP) tasks seriously while others do not. This paper aims to minimize these serious errors while retaining the overall performance of POS tagging. Two gradient loss functions are proposed to reflect the different types of errors. They are designed to assign a larger cost to serious errors and a smaller one to minor errors. Through a set of POS tagging experiments, it is shown that the classifier trained with the proposed loss functions reduces serious errors compared to state-of-the-art POS taggers. In addition, the experimental result on text chunking shows that fewer serious errors help to improve the performance of subsequent NLP tasks.

Original languageEnglish
Title of host publication50th Annual Meeting of the Association for Computational Linguistics, ACL 2012 - Proceedings of the Conference
Pages1025-1034
Number of pages10
StatePublished - 2012
Event50th Annual Meeting of the Association for Computational Linguistics, ACL 2012 - Jeju Island, Korea, Republic of
Duration: 2012.07.82012.07.14

Publication series

Name50th Annual Meeting of the Association for Computational Linguistics, ACL 2012 - Proceedings of the Conference
Volume1

Conference

Conference50th Annual Meeting of the Association for Computational Linguistics, ACL 2012
Country/TerritoryKorea, Republic of
CityJeju Island
Period12.07.812.07.14

Fingerprint

Dive into the research topics of 'A cost sensitive part-of-speech tagging: Differentiating serious errors from minor errors'. Together they form a unique fingerprint.

Cite this