Skip to main navigation Skip to search Skip to main content

Fine-grained named entity recognition using conditional random fields for question answering

  • Changki Lee*
  • , Yi Gyu Hwang
  • , Hyo Jung Oh
  • , Soojong Lim
  • , Jeong Heo
  • , Chung Hee Lee
  • , Hyeon Jin Kim
  • , Ji Hyun Wang
  • , Myung Gil Jang
  • *Corresponding author for this work
  • Electronics and Telecommunications Research Institute

Research output: Contribution to conferenceConference paperpeer-review

Abstract

In many QA systems, fine-grained named entities are extracted by coarse-grained named entity recognizer and fine-grained named entity dictionary. In this paper, we describe a fine-grained Named Entity Recognition using Conditional Random Fields (CRFs) for question answering. We used CRFs to detect boundary of named entities and Maximum Entropy (ME) to classify named entity classes. Using the proposed approach, we could achieve an 83.2% precision, a 74.5% recall, and a 78.6% F1 for 147 fined-grained named entity types. Moreover, we reduced the training time to 27% without loss of performance compared to a baseline model. In the question answering, The QA system with passage retrieval and AIU archived about 26% improvement over QA with passage retrieval. The result demonstrated that our approach is effective for QA.

Original languageEnglish
Title of host publicationInformation Retrieval Technology - Third Asia Information Retrieval Symposium, AIRS 2006, Proceedings
PublisherSpringer Verlag
Pages581-587
Number of pages7
ISBN (Print)3540457801, 9783540457800
DOIs
StatePublished - 2006
Event3rd Asia Information Retrieval Symposium, AIRS 2006 - Singapore, Singapore
Duration: 2006.10.162006.10.18

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4182 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd Asia Information Retrieval Symposium, AIRS 2006
Country/TerritorySingapore
CitySingapore
Period06.10.1606.10.18

Keywords

  • Conditional random fields
  • Fine-grained named entity recognition
  • Question answering

Fingerprint

Dive into the research topics of 'Fine-grained named entity recognition using conditional random fields for question answering'. Together they form a unique fingerprint.

Cite this