Semantic Chunk Annotation for questions using Maximum Entropy

We present a ME (Maximum Entropy) model for Semantic Chunk Annotation in a Chinese Question and Answer (Q&A) system. The model was derived from a corpus of real world questions, which are collected from some discussion groups on the Internet. The questions are supposed to be answered by other pe...

Full description

Saved in:
Bibliographic Details
Main Authors: Shixi Fan, Yaoyun Zhang, Ng, W.W.Y., Xuan Wang, Xiaolong Wang
Format: Conference Proceeding
Language:English
Subjects:
Computer architecture
Computer science
Entropy
Information retrieval
Internet
Maximum Entropy
Mutual information
Natural languages
Q&A
Search engines
Semantic Chunk Annotation
Testing
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present a ME (Maximum Entropy) model for Semantic Chunk Annotation in a Chinese Question and Answer (Q&A) system. The model was derived from a corpus of real world questions, which are collected from some discussion groups on the Internet. The questions are supposed to be answered by other people, so the questions are very complex. The semantic chunks were introduced. Feature for the model was described and MI (mutual information) was adopted for feature selection. The training data consists of 14000 sentences and the test data consists of 4000 sentences. The result: F-score is 90.68%.
ISSN:1062-922X
2577-1655
DOI:10.1109/ICSMC.2008.4811317