A combined measure for text semantic similarity

With the rapid development of artificial intelligence and natural language processing, text similarity calculation has become the core module of many applications such as semantic disambiguation, information retrieval, automatic question answering and data mining etc. Most of the existing semantic s...

Full description

Saved in:
Bibliographic Details
Main Authors: Hao-Di Li, Qing-Cai Chen, Xiao-Long Wang
Format: Conference Proceeding
Language:English
Subjects:
Abstracts
Combination of rule and statistical measure
Correlation
Electronic publishing
Encyclopedias
Semantic similarity
Semantics
Sentence level semantic similarity
Statistical analysis
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:With the rapid development of artificial intelligence and natural language processing, text similarity calculation has become the core module of many applications such as semantic disambiguation, information retrieval, automatic question answering and data mining etc. Most of the existing semantic similarity algorithms are based on statistical methods or rule based methods that are conducted on ontology dictionaries and some kind of knowledge bases. Wherein the rule-based methods usually use the dictionary, the ontology tree or graph, or the co-occurrence number of attributes, while the statistical methods may choose to use or not use a knowledge base. While a statistical method of using a knowledge base incorporates more comprehensive knowledge and has the capability of reduces knowledge noise, it usually obtains better performance. Nevertheless, due to the imbalanced distribution of different items in a knowledge base, the semantic similarity calculation results for low-frequency words are usually poor.
ISSN:2160-133X
DOI:10.1109/ICMLC.2013.6890900