Affiliated with RCfalse
Chinese unknown word recognition for PCFG-LA parsing
Huang Q.; He L.; Wong D.F.; Chao L.S.
Source PublicationScientific World Journal
ISSN1537744X 23566140

This paper investigates the recognition of unknown words in Chinese parsing. Two methods are proposed to handle this problem. One is the modification of a character-based model. We model the emission probability of an unknown word using the first and last characters in the word. It aims to reduce the POS tag ambiguities of unknown words to improve the parsing performance. In addition, a novel method, using graph-based semisupervised learning (SSL), is proposed to improve the syntax parsing of unknown words. Its goal is to discover additional lexical knowledge from a large amount of unlabeled data to help the syntax parsing. The method is mainly to propagate lexical emission probabilities to unknown words by building the similarity graphs over the words of labeled and unlabeled data. The derived distributions are incorporated into the parsing process. The proposed methods are effective in dealing with the unknown words to improve the parsing. Empirical results for Penn Chinese Treebank and TCT Treebank revealed its effectiveness. © 2014 Qiuping Huang et al.

URLView the original
Indexed BySCIE
WOS Research AreaScience & Technology - Other Topics
WOS SubjectMultidisciplinary Sciences
WOS IDWOS:000335337600001
Fulltext Access
Citation statistics
Cited Times [WOS]:1   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
AffiliationUniversidade de Macau
First Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Huang Q.,He L.,Wong D.F.,et al. Chinese unknown word recognition for PCFG-LA parsing[J]. Scientific World Journal,2014,2014.
APA Huang Q.,He L.,Wong D.F.,&Chao L.S..(2014).Chinese unknown word recognition for PCFG-LA parsing.Scientific World Journal,2014.
MLA Huang Q.,et al."Chinese unknown word recognition for PCFG-LA parsing".Scientific World Journal 2014(2014).
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Huang Q.]'s Articles
[He L.]'s Articles
[Wong D.F.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Huang Q.]'s Articles
[He L.]'s Articles
[Wong D.F.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Huang Q.]'s Articles
[He L.]'s Articles
[Wong D.F.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.