Chinese NLP Lexicons

Chinese NLP Lexicons

The complexity of Chinese poses special challenges to developers of natural language processing (NLP) applications, such as in the areas of word segmentation, information retrieval, speech technology, named-entity extraction, and machine translation. These challenges are exacerbated by the lack of truly comprehensive lexical resources, especially for proper nouns.

CJKI has developed a wide variety of resources, some very comprehensive, to enhance the accuracy and reliability of Chinese NLP applications. Below are links to the individual product pages of CJKI’s resources for Chinese NLP lexicons. These pages provide descriptions of each resource, explain how the resources are used and include data samples.



Chinese Lexical Database

Monolingual general vocabulary for NLP applications


Yue Phonetic Database

Phonemic transcriptions of Cantonese (Yue) vocabulary in jyutping


Chinese to Chinese Conversion

SC/TC mapping tables supporting orthographic and lexemic conversion


Chinese Hanyu Pinyin Database

Accurate hanyu pinyin data including technical terms and proper nouns


Chinese Phonetic Database

Phonemic transcriptions showing differences between PRC and Taiwan