arXiv cs.CL
· Papers
ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information
arXiv:2106.16038v3 Announce Type: replace Abstract: Recent pretraining models in Chinese neglect two important aspects specific to the Chinese language: glyph and pinyin, which carry significant syntax and semantic information for language understanding. In this work, we propose ChineseBERT, which incorporates both the