Full Text:  <436>

CLC number: 

On-line Access: 2024-08-27

Received: 2023-10-17

Revision Accepted: 2024-05-08

Crosschecked: 0000-00-00

Cited: 0

Clicked: 644

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
Open peer comments

Frontiers of Information Technology & Electronic Engineering 

Accepted manuscript available online (unedited version)


DRMSpell: dynamically reweighting multimodality for Chinese spelling correction


Author(s):  Yinghao LI, Heyan HUANG, Baojun WANG, Yang GAO

Affiliation(s):  School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China; more

Corresponding email(s):  yhli@bit.edu.cn, hhy63@bit.edu.cn, puking.w@huawei.com, gyang@bit.edu.cn

Key Words:  Chinese spelling correction; Multimodality; Masking strategy


Share this article to: More <<< Previous Paper|Next Paper >>>

Yinghao LI, Heyan HUANG, Baojun WANG, Yang GAO. DRMSpell: dynamically reweighting multimodality for Chinese spelling correction[J]. Frontiers of Information Technology & Electronic Engineering,in press.https://doi.org/10.1631/FITEE.2300816

@article{title="DRMSpell: dynamically reweighting multimodality for Chinese spelling correction",
author="Yinghao LI, Heyan HUANG, Baojun WANG, Yang GAO",
journal="Frontiers of Information Technology & Electronic Engineering",
year="in press",
publisher="Zhejiang University Press & Springer",
doi="https://doi.org/10.1631/FITEE.2300816"
}

%0 Journal Article
%T DRMSpell: dynamically reweighting multimodality for Chinese spelling correction
%A Yinghao LI
%A Heyan HUANG
%A Baojun WANG
%A Yang GAO
%J Frontiers of Information Technology & Electronic Engineering
%P
%@ 2095-9184
%D in press
%I Zhejiang University Press & Springer
doi="https://doi.org/10.1631/FITEE.2300816"

TY - JOUR
T1 - DRMSpell: dynamically reweighting multimodality for Chinese spelling correction
A1 - Yinghao LI
A1 - Heyan HUANG
A1 - Baojun WANG
A1 - Yang GAO
J0 - Frontiers of Information Technology & Electronic Engineering
SP -
EP -
%@ 2095-9184
Y1 - in press
PB - Zhejiang University Press & Springer
ER -
doi="https://doi.org/10.1631/FITEE.2300816"


Abstract: 
Chinese spelling correction (CSC) is a task that aims to detect and correct the spelling errors that may occur in Chinese texts. However, the Chinese language exhibits a high degree of complexity, characterized by the presence of multiple phonetic representations known as pinyin, which possess distinct tonal variations that can correspond to various characters. In light of the complexity inherent in the Chinese language, the CSC task becomes imperative for ensuring the accuracy and clarity of written communication. Recent research has included external knowledge into the model using phonological and visual modalities. However, these methods do not effectively utilize the modality information in a targeted manner for addressing the different types of errors. In this paper, we propose a multimodal pretrained language model called DRMSpell for CSC, which takes into consideration the interaction between the modalities. A dynamically reweighting multimodality (DRM) module is introduced to reweight various modalities for obtaining more multimodal information. To fully utilize the multimodal information obtained and to further strengthen the model, an independent-modality masking strategy (IMS) is proposed to independently mask three modalities of a token in the pretraining stage. Our method achieves state-of-the-art performance on most metrics constituting widely used benchmarks. The findings of the experiments demonstrate that our method is capable of modeling the interactive information between modalities and is also robust to incorrect modal information.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2024 Journal of Zhejiang University-SCIENCE