International Journal of Computational Linguistics & Chinese Language Processing, Volume 25, Number 1, June 2020
7470Authors
nan
Abstract
We present a method for Chinese spelling check that automatically learns to correct a sentence with potential spelling errors. In our approach, a character-based neural machine translation (NMT) model is trained to translate the potentially misspelled sentence into correct one, using right-and-wrong sentence pairs from newspaper edit logs and artificially generated data. The method involves extracting sentences contain edit of spelling correction from edit logs, using commonly confused right-and-wrong word pairs to generate artificial right-and-wrong sentence pairs in order to expand our training data , and training the NMT model. The evaluation on the United Daily News (UDN) Edit Logs and SIGHAN-7 Shared Task shows that adding artificial error data can significantly improve the performance of Chinese spelling check system. Keywords: Chinese Spelling Check, Artificial Error Generation, Neural Machine Translation, Edit Log 1.
Keywords
Full Content
International Journal of Computational Linguistics & Chinese Language Processing Aims and Scope International Journal of Computational Linguistics and Chinese Language Processing (IJCLCLP) is an international journal published by the Association for Computational Linguistics and Chinese Language Processing (ACLCLP). This journal was founded in August 1996 and is published four issues per year since 2005. This journal covers all aspects related to computational linguistics and speech/text processing of all natural languages. Possible topics for manuscript submitted to the journal include, but are not limited to: • Computational Linguistics • Natural Language Processing • Machine Translation • Language Generation • Language Learning • Speech Analysis/Synthesis • Speech Recognition/Understanding • Spoken Dialog Systems • Information Retrieval and Extraction • Web Information Extraction/Mining • Corpus Linguistics • Multilingual/Cross-lingual Language Processing Membership & Subscriptions If you are interested in joining ACLCLP, please see appendix for further information. Copyright © The Association for Computational Linguistics and Chinese Language Processing International Journal of Computational Linguistics and Chinese Language Processing is published four issues per volume by the Association for Computational Linguistics and Chinese Language Processing. Responsibility for the contents rests upon the authors and not upon ACLCLP, or its members. Copyright by the Association for Computational Linguistics and Chinese Language Processing. All rights reserved. No part of this journal may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical photocopying, recording or otherwise, without prior permission in writing form from the Editor-in Chief. Cover Calligraphy by Professor Ching-Chun Hsieh, founding president of ACLCLP Text excerpted and compiled from ancient Chinese classics, dating back to 700 B.C. This calligraphy honors the interaction and influence between text and language International Journal of Computational Linguistics and Chinese Language Processing vol. 25, no. 1, June 2020 Contents Papers Chinese Spelling Check based on Neural Machine Translation….. Jhih-Jie Chen, Hai-Lun Tu, Ching-Yu Yang, Chiao-Wen Li and Jason S. Chang 1 基於端對端模型化技術之語音文件摘要 [Spoken Document Summarization Using End-to-End Modeling Techniques].......…... 劉慈恩(Tzu-En Liu),劉士弘(Shih-Hung Liu), 張國韋(Kuo-Wei Chang),陳柏琳(Berlin Chen) 29 應用多模式特徵融合的深度注意力網路進行謠言檢測 [Rumor Detection Using Deep Attention Networks With Multimodal Feature Fusion]...………………………………..…... 王正豪(Jenq-Haur Wang),黃靖幃(Chin-Wei Huang) 57 Linguistic Input and Child Vocalization of 7 Children from 5 to 30 Months: A Longitudinal Study with LENA Automatic Analysis…………………………………………………………... Chia-Cheng Lee, Li-mei Chen, and D. Kimbrough Oller 81 應用多跳躍注意記憶關聯於記憶網路之研究 [A Research of Applying Multi-hop Attention and Memory Relations on Memory Networks]…...…………………………………………...………... 詹京翰(Jing-Han Zhan),劉立頌(Alan Liu), 李俊宏(Chiung-Hon Lee) 103 The Association for Computational Linguistics and Chinese Language Processing Computational Linguistics and Chinese Language Processing Vol. 25, No. 1, June 2020, pp. 1-28 1 The Association for Computational Linguistics and Chinese Language Processing Chinese Spelling Check based on Neural Machine Translation Jhih-Jie Chen, Hai-Lun Tu, Ching-Yu Yang, Chiao-Wen Li and Jason S. Chang Abstract We present a method for Chinese spelling check that automatically learns to correct a sentence with potential spelling errors. In our approach, a character-based neural machine translation (NMT) model is trained to translate the potentially misspelled sentence into correct one, using right-and-wrong sentence pairs from newspaper edit logs and artificially …
Content truncated to 500 words
Labeled Text
We present a method for Chinese spelling check that automatically learns to correct a sentence with potential spelling errors. In our approach, a character-based neural machine translation (NMT) model is trained to translate the potentially misspelled sentence into correct one, using right-and-wrong sentence pairs from newspaper edit logs and artificially generated data. The method involves extracting sentences contain edit of spelling correction from edit logs, using commonly confused right-and-wrong word pairs to generate artificial right-and-wrong sentence pairs in order to expand our training data , and training the NMT model. The evaluation on the United Daily News (UDN) Edit Logs and SIGHAN-7 Shared Task shows that adding artificial error data can significantly improve the performance of Chinese spelling check system. Keywords: Chinese Spelling Check, Artificial Error Generation, Neural Machine Translation, Edit Log 1.
Publication Details
- Paper ID:
- 7470
- Year:
- 2020
- Publication:
- TIPSTER
- Publication Type:
- conf
- DOI:
- nan