Advancing Multi-Criteria Chinese Word Segmentation Through Criterion Classification and Denoising

Tzu Hsuan Chou, Chun-Yi Lin, Hung-Yu Kao

Main: Syntax: Tagging, Chunking, and Parsing Main-poster Paper

Poster Session 7: Syntax: Tagging, Chunking, and Parsing (Poster)
Conference Room: Frontenac Ballroom and Queen's Quay
Conference Time: July 12, 11:00-12:30 (EDT) (America/Toronto)
Global Time: July 12, Poster Session 7 (15:00-16:30 UTC)
Keywords: chunking, shallow-parsing
Languages: chinese
TLDR: Recent research on multi-criteria Chinese word segmentation (MCCWS) mainly focuses on building complex private structures, adding more handcrafted features, or introducing complex optimization processes. In this work, we show that through a simple yet elegant input-hint-based MCCWS model, we can ach...
You can open the #paper-P5566 channel in a separate window.
Abstract: Recent research on multi-criteria Chinese word segmentation (MCCWS) mainly focuses on building complex private structures, adding more handcrafted features, or introducing complex optimization processes. In this work, we show that through a simple yet elegant input-hint-based MCCWS model, we can achieve state-of-the-art (SoTA) performances on several datasets simultaneously. We further propose a novel criterion-denoising objective that hurts slightly on F1 score but achieves SoTA recall on out-of-vocabulary words. Our result establishes a simple yet strong baseline for future MCCWS research. Source code is available at https://github.com/IKMLab/MCCWS.