NCUEE-NLP at SemEval-2023 Task 8: Identifying Medical Causal Claims and Extracting PIO Frames Using the Transformer Models

Lung-Hao Lee, Yuan-Hao Cheng, Jen-Hao Yang, Kao-Yuan Tien

The 17th International Workshop on Semantic Evaluation (SemEval-2023) Task 8: causal medical claim identification and related pico frame extraction from social media posts Paper

TLDR: This study describes the model design of the NCUEE-NLP system for the SemEval-2023 Task 8. We use the pre-trained transformer models and fine-tune the task datasets to identify medical causal claims and extract population, intervention, and outcome elements in a Reddit post when a claim is given. Ou
You can open the #paper-SemEval_48 channel in a separate window.
Abstract: This study describes the model design of the NCUEE-NLP system for the SemEval-2023 Task 8. We use the pre-trained transformer models and fine-tune the task datasets to identify medical causal claims and extract population, intervention, and outcome elements in a Reddit post when a claim is given. Our best system submission for the causal claim identification subtask achieved a F1-score of 70.15\%. Our best submission for the PIO frame extraction subtask achieved F1-scores of 37.78\% for Population class, 43.58\% for Intervention class, and 30.67\% for Outcome class, resulting in a macro-averaging F1-score of 37.34\%. Our system evaluation results ranked second position among all participating teams.