Transfer Learning for Low-Resource Clinical Named Entity Recognition

Nevasini Sasikumar, Krishna Sri Ipsit Mantri

The 5th Workshop on Clinical Natural Language Processing (ClinicalNLP) N/a Paper

TLDR: We propose a transfer learning method that adapts a high-resource English clinical NER model to low-resource languages and domains using only small amounts of in-domain annotated data. Our approach involves translating in-domain datasets to English, fine-tuning the English model on the translated da
You can open the #paper-ClinicalNLP_83 channel in a separate window.
Abstract: We propose a transfer learning method that adapts a high-resource English clinical NER model to low-resource languages and domains using only small amounts of in-domain annotated data. Our approach involves translating in-domain datasets to English, fine-tuning the English model on the translated data, and then transferring it to the target language/domain. Experiments on Spanish, French, and conversational clinical text datasets show accuracy gains over models trained on target data alone. Our method achieves state-of-the-art performance and can enable clinical NLP in more languages and modalities with limited resources.