Disentangling Disagreements on Offensiveness: A Cross-Cultural Study

Aida Mostafazadeh Davani, Mark Diaz, Dylan Baker, Vinodkumar Prabhakaran

The 7th Workshop on Online Abuse and Harms (WOAH) Non-archival Paper

TLDR: What is deemed offensive depends inherently on the socio-cultural contexts within which those assessments are made. However, the subjective nature of this task is often overlooked in traditional NLP studies. While there has been recent work on socio-demographic correlates of offensiveness, the contr
You can open the #paper-ACL_45 channel in a separate window.
Abstract: What is deemed offensive depends inherently on the socio-cultural contexts within which those assessments are made. However, the subjective nature of this task is often overlooked in traditional NLP studies. While there has been recent work on socio-demographic correlates of offensiveness, the contribution of socio-cultural factors to perceiving offensiveness, when considered as a moral judgement, across the globe is still under-explored. We summarize the findings from a cross-cultural study of offensiveness annotations by 4295 participants from 21 different countries across 8 geo-cultural regions. Our results show that (1) perceptions of offensiveness vary significantly across geo-cultural regions, despite controlling for gender, age, and socio-economic status, and (2) these differences are significantly mediated by annotators' individual moral concerns that vary across cultures.