Supporting Online Toxicity Detection with Knowledge Graphs

Vol. 16 (2022): Proceedings of the Sixteenth International AAAI Conference on Web and Social Media

Volume

Vol. 16 (2022): Proceedings of the Sixteenth International AAAI Conference on Web and Social Media

Poster Papers

Due to the rise in toxic speech on social media and other online platforms, there is a growing need for systems that could automatically flag or filter such content. Various supervised machine learning approaches have been proposed, trained from manually-annotated toxic speech corpora. However, annotators sometimes struggle to judge or to agree on which text is toxic and which group is being targeted in a given text. This could be due to bias, subjectivity, or unfamiliarity with used terminology (e.g. domain language, slang). In this paper, we propose the use of a knowledge graph to help in better understanding such toxic speech annotation issues. Our empirical results show that 3% in a sample of 19k texts mention terms associated with frequently attacked gender and sexual orientation groups that were not correctly identified by the annotators.

10.1609/icwsm.v16i1.19398