Loading [MathJax]/extensions/MathMenu.js
Context-Aware Offensive Language Detection in Human-Chatbot Conversations | IEEE Conference Publication | IEEE Xplore

Context-Aware Offensive Language Detection in Human-Chatbot Conversations


Abstract:

Dialogs generated by chatbots may contain unethical and offensive language that can negatively affect users, the service, and society. Existing methods for automatically ...Show More

Abstract:

Dialogs generated by chatbots may contain unethical and offensive language that can negatively affect users, the service, and society. Existing methods for automatically detecting offensive language are not effective for chat data, which is short and multi-turn and hence requires understanding the subtle context behind the language. We introduce a new offensive language dataset from real human-chatbot conversations with context-aware annotations that can identify the kinds of language that are offensive only in a certain context. We propose a neural network model CALIOPER (Context-Aware modeL for Identifying Offensive language using Pre-trained Encoder and Retrieval), which uses a context-aware encoder and attention mechanism to incorporate previous messages and retrieve relevant information for detecting implicit offensiveness. Experimental results show that the model performs well on multi-turn dialog data, par-ticularly for context-dependent offensive language. This work contributes to making a safer chatbot ecosystem by advancing techniques to detect offensive language in multi-turn dialog data. (Disclaimer: This work contains profanity due to the study topic, which we replace with * marks.)
Date of Conference: 18-21 February 2024
Date Added to IEEE Xplore: 11 April 2024
ISBN Information:

ISSN Information:

Conference Location: Bangkok, Thailand

Funding Agency:


References

References is not available for this document.