Challenges in discriminating profanity from hate speech
In this study, we approach the problem of distinguishing general profanity from hate speech in social media, something which has not been widely considered. Using a new dataset annotated specifically for this task, we employ supervised classification along with a set of features that
includes [Inline formula]-grams, skip-grams and clustering-based word representations. We apply approaches based on single classifiers as well as more advanced ensemble classifiers and stacked generalisation, achieving the best result of [Inline formula] accuracy for this 3-class classification
task. Analysis of the results reveals that discriminating hate speech and profanity is not a simple task, which may require features that capture a deeper understanding of the text not always possible with surface [Inline formula]-grams. The variability of gold labels in the annotated data,
due to differences in the subjective adjudications of the annotators, is also an issue. Other directions for future work are discussed.
Keywords: Hate speech; bullying; classifier ensembles; social media; text classification; twitter
Document Type: Research Article
Affiliations: 1: Harvard Medical School, Boston, MA, USA. 2: Research Group in Computational Linguistics, University of Wolverhampton, UK.
Publication date: 04 March 2018
- Editorial Board
- Information for Authors
- Subscribe to this Title
- Ingenta Connect is not responsible for the content or availability of external websites
- Access Key
- Free content
- Partial Free content
- New content
- Open access content
- Partial Open access content
- Subscribed content
- Partial Subscribed content
- Free trial content