Cyberbullying Detection Based on Hybrid Neural Networks and Multi-Feature Fusion

Cyberbullying demonstrates notable metaphorical and contextual traits, characterized by a high-dimensional sparse semantic space and dynamic evolution. Pre-trained models utilize extensive textual data for learning and employ transformer-based word vector generation techniques to accurately capture intricate semantics and nuanced syntax in text. However, although a single pre-trained model demonstrates strong performance in contextual modeling, it still faces challenges including inadequate feature representation and limited generalization capability in classifying cyberbullying texts. This study proposes a cyberbullying detection model employing BERT-BiGRU-CNN (BBGC) to address this issue. The BBGC model initially employs BERT to produce word embeddings, subsequently inputs them into a BiGRU layer to acquire sequence features, and finally utilizes a CNN for the extraction of local features. The features derived from BERT, BiGRU, and CNN are integrated, followed by the application of the softmax function to yield the final outcome of cyberbullying detection. Experimental findings indicate that the BBGC fusion model surpasses individual pre-trained models in the task of detecting cyberbullying text. Furthermore, in comparison to hybrid neural network models utilizing RoBERTa, ALBERT, DistilBERT and other pre-trained models, the BBGC model demonstrates considerable advantages.