Hyperparameter metaheuristic optimization technique (using salp swarm algorithm) For (Bert transformer) In sentiment analysis. (IMDb dataset)

Sentiment recognition is a complex task in natural language processing (NLP), and needs training models to handle bulk volumes of data such as IMDb dataset (English movie reviews) with hesitating linguistic trends, posing some considerable computational difficulties.The proposed framework incorporates Bidirectional Encoder Representations Transformers (BERT) and Salp Swarm Algorithm (SSA) to optimize hyperparameters in sentiment analysis using IMDb dataset.Salp swarm intelligence of (SSA) is conducted to optimize the learning rate, batch size, dropout rate, and number of attention heads.Comparative analysis has been conducted against 4 state-of-the-art algorithms (Grid Search, Particle Swarm Optimization, Improved SSA, WOA-AdaBoost) indicating the effectiveness of the proposed SSA-BERT model.The model shows an accuracy of )99.5% (on IMDb dataset performing better than Grid Search (95.5%), Particle Swarm Optimization (PSO) (96%), and Improved SSA (ISSA) (98.5%) as well as the WOA-AdaBoost (99%). Statistical analysis has been conducted using a T-test to prove the model’s superiority.The proposed model achieved a )99.0% (accuracy on the fifth epoch, and an overall accuracy of (99.5%).