Synapse
⌘+K
Synapse
PulseExploreJournal ClubResearchersJournals
Instagram
HomeJournal ClubExplore
September 2, 2026Applied AI LettersOpen Access

Sentiment Analysis of Imbalanced Dataset Through Data Augmentation and Generative Annotation Using DistilBERT and Low‐Rank Fine‐Tuning

View Full Paper
Ask AI
Bookmark
Share

Authors

HNHossein Nekkouei NasrabadiMMMohammad Hossein Moattar

Discussion

Loading...

Member takes

Overview

Experimental study demonstrates improved sentiment classification in imbalanced social media data, indicating the utility of generative augmentation with parameter-efficient transformer tuning.

Key Points

  • To improve sentiment classification accuracy on heavily imbalanced social media data using large language model augmentation and computationally efficient transformer fine-tuning.
  • Generated synthetic tweets and positive annotations via GPT-4 using paraphrasing and back-translation through Italian to balance 10 negative categories in the Twitter US Airline Sentiment dataset.
  • Encoded augmented samples into sentence embeddings using DistilBERT fine-tuned with Low-Rank Adaptation (LoRA) and classified sentiments with a SoftMax layer.
  • Validated classification performance using a held-out test set and 10-fold cross-validation.
  • Achieved strong classification performance across positive, neutral, and negative sentiment classes while substantially reducing training computational complexity.
  • Successfully improved dataset balance and interpretability through generative semantic counterpart labeling of predefined negative airline categories.

Cite This Study

Nasrabadi et al. (2026) studied this question.

synapsesocial.com/papers/6a97e29ec562ede874ec6d54https://doi.org/10.1002/ail2.70043
View Full Paper
Ask AI
Bookmark
Share