A Review of Natural Language Processing Techniques for Sentiment Analysis using Pre-trained Models

Research and industry are becoming highly interested in automatically analyzing the opinion of general public from social networks with respect to a particular subject. Extracting the polarity from these data is always remaining as a significant bottleneck. Pre-trained models built on deep learning architecture can achieve this task in an effective manner by using transfer learning approach. Since it is difficult to develop a model from scratch, due to time constraints or computational limits, pre-trained models with vast potential and possibilities were introduced. They provide a benchmark to either improve the existing model or test the developed model against it. This paper discusses about various word embedding methods used for sentiment analysis followed by an overview on state-of-the-art pre-trained models used for natural language processing, which is commonly used in the process of sentiment analysis. Experimental results of two state-of-the-art pre-trained models are also analyzed.