A Visual Transformer and Convolution Neural Network-based Intelligent Recommender System for E-Commerce Scenes

Recommender systems have been a kind of powerful tool to improve e-commerce benefits. Existing recommender systems mostly employ explicit features of products, such as description and attributes. However, visual characteristics contain fruitful implicit and intuitive information, and are always ignored by existing works. To deal with this issue, this paper proposes a novel intelligent recommender system via visual Transformer (ViT) model and convolutional neural network (CNN) structure. First, the ViT part is utilized to extract visual feature representation. By learning the visual similarity among products, it is expected to obtain a better scene understanding. Then, an improved CNN part is utilized to extract hidden association information from historical behaviors of users. It is expected to better perceive user preference and purchasing characteristics. The combination of two parts constructs the proposed recommender system. Finally, we make performance evaluation for the proposal on real-world e-commerce dataset. The results indicate that the proposal exhibits high recommendation accuracy and efficiency. Compared with other typical algorithms, our proposal can better understand product images and user behaviors, providing more personalized recommendation results.