Human skin tone variation is an obstacle in the development of a digital beauty product recommendation system. The purpose of this study is to categorize skin tone into three groups (Black, Brown, and White). Using a Convolutional Neural Network (CNN) based on the refined EfficientNetB0 architecture on a balanced dataset of 1,500 facial images, each class consisting of 500 images. All images in the dataset have been resized to 224 × 224 pixels to match the model input and ensure data uniformity and compatibility with the EfficientNetB0 model architecture used. The dataset used was obtained from the Kaggle platform and processed through the normalization and augmentation stages. It was then evaluated through the validation process using the 5-fold cross-validation method. This model achieved a total accuracy level of 88.67%, with the white category demonstrating precision (0.93), recall (0.95), and F1-score (0.94), as well as the highest AUC of 0.99, indicating very satisfactory performance. Additionally, this system can offer personalized beauty product recommendations, including foundation shades, lipstick colors, and clothing color palettes, tailored to specific skin tones. This method enhances the user experience by providing accurate recommendations that adapt to various lighting conditions, making it suitable for use on digital beauty platforms.
Nurapipah et al. (Mon,) studied this question.