Skin Tone Analysis Through Skin Tone Map Generation With Optical Approach and Deep Learning

ABSTRACT Background Skin tone assessment is critical in both cosmetic and medical fields, yet traditional methods like the individual typology angle (ITA) have limitations, such as sensitivity to illuminants and insensitivity to skin redness. Methods This study introduces an automated image‐based method for skin tone mapping by applying optical approaches and deep learning. The method generates skin tone maps by leveraging the illuminant spectrum, segments the skin region from face images, and identifies the corresponding skin tone on the map. The method was evaluated by generating skin tone maps under three standard illuminants (D45, D65, and D85) and comparing the results with those obtained using ITA on skin tone simulation images. Results The results showed that skin tone maps generated under the same lighting conditions as the image acquisition (D65) provided the highest accuracy, with a color difference of around 6, which is more than twice as small as those observed under other illuminants. The mapping positions also demonstrated a clear correlation with pigment levels. Compared to ITA, the proposed approach was particularly effective in distinguishing skin tones related to redness. Conclusion Despite the need to measure the illuminant spectrum and for further physiological validation, the proposed approach shows potential for enhancing skin tone assessment. Its ability to mitigate the effects of illuminants and distinguish between the two dominant pigments offers promising applications in both cosmetic and medical diagnostics.