On the possible benefits of deep learning for spectral preprocessing

Abstract Preprocessing is a mandatory step in most types of spectroscopy and spectrometry. The choice of preprocessing method depends on the data being analysed, and to get the preprocessing right, domain knowledge or trial and error is required. Given the recent success of deep learning‐based methods in numerous applications and their ability to automatically detect patterns in data, we aimed at exploring the possibilities of using such methods for preprocessing. Our study considered a flexible but systematic investigation of spectroscopic preprocessing methods (classical and deep learning‐based) combined with predictive modelling, including both traditional linear modelling and artificial neural network‐based modelling. The main ambition of the present work was to assess if the advantages of deep learning‐based methods in spectral preprocessing are sufficient to justify the additional efforts in model set‐up and training and the possible losses of interpretability and transparency. With the use of data from different vibrational spectroscopy techniques, we demonstrated that deep learning‐based preprocessing successfully increased the predictive performance of our models but that classical preprocessing still is a good alternative or even the best one in some cases. A significant increase in effort was required when using deep learning‐based preprocessing together with linear model prediction. Compared with classical preprocessing techniques, deep learning‐based preprocessing decreased the transparency and showed only modest improvements of the prediction performance of linear models. Our conclusion is that deep learning‐based preprocessing is best suited when integrated in neural network predictions.