Performing Quality Control on Meteorological Data Using Machine Learning Techniques

Quality control (QC) on data has historically been a tedious and time-consuming task. With the currently available computer processing power and machine learning algorithms, it is possible to make QC far faster and more efficient, providing high-quality data in near real time to end users. Many organisations are already using such systems with great success, although the rapid expansion of machine learning continues to open new avenues for improvement. The aim of this project is to create a QC system for Met Eireann, the Irish Meteorological Office, which incorporates the latest machine learning techniques, combined with expert human supervision, to produce the highest possible quality meteorological data. Presented here are the ideas and concepts we intend to implement to create the QC system, showing the results of the initial trials on air temperature data. The project is still in the earliest stages of development and will benefit from input and feedback from others with experience working on similar projects.