What question did this study set out to answer?

The research aims to enhance the classification of brain tumours using advanced deep learning models on MR images.

January 27, 2022Scientific Reports118 citationsOpen Access

Classification of brain tumours in MR images using deep spatiospatial models

SCSoumick Chatterjee FNFaraz Ahmed Nizamani ANAndreas Nürnberger

Key Points

The research aims to enhance the classification of brain tumours using advanced deep learning models on MR images.
Two spatiotemporal deep learning models, ResNet (2+1)D and ResNet Mixed Convolution, were employed.
Models were pre-trained on unrelated datasets before classification tasks.
Performance was compared against the pure 3D convolutional model, ResNet18.
Pre-trained ResNet Mixed Convolution achieved a macro F1-score of 0.9345 and a test accuracy of 96.98%.
Both spatiotemporal models outperformed the ResNet18 model in classification tasks.
Pre-training led to enhanced performance while maintaining lower computational costs.

Abstract

A brain tumour is a mass or cluster of abnormal cells in the brain, which has the possibility of becoming life-threatening because of its ability to invade neighbouring tissues and also form metastases. An accurate diagnosis is essential for successful treatment planning, and magnetic resonance imaging is the principal imaging modality for diagnosing brain tumours and their extent. Deep Learning methods in computer vision applications have shown significant improvement in recent years, most of which can be credited to the fact that a sizeable amount of data is available to train models, and the improvements in the model architectures yield better approximations in a supervised setting. Classifying tumours using such deep learning methods has made significant progress with the availability of open datasets with reliable annotations. Typically those methods are either 3D models, which use 3D volumetric MRIs or even 2D models considering each slice separately. However, by treating one spatial dimension separately or by considering the slices as a sequence of images over time, spatiotemporal models can be employed as "spatiospatial" models for this task. These models have the capabilities of learning specific spatial and temporal relationships while reducing computational costs. This paper uses two spatiotemporal models, ResNet (2+1)D and ResNet Mixed Convolution, to classify different types of brain tumours. It was observed that both these models performed superior to the pure 3D convolutional model, ResNet18. Furthermore, it was also observed that pre-training the models on a different, even unrelated dataset before training them for the task of tumour classification improves the performance. Finally, Pre-trained ResNet Mixed Convolution was observed to be the best model in these experiments, achieving a macro F1-score of 0.9345 and a test accuracy of 96.98%, while at the same time being the model with the least computational cost.

Ask AI

Helpful

Bookmark

View Full Paper