Answers are grounded in this paper and cite their sources.
The Gini importance of the random forest provided superior means for measuring feature relevance on spectral data, but - on an optimal subset of features - the regularized classifiers might be preferable over the random forest classifier, in spite of their limitation to model linear dependencies only. A feature selection based on Gini importance, however, may precede a regularized linear classification to identify this optimal subset of features, and to earn a double benefit of both dimensionality reduction and the elimination of noise from the classification task.
No takes yet. Share an insight, caveat, or question.
Menze et al. (2009) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: