Machine Learning, Thematic Feature Grouping, and the Magnificent Seven: A Forecasting Analysis

This study examines the predictability of monthly excess returns for the “Magnificent Seven” U.S. technology firms using machine learning and economically motivated thematic feature grouping. Framed as a focused study of the most systemically consequential equity panel in modern markets—seven firms representing over 30% of the S&P 500—the analysis confronts a small-N, large-P environment where economically structured dimensionality reduction is essential. Using 154 firm-level characteristics categorized into 13 economic themes, we evaluate linear, penalized, tree-based, and neural network models in a small-N, large-P setting. Unrestricted models suffer substantial overfitting and fail to outperform the historical average benchmark out-of-sample. In contrast, theme-based models generate economically meaningful and regime-dependent predictive gains. Short-Term Reversal and seasonality exhibit stronger expansion-period predictability, while size and profitability perform better during recessions. Regularized linear models provide the most stable performance in limited-data environments, whereas nonlinear ensemble methods improve only when training windows are extended. The findings underscore the importance of economically structured dimensionality reduction and adaptive factor allocation in managing concentration risk among systemically important mega-cap firms.