Answers are grounded in this paper and cite their sources.
Naive Bayes is renowned for its simplicity and efficiency, occupying a significant position within the domains of data mining and machine learning. However, its performance optimisation is constrained by the adequacy of instance training and the effectiveness of feature selection. To address these limitations, this paper first proposes a novel algorithm called Misclassified Instances Re-training Naive Bayes (MIReNB). This methodology employs Leave-One-Out Cross Validation (LOOCV) to meticulously discern and iteratively reuse misclassified instances, dynamically adjusting the frequency table of the conditional probability distribution for each attribute-value and class, followed by retraining procedures to augment predictive performance. Building upon MIReNB, we subsequently propose two extensions. The first extension, designated as MIReNB Select, incorporates an additional feature selection stage before identifying misclassified instances to determine the optimal feature subset for retraining, thereby improving prediction accuracy and robustness. The second extension, termed MIReNB Twice, involves a dual iterative process that deeply integrates misclassified instances, achieving adaptive refinement of the conditional probability distribution while enhancing classification accuracy and generalisation ability. Numerous empirical investigations have shown that MIReNB, along with its two extensions, can enhance classification accuracy notably while preserving the inherent simplicity and efficiency of the Naive Bayes classifier.
No takes yet. Share an insight, caveat, or question.
Ke et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: