PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
September 28, 2025Journal of Chemical Information and Modeling5 citations

Rethinking Retrosynthesis: Curriculum Learning Reshapes Transformer-Based Small-Molecule Reaction Prediction

View Full Paper
RSRahul SheshanarayanaFYFengqi You

Key Points

  • Curriculum learning improves top-1 accuracy from 27.0% to 75.9% in the BART model, showcasing significant gains in reaction prediction accuracy.
  • In low-data scenarios, curriculum learning raises top-1 accuracy from 16.9% to 46.6%, highlighting effectiveness in limited training settings.
  • The method leverages transformer architectures to systematically control training difficulty, enabling better model performance on rare reactions.
  • Significantly enhances model robustness against distributional shifts, with accuracy improvements observed up to 51.2% under structurally dissimilar conditions.

Abstract

Retrosynthesis prediction remains a central challenge in computational chemistry, particularly when models must generalize to rare or structurally complex reactions. We present a curriculum learning (CL) framework that reshapes model training by systematically controlling reaction difficulty during learning, directly addressing the challenge of chemical generalization. In contrast to conventional generative approaches that treat all training reactions uniformly, our method introduces reactions in a chemically informed progression, gradually exposing the model to increasingly complex transformations based on synthetic accessibility, ring complexity, and molecular size. This difficulty-aware pacing allows the model to better capture reaction conditionality, preserve chemical plausibility, and avoid failure modes commonly observed in rare or underrepresented transformations. Applied across three transformer-based architectures─ChemBERTa + DistilGPT2, ReactionT5v2, and BART─the framework yields substantial performance gains. Notably, the largest improvements are observed in the BART model, which lacks any chemical domain pretraining: CL improves its top-1 accuracy from 27.0% to 75.9% (+48.9%). The remainder of our evaluations use ChemBERTa + DistilGPT2 as a representative pretrained model. In low-data regimes with only 50% of the training data, CL increases top-1 accuracy from 16.9% to 46.6% (+29.7%). Under scaffold-based splits, CL improves top-1 accuracy by up to 29%, and in structurally dissimilar settings (Tanimoto similarity <0.4), CL boosts top-1 accuracy from 18.2% to 69.4% (+51.2%), demonstrating strong robustness to distributional shifts. These improvements are achieved without auxiliary labels, templates, or reaction class supervision. Looking forward, this CL framework may aid retrosynthetic route planning for pharmaceutical intermediates, catalysts, polymers, and functional materials.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Sheshanarayana et al. (2025) studied this question.

synapsesocial.com/papers/68d909fc41e1c178a14f5d00https://doi.org/10.1021/acs.jcim.5c01508
Ask AI
Helpful
Bookmark
Share
View Full Paper