PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 19, 2026AIChE Journal4 citationsOpen Access

SigmaFormer : Augmenting transformer encoders with COSMO sigma profiles for pure component property prediction

View Full Paper
TKTae Hyun KimSPSilabrata PahariJKJoseph Sang‐Il Kwon

Key Points

  • The aim is to improve molecular property predictions by integrating molecular surface charge distributions into transformer-based models.
  • Augmented pretrained transformer encoder with a 53-dimensional COSMO-derived descriptor.
  • Evaluated across 25 thermophysical and environmental properties.
  • Performed Monte Carlo dropout uncertainty analysis and gradient-based interpretability.
  • Achieved highest average prediction score of 0.836 among five models, excelling in 9 of 25 properties.
  • Properties influenced by intermolecular interactions showed improvements of +2.30% and +1.03% in phase transition and environmental categories, respectively.
  • Reduced uncertainty in 19 out of 25 properties.

Abstract

Abstract Transformer‐based molecular models pretrained on SMILES strings demonstrate strong performance in property prediction. However, these model often lack explicit integration of molecular surface charge distributions that govern intermolecular interactions such as hydrogen bonding and polarity. SigmaFormer addresses this limitation by augmenting a pretrained encoder with a 53‐dimensional descriptor derived from COSMO quantum‐chemical calculations, including the σ‐profile, cavity surface area, and cavity volume. Benchmarking across 25 thermophysical and environmental properties indicates that SigmaFormer achieves the highest average (0.836) and the best in 9 of 25 properties among five models. Performance improvements are most pronounced in properties governed by intermolecular interactions, with phase transition and environmental/toxicity categories exhibiting average of +2.30% and +1.03%, respectively. Monte Carlo dropout uncertainty is reduced in 19 of 25 properties. Data‐efficiency experiments identify three distinct contribution modes, and gradient‐based interpretability analysis demonstrates that the model leverages σ‐profile regions in a thermodynamically consistent and property‐specific manner.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Kim et al. (2026) studied this question.

synapsesocial.com/papers/6a0bfdc7166b51b53d37911fhttps://doi.org/10.1002/aic.70450
Ask AI
Helpful
Bookmark
Share
View Full Paper