Answers are grounded in this paper and cite their sources.
Absorption, distribution, metabolism, excretion, and toxicity (ADMET) models are usually judged on predefined benchmark splits. Those splits are useful, but they do not show whether a model reproduces the pharmacokinetic (PK) numbers that are actually reported for individual drugs. Here we compared ADMET-AI with a fine-tuned NV-KERMT-70M-v2 model (“KERMT”) on the same Therapeutics Data Commons (TDC)-aligned endpoint definitions. KERMT was fine-tuned in two stages: a protocol check on the ChEMBL multitask (ChEMBL-MT) data set, then TDC-aligned regression and classification fine-tuning on merged ChEMBL, Biogen, ExpansionRx/OpenADMET and TDC data. Two retrospective literature comparisons were run. The first used a curated 25-drug oncology panel: for half-life (n = 17) KERMT cut mean absolute error (MAE) from 46.81 to 16.83 h (paired Wilcoxon p = 0.0046, Holm-adjusted p = 0.0139, closer for 13 of 17 drugs); volume of distribution at steady state (VDss, n = 12) and hepatocyte clearance (n = 17) showed no statistically supported difference. The second, reported here for the first time, is an expanded three-way comparison of 53 oncology drugs × 3 endpoints (159 drug-endpoint rows) against curated literature and label values. On the 48 drugs with a usable half-life reference, KERMT more than halved the error (MAE 19.43 vs 43.38 h; median absolute error 12.01 vs 35.30 h; geometric mean fold error, GMFE, 2.72 vs 3.69; within 2-fold 41.0% vs 25.0%), was closer for 34 of 48 drugs (70.8%; 95% confidence interval, CI, 55.9-83.0%), and the paired Wilcoxon test was significant (p = 0.0002; Holm-adjusted p = 0.0004). The advantage persisted after each model's systematic bias was removed (p = 0.0004), so it is not a simple scale offset: ADMET-AI over-predicted half-life for 35 of 48 drugs (mean bias +29.20 h) whereas KERMT was mildly conservative (-13.79 h). For plasma protein binding ratio (PPBR, n = 21) KERMT had lower MAE (7.05 vs 9.44 percentage points) and the only statistically significant rank agreement with literature seen anywhere in this study (Spearman ρ = 0.540, p = 0.012, vs 0.400, p = 0.073), but the paired error difference was not significant (p = 0.157). One endpoint failed outright and we state it plainly: KERMT VDss predictions collapsed to near-baseline behaviour. They occupied a narrow band (46 of 53 drugs between 0 and 10 L/kg; standard deviation 3.64 vs 6.71 L/kg for ADMET-AI), no drug in the panel had an assay-matched VDss reference, and on the six drugs with an approximate reference the per-drug KERMT predictions (MAE 2.18 L/kg) were no better than replacing the entire model with one constant (MAE 2.14 L/kg) and worse than a no-information baseline (1.71 L/kg). KERMT VDss output should therefore not be used. A deliberately strict control bounds the positive findings as well: against a structure-blind constant predictor built by leave-one-out from the reference values, KERMT was statistically indistinguishable on both endpoints (half-life MAE 19.43 vs 16.07 h, p = 0.051; PPBR 7.05 vs 7.24 percentage points, p = 0.812), while ADMET-AI was significantly worse than that constant for half-life (p < 0.0001). We therefore make no claim of accurate numerical point prediction; the supported claims are that fine-tuning removes ADMET-AI's large systematic half-life error and that the PPBR rank correlation is compound-specific signal a constant cannot possess. Physically impossible values occurred in 16 of 159 KERMT rows and 21 of 159 ADMET-AI rows. Across 30 classification endpoints, mean inter-model Pearson correlation was 0.711 and mean binary agreement at 0.5 was 89%, which measures similarity, not accuracy. This version does not yet include official Therapeutics Data Commons benchmark-group evaluation of the fine-tuned models, replicate training seeds, or a training-set overlap audit; those gaps are declared explicitly rather than left implicit. The overall conclusion is endpoint-specific: fine-tuned KERMT is a materially better-calibrated half-life and plasma-protein-binding predictor than ADMET-AI on this panel, it is not yet a demonstrated ranking model for half-life, and its VDss head is unusable.
No takes yet. Share an insight, caveat, or question.
Mansour et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: