Answers are grounded in this paper and cite their sources.
Enzyme Commission (EC) number predictors such as CLEAN are evaluated with support-weighted precision and F1, which ignore the precision loss from predicted EC numbers absent from the test labels. This scoring, used in the public code of CLEAN, three subsequent methods and the EC-Bench bench- mark, overlooks 67–96% of CLEAN’s false positives on standard benchmarks, mostly incorrect fourth digits. Rescoring EC-Bench predictions for 16 meth- ods showed score inflation rising with the number of EC numbers assigned and one significant pair reversal, while overall rankings remained similar (Kendall’s τb = 0.90). In a temporal benchmark of 2,099 Swiss-Prot enzymes added after CLEAN’s training snapshot, 30.5% carried EC numbers unseen during train- ing. For the remaining enzymes, inference from neighboring training members in CLEAN’s embedding space outperformed its centroid rule (pre-registered: union-label macro-F1 +0.043), although the class-size correction added noth- ing. In descriptive analyses, BLASTp outperformed every embedding-based rule (micro-F1 0.735 vs 0.641 for the centroid rule and 0.703 for the best alternative, exemplar), with no significant difference from the centroid below 30% sequence identity. A subgroup analysis registered afterwards showed a BLASTp advan- tage on experimentally supported annotations (+0.082). CLEAN’s confidence exceeded its accuracy by 0.16–0.30 for rare EC numbers, and model-based cali- bration budgets for 20% rare-tier error had lower bootstrap limits 4.5–6.7 times the available sample sizes. We propose an EC evaluation card for comparable, transparent reporting.
No takes yet. Share an insight, caveat, or question.
Paudel et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: