Genesis: A Modular Protein Language Modelling Approach to Immunogenicity Prediction

Abstract Neoantigen immunogenicity prediction is a highly challenging problem in the development of personalised medicines. Low reactivity rates in called neoantigens result in a difficult prediction scenario with limited training datasets. Here we describe Genesis, a modular protein language modelling approach to immunogenicity prediction for CD8+ reactive epitopes. Genesis comprises of a pMHC encoding module trained on three pMHC prediction tasks, an optional TCR encoding module and a set of context specific immunogenicity prediction head modules. Compared with state-of-the-art models for each task, Genesis’ encoding module performs comparably or better on pMHC binding affinity, eluted ligand prediction and stability tasks. Genesis outperforms all compared models on pMHC immunogenicity prediction (Area under the receiver operating characteristic curve=0.619, average precision: 0.514), with a 7% increase in average precision compared to the next best model. Genesis shows further improved performance on immunogenicity prediction with the integration of TCR context information. Genesis performance is further analysed for interpretability, which locates areas of weakness found across existing immunogenicity models and highlight possible biases in public datasets.