Answers are grounded in this paper and cite their sources.
Structural biology mailing lists such as CCP4, CCP-EM, Phenix and COOT contain decades of expert answers to practical problems, but an answer is difficult to find even when it has been given before. A question-and-answer corpus was built from 103,600 messages across the four mailing lists, and threads were classified as questions. The answers were confirmed by the asker’s reply or by the agreement of several participants, identified by three LLM models. This gave 4,320 curated question-and-answer pairs, which were used for fine-tuning and retrieval augmentation for six LLM models, two sizes each from the Mistral, Llama and Qwen families. The LLM models were evaluated under eight conditions: base and fine-tuned, each without retrieval and with retrieval from the software documentation, from the mailing-list corpus, and from both. The base models with mailing-list retrieval were preferred by the LLM judges over the base models alone, the fine-tuned models, and even the base models with retrieval from the software documentation. The data sets and the fine-tuned models are publicly available.
No takes yet. Share an insight, caveat, or question.
Emad Alharbi (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: