LLMs can provide reliable and generally appropriate breast cancer advice, but performance suffers regarding WA-specific breast screening terminology. Our findings highlight how LLM performance is region-specific, and this fact is likely generalisable to other areas of medicine where there may be regional variance in practice. Overall, LLMs are useful as educational tools, but their outputs should always be interpreted considering local guidelines and with clinical oversight.
Njunge et al. (Sun,) studied this question.