PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 21, 2026Journal of Voice0 citationsOpen Access

Exploring Dysphonic Artificial Intelligence Voice Cloning for Speech Intelligibility in Noise

View Full Paper
PBPasquale BottalicoCNCharles J. NudelmanDFDaniel Fogerty

Key Points

  • This study aims to evaluate how well AI-generated voice clones capture the intelligibility of dysphonic speech compared to healthy voices.
  • Generated voice clones for 12 speakers: 6 with dysphonia and 6 vocally healthy.
  • Sixty-four listeners evaluated both natural and AI-produced speech samples across three experiments.
  • Conducted tests including the Hearing-in-Noise Test to measure speech intelligibility in noise.
  • Listeners were more sensitive to dysphonic voice differences, achieving 66.8% accuracy comparing real voices.
  • AI-generated dysphonic voices improved intelligibility scores from 35.5% to 66.5% for males, reaching 67.0% for females.
  • Findings reveal AI tools currently do not replicate the intelligibility issues in dysphonic speech effectively.

Abstract

BACKGROUND: Voice cloning technologies powered by artificial intelligence (AI) may provide new opportunities to study the perceptual effects of dysphonia, particularly in rare voice disorders where clinical data are scarce. This study examined whether AI-generated voice clones can capture the intelligibility characteristics of dysphonic speech. METHODS/DESIGN: Researchers generated voice clones for 12 speakers, including six speakers with dysphonia and six vocally healthy speakers. Sixty-four listeners evaluated both natural and AI-produced speech samples across three experiments. In Experiment 1, listeners judged whether samples were real or AI-generated. Experiment 2 focused on listeners' ability to identify AI-generated voices in paired comparisons. Experiment 3 measured speech intelligibility in noise using the Hearing-in-Noise Test. RESULTS: In Experiment 1, listeners were more sensitive to differences in dysphonic voices compared with healthy voices. In Experiment 2, participants performed better when comparing pairs of real voices, achieving 66.8% accuracy. In Experiment 3, AI-generated dysphonic voices were more intelligible than natural dysphonic voices. Male dysphonic speakers demonstrated the largest increase in speech intelligibility scores, rising from 35.5% for real speech to 66.5% for AI-generated speech. Female speakers also showed consistent or enhanced intelligibility, with AI-generated dysphonic female voices reaching 67.0%. CONCLUSION: Overall, findings indicate that current AI voice cloning tools fail to replicate the reduced intelligibility of dysphonic speech, suggesting limitations in accurately modeling the acoustic features of voice disorders.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Bottalico et al. (2026) studied this question.

synapsesocial.com/papers/6a0ea074be05d6e3efb5f28ehttps://doi.org/10.1016/j.jvoice.2026.04.034
Ask AI
Helpful
Bookmark
Share
View Full Paper