What does this research mean for the field?

Neural signals recorded with a single high-density electrocorticography implant can support the simultaneous decoding of speech and gestures to enable multi-effector control in people with paralysis. Novelty: ClaimNovelty.NOVEL_FINDING. Consensus alignment: ConsensusAlignment.ESTABLISHES_NEW_DIRECTION.

What question did this study set out to answer?

To determine whether a single high-density electrocorticography implant can simultaneously decode speech and nonverbal gestures to restore natural multimodal communication in individuals with paralysis.

September 15, 2026Nature NeuroscienceOpen Access

Simultaneous speech and gesture decoding for multimodal communication in paralysis

View Full Paper

Ask AI

Bookmark

Authors

SBSamantha BroslerQB3 JLJessie R. LiuUniversity of California, San Francisco ASAlexander B. SilvaQB3

Discussion

Member takes

Implication

Experimental neuroengineering study demonstrates simultaneous speech and gesture decoding via electrocorticography in paralysis, highlighting potential for multimodal communication avatars.

Key Points

To determine whether a single high-density electrocorticography implant can simultaneously decode speech and nonverbal gestures to restore natural multimodal communication in individuals with paralysis.
Recorded neural activity using a single high-density electrocorticography (ECoG) implant across three participants with paralysis (N=3).
Designed parallel speech and gesture decoders trained on attempted isolated movements, simultaneous movements, or a combination of both to drive an expressive digital avatar.
Neural activity recorded from a single implant supported reliable decoding of isolated upper-limb and orofacial movements across all three participants.
Participants successfully controlled a personalized virtual avatar through simultaneous or isolated speech and gestures, with joint-movement training significantly boosting decoding performance across behavioral contexts.

Cite This Study

Brosler et al. (2026) studied this question.

synapsesocial.com/papers/6aa912f99013453be30a0ca6 https://doi.org/10.1038/s41593-026-02446-2

View Full Paper

Ask AI

Bookmark

September 15, 2026Nature NeuroscienceOpen Access

Simultaneous speech and gesture decoding for multimodal communication in paralysis

View Full Paper

Ask AI

Bookmark

Authors

SBSamantha BroslerQB3 JLJessie R. LiuUniversity of California, San Francisco ASAlexander B. SilvaQB3

Discussion

Member takes

Implication

Experimental neuroengineering study demonstrates simultaneous speech and gesture decoding via electrocorticography in paralysis, highlighting potential for multimodal communication avatars.

Key Points

To determine whether a single high-density electrocorticography implant can simultaneously decode speech and nonverbal gestures to restore natural multimodal communication in individuals with paralysis.
Recorded neural activity using a single high-density electrocorticography (ECoG) implant across three participants with paralysis (N=3).
Designed parallel speech and gesture decoders trained on attempted isolated movements, simultaneous movements, or a combination of both to drive an expressive digital avatar.
Neural activity recorded from a single implant supported reliable decoding of isolated upper-limb and orofacial movements across all three participants.
Participants successfully controlled a personalized virtual avatar through simultaneous or isolated speech and gestures, with joint-movement training significantly boosting decoding performance across behavioral contexts.

Cite This Study

Brosler et al. (2026) studied this question.

synapsesocial.com/papers/6aa912f99013453be30a0ca6 https://doi.org/10.1038/s41593-026-02446-2

Also Consider

Synapse has enriched 3 closely related papers on similar clinical questions. Consider them for comparative context:

View Full Paper

Ask AI

Bookmark