Format

Send to

Choose Destination
See comment in PubMed Commons below
J Neural Eng. 2014 Jun;11(3):035015. doi: 10.1088/1741-2560/11/3/035015. Epub 2014 May 19.

Direct classification of all American English phonemes using signals from functional speech motor cortex.

Author information

1
Bioengineering, University of Illinois at Chicago, 851 S. Morgan Street, Chicago, IL 60607, USA.

Abstract

OBJECTIVE:

Although brain-computer interfaces (BCIs) can be used in several different ways to restore communication, communicative BCI has not approached the rate or efficiency of natural human speech. Electrocorticography (ECoG) has precise spatiotemporal resolution that enables recording of brain activity distributed over a wide area of cortex, such as during speech production. In this study, we sought to decode elements of speech production using ECoG.

APPROACH:

We investigated words that contain the entire set of phonemes in the general American accent using ECoG with four subjects. Using a linear classifier, we evaluated the degree to which individual phonemes within each word could be correctly identified from cortical signal.

MAIN RESULTS:

We classified phonemes with up to 36% accuracy when classifying all phonemes and up to 63% accuracy for a single phoneme. Further, misclassified phonemes follow articulation organization described in phonology literature, aiding classification of whole words. Precise temporal alignment to phoneme onset was crucial for classification success.

SIGNIFICANCE:

We identified specific spatiotemporal features that aid classification, which could guide future applications. Word identification was equivalent to information transfer rates as high as 3.0 bits s(-1) (33.6 words min(-1)), supporting pursuit of speech articulation for BCI control.

PMID:
24836588
PMCID:
PMC4097188
DOI:
10.1088/1741-2560/11/3/035015
[Indexed for MEDLINE]
Free PMC Article
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for IOP Publishing Ltd. Icon for PubMed Central
    Loading ...
    Support Center