Publication
Title
Simulating speech processing with cochlear implants: How does channel interaction affect learning in neural networks?
Author
Abstract
We introduce a novel machine learning approach for investigating speech processing with cochlear implants (CIs)-prostheses used to replace a damaged inner ear. Concretely, we use a simple perceptron and a deep convolutional network to classify speech spectrograms that are modified to approximate CI-delivered speech. Implant-delivered signals suffer from reduced spectral resolution, chiefly due to a small number of frequency channels and a phenomenon called channel interaction. The latter involves the spread of information from neighboring channels to similar populations of neurons and can be modeled by linearly combining adjacent channels. We find that early during training, this input modification degrades performance if the networks are first pre-trained on high-resolution speech-with a larger number of channels, and without added channel interaction. This suggests that the spectral degradation caused by channel interaction alters the signal to conflict with perceptual expectations acquired from high-resolution speech. We thus predict that a reduction of channel interaction will accelerate learning in CI users who are implanted after having adapted to high-resolution speech during normal hearing. (The code for replicating our experiments is available online: https://github.com/clips/SimulatingCochlearImplants).
Language
English
Source (journal)
PLoS ONE
Publication
2019
ISSN
1932-6203
DOI
10.1371/JOURNAL.PONE.0212134
Volume/pages
14 :2 (2019) , p. 1-13
Article Reference
e0212134
ISI
000459806400055
Pubmed ID
30811448
Medium
E-only publicatie
Full text (Publisher's DOI)
Full text (open access)
UAntwerpen
Faculty/Department
Research group
Project info
Bootstrapping operations in language acquisition: a computational psycholinguistic approach.
Publication type
Subject
Affiliation
Publications with a UAntwerp address
External links
Web of Science
Record
Identifier
Creation 04.04.2019
Last edited 01.01.2025
To cite this reference