2024-03-29T01:50:12Z
https://nagoya.repo.nii.ac.jp/oai
oai:nagoya.repo.nii.ac.jp:00025726
2023-01-16T03:51:45Z
435:671:672
Articulatory Controllable Speech Modification Based on Statistical Inversion and Production Mappings
Tobing, Patrick Lumban
76249
Kobayashi, Kazuhiro
76250
Toda, Tomoki
76251
articulatory control
direct waveform modification
intercorrelation of articulators
Gaussian mixture model
speech modification
statistical inversion and production mappings
In this paper, we present an innovative way of utilizing the natural relationship between speech sounds and articulatory movements by developing an articulatory controllable speech modification system. Specifically, we employ statistical acoustic-to-articulatory inversion mapping and articulatory-to-acoustic production mapping based on a Gaussian mixture model, allowing flexible modification of the model parameters and the independence of the text input features. Modification of an input speech signal through manipulation of the unobserved articulatory movements is achievable through a sequence of inversion and production mappings. To ensure the naturalness of articulatory movement trajectories, we introduce a method for manipulating articulatory parameters by considering their intercorrelation. Moreover, to generate high-quality modified speech sounds, we avoid the use of vocoder-based excitation generation by presenting several implementations of direct waveform modification capable of directly filtering an input speech signal using the differences in spectral parameters. The experimental results demonstrate that: 1) higher accuracy in the estimation of spectral parameters is achieved by using sequential inversion and production mappings than for conventional production mapping using measured articulatory parameters, 2) the method for manipulating articulatory parameters by considering their intercorrelation makes it possible to generate more natural trajectories of modified articulatory movements; 3) the implementations of the direct waveform modification method significantly improve the quality of modified speech sounds, even under varying speaking conditions; and 4) the controllability of the system is ensured by its capability of producing modified vowel sounds through the manipulation of appropriate articulatory configurations.
journal article
IEEE
2017-11-23
application/pdf
IEEE/ACM Transactions on Audio, Speech, and Language Processing
12
25
2337
2350
2329-9290
https://nagoya.repo.nii.ac.jp/record/25726/files/artspmod.pdf
eng
https://doi.org/10.1109/TASLP.2017.2753583
“(c) 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.”