JAIST Repository >
School of Information Science >
Articles >
Journal Articles >

Please use this identifier to cite or link to this item: http://hdl.handle.net/10119/16701

Title: Voice conversion for emotional speech: Rule-based synthesis with degree of emotion controllable in dimensional space
Authors: Xue, Yawen
Hamada, Yasuhiro
Akagi, Masato
Keywords: Emotional voice conversion
Rule-based speech synthesis
Emotion dimension
Three-layered model
Fujisaki F0 model
Target prediction model
Issue Date: 2018-07-19
Publisher: Elsevier
Magazine name: Speech Communication
Volume: 102
Start page: 54
End page: 67
DOI: 10.1016/j.specom.2018.06.006
Abstract: This paper proposes a rule-based voice conversion system for emotion which is capable of converting neutral speech to emotional speech using dimensional space (arousal and valence) to control the degree of emotion on a continuous scale. We propose an inverse three-layered model with acoustic features as output at the top layer, semantic primitives at the middle layer and emotion dimension as input at the bottom layer; an adaptive-based fuzzy inference system acts as connectors to extract the non-linear rules among the three layers. The rules are applied by modifying the acoustic features of neutral speech to create the different types of emotional speech. The prosody-related acoustic features of F0 and power envelope are parameterized using the Fujisaki model and target prediction model separately. Perceptual evaluation results show that the degree of emotion can be perceived well in the dimensional space of valence and arousal.
Rights: Copyright (C)2018, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International license (CC BY-NC-ND 4.0). [http://creativecommons.org/licenses/by-nc-nd/4.0/] NOTICE: This is the author's version of a work accepted for publication by Elsevier. Yawen Xue, Yasuhiro Hamada, and Masato Akagi, Speech Communication, 102, 2018, 54-67, http://dx.doi.org/10.1016/j.specom.2018.06.006
URI: http://hdl.handle.net/10119/16701
Material Type: author
Appears in Collections:b10-1. 雑誌掲載論文 (Journal Articles)

Files in This Item:

File Description SizeFormat
2814.pdf1019KbAdobe PDFView/Open

All items in DSpace are protected by copyright, with all rights reserved.


Contact : Library Information Section, Japan Advanced Institute of Science and Technology