JAIST Repository >
School of Information Science >
Conference Papers >
Conference Papers >

Please use this identifier to cite or link to this item: http://hdl.handle.net/10119/12328

Title: Emotional Speech Recognition and Synthesis in Multiple Languages toward Affective Speech-to-Speech Translation System
Authors: Akagi, Masato
Han, Xiao
Elbarougy, Reda
Hamada, Yasuhiro
Li, Junfeng
Keywords: Speech-to-speech translation (S2ST) system
paralinguistic and non-linguistic information
emotion recognition/synthesis
multiple languages
Issue Date: 2014-08
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Magazine name: 2014 Tenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP)
Start page: 574
End page: 577
DOI: 10.1109/IIH-MSP.2014.148
Abstract: Speech-to-speech translation (S2ST) is the process by which a spoken utterance in one language is used to produce a spoken output in another language. The cnventional approach to S2ST has focused on processing linguistic information only by directly translating the spoken utterance from the source language to the target language without taking into account para-linguistic and non-linguistic information such as theemotional states at play in the source language. In this work, we explore how to deal with para- and non-linguistic information among multiple languages, with a particular focus on speakers’ emotional states, in S2ST scenarios called “affective S2ST.” In our efforts to construct an effective system, we discuss (1) how to describe emotions in speech and how to model the perception/production of emotions and (2) the commonality and differences among multiple languages in the proposed model. We then use these discussions as context for (3) an examination of our “affective S2ST” system in operation.
Rights: This is the author's version of the work. Copyright (C) 2014 IEEE. 2014 Tenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), 2014, 574-577. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
URI: http://hdl.handle.net/10119/12328
Material Type: author
Appears in Collections:b11-1. 会議発表論文・発表資料 (Conference Papers)

Files in This Item:

File Description SizeFormat
IIHMSP_MS_Akagi.pdf533KbAdobe PDFView/Open

All items in DSpace are protected by copyright, with all rights reserved.

 


Contact : Library Information Section, Japan Advanced Institute of Science and Technology