Electrical Engineering and Computer Science
Permanent URI for this collection
Browse
Browsing Electrical Engineering and Computer Science by Subject "AI"
Now showing 1 - 1 of 1
Results Per Page
Sort Options
Item Open Access A Cloud-Based Extensible Avatar For Human Robot Interaction(2019-07-02) AlTarawneh, Enas Khaled Ahm; Jenkin, MichaelAdding an interactive avatar to a human-robot interface requires the development of tools that animate the avatar so as to simulate an intelligent conversation partner. Here we describe a toolkit that supports interactive avatar modeling for human-computer interaction. The toolkit utilizes cloud-based speech-to-text software that provides active listening, a cloud-based AI to generate appropriate textual responses to user queries, and a cloud-based text-to-speech generation engine to generate utterances for this text. This output is combined with a cloud-based 3D avatar animation synchronized to the spoken response. Generated text responses are embedded within an XML structure that allows for tuning the nature of the avatar animation to simulate different emotional states. An expression package controls the avatar's facial expressions. The introduced rendering latency is obscured through parallel processing and an idle loop process that animates the avatar between utterances. The efficiency of the approach is validated through a formal user study.