"“Emo Sim”: Expressing Voice–Based Emotions in Mobile Interfaces"

Dr. Rasika Ranaweera ,Senior Lecturer/Dean ,Faculty of Computing ,ranaweera.r@nsbm.ac.lk

Subjects:  “Emo Sim”: Expressing Voice–Based Emotions in Mobile Interfaces


Human interaction with mobile devices is currently a very active research area. Speech which is enriched with emotions is one of the major ways of exchanging ideas, especially via telephony. By analyzing voice stream using a program created in matlab, different emotions of human voice can be recognized. Using a simple Java client the recognized emotions are delivered to a sever as an index number. A mobile client then retrieves the emotion and displays it through colored icons. Each emotion is mapped to a particular color since it is natural to use colors to represent various expressions. We believe, with the help of this application one could conceivably, avoid chatting with somebody whose emotional state is negative! Immersive Virtual Environments such as Second Life and Wonderland allow users to meet in synthetic worlds, performing shared object manipulation and other group tasks including voice chat. By extending the emotion classifier user‘s feelings can be conveyed as gestures (actually animations) of avatar inside the virtual world.