Associating children's non-verbal and verbal behaviour: body

4 pages - 160.8 KB
Movements, emotions, and laughter in a human-robot interaction ... encompassing all kinds of non- verbal/paralinguistic phenomena such as emotional user.
Document in text mode:
ASSOCIATINGCHILDREN’SNON-VERBALANDVERBALBEHAVIOUR:BODYMOVEMENTS,EMOTIONS,ANDLAUGHTERINAHUMAN-ROBOTINTERACTIONA.Batliner1,S.Steidl1,2,E.N¨oth11PatternRecognitionLab,Friedrich-AlexanderUniversit¨atErlangen-N¨urnberg,Erlangen,Germany2InternationalComputerScienceInstitute(ICSI),Berkeley,CA,U.S.A.ABSTRACTInthisarticle,weassociatedifferenttypesofvocalbehaviourdenotingemotionaluserstatesandlaughterwithdifferenttypesofbodymovementssuchasgestures,forwardbends,orliveliness.OursubjectsareGermanchildrengivingcom-mandstoSony’sAiborobot;thedataarefullyrealistic.Theanalysisrevealscharacteristicandsignificantco-occurrencesofbodymovementsandvocalevents.IndexTerms—emotion,bodymovements,laughter,chil-dren,personality1.INTRODUCTIONWithinspeechscience,thefocusofinteresthasbroad-enedduringthelastyears,encompassingallkindsofnon-verbal/paralinguisticphenomenasuchasemotionaluserstates.Inthesamevein,uni-modalprocessing(speech/video,etc.)hasbeensupplementedbymulti-modalprocessing.Anoverviewofbehavioural/socialsig...