Document in text mode:

ASSOCIATINGCHILDREN’SNON-VERBALANDVERBALBEHAVIOUR:BODYMOVEMENTS,EMOTIONS,ANDLAUGHTERINAHUMAN-ROBOTINTERACTIONA.Batliner1,S.Steidl1,2,E.N¨oth11PatternRecognitionLab,Friedrich-AlexanderUniversit¨atErlangen-N¨urnberg,Erlangen,Germany2InternationalComputerScienceInstitute(ICSI),Berkeley,CA,U.S.A.ABSTRACTInthisarticle,weassociatedifferenttypesofvocalbehaviourdenotingemotionaluserstatesandlaughterwithdifferenttypesofbodymovementssuchasgestures,forwardbends,orliveliness.OursubjectsareGermanchildrengivingcom-mandstoSony’sAiborobot;thedataarefullyrealistic.Theanalysisrevealscharacteristicandsignificantco-occurrencesofbodymovementsandvocalevents.IndexTerms—emotion,bodymovements,laughter,chil-dren,personality1.INTRODUCTIONWithinspeechscience,thefocusofinteresthasbroad-enedduringthelastyears,encompassingallkindsofnon-verbal/paralinguisticphenomenasuchasemotionaluserstates.Inthesamevein,uni-modalprocessing(speech/video,etc.)hasbeensupplementedbymulti-modalprocessing.Anoverviewofbehavioural/socialsig...