Emotion Expression
- Voerman, R.E.M. (Romera) (Unlicensed)
- Koen Hindriks
Introduction
The emotion_expression service can be used to manipulate common neutral gestures into more affective gestures for the Nao. It will take the neutral gesture in .json format and wanted affect as input and gives the affective gesture as an output.
Docker name: emotion_expression
Input
JSON file of neutral motion file
wanted affect
Output
JSON file of affective motion
Initialisation
In order to use the service, the neutral gestures need to be downloaded.
Example
See emotionexpression_example.py for an example usage.
Events
Events that the service creates and can have listeners.
Known Issues
The main issue with emotion_expression is that not every movement is stable enough to execute on the Nao.
For the manipulation of neutral gestures into emotion-based gestures, this page will provide an overview of the gestures with the evaluation of stability. Please note that if a gesture is not tested yet, the stability of that gesture is not ensured and therefore do NOT use it for NAO’s safety.
The overview is provided with all gestures out of Choregraph tested on several affects (0 = instable, 1 = stable). The affects are determined by the use of the Circumplex Model of Affect: nine intersection points are selected to cover a variation of affects. The Circumplex Model of Affect and the selected points are shown in Figure 1 below.
Â
 | Category | Neutral | Angry | Happy |
|---|---|---|---|---|
FastGatherBothHandsOnChest_LeanRight | Affirmation | 1 | Â | Â |
GatherBothHandsInFront | Affirmation | 1 | Â | Â |
GoToStance_Affirmation_Center | Affirmation | 1 | Â | Â |
GoToStance_Affirmation_LeanLeft | Affirmation | 1 | Â | Â |
GoToStance_Affirmation_LeanRight | Affirmation | 1 | Â | Â |
LittleBothArmsUp_DuckEnd | Affirmation | 1 | Â | Â |
OfferBothHands_HeadNod_LeanLeft | Affirmation | 1 | Â | Â |
SlowBowWithArms | Affirmation | 1 | Â | Â |
StrongLeftArmsInFront_LeanLeft | Affirmation | 1 | Â | Â |
WideOpenBothHands | Affirmation | 1 | Â | Â |
GoToStance_Affirmation_Flex | Affirmation | 0 | Â | Â |
StrongArmsAndLegsBump_LeanRight | Affirmation | 0 | Â | Â |
WideGatherBothHandsOnChest_LeanRight | Affirmation | 0 | Â | Â |
DoubleLeftHandBump_LeanRight | Enumeration | 1 | Â | Â |
DoubleRightHandBump_LeanRight | Enumeration | 1 | Â | Â |
GoToStance_Enumeration_Center | Enumeration | 1 | Â | Â |
GoToStance_Enumeration_LeanRight | Enumeration | 1 | Â | Â |
LeftArmBump_LeanRight | Enumeration | 1 | Â | Â |
LeftArmSpreadAndBack | Enumeration | 1 | Â | Â |
LittleFancyBothArmsInFront | Enumeration | 1 | Â | Â |
OfferLeftHandThenRightHand | Enumeration | 1 | Â | Â |
OpenBothHandsInFrontWithBump | Enumeration | 1 | Â | Â |
CircleBothArmsLeaningFront | Exclamation | 1 | Â | Â |
FastBothArmsInFront | Exclamation | 1 | Â | Â |
GoToStance_Exclamation_Center | Exclamation | 1 | Â | Â |
GoToStance_Exclamation_LeanBack | Exclamation | 1 | Â | Â |
GoToStance_Exclamation_LeanLeft | Exclamation | 1 | Â | Â |
GoToStance_Exclamation_LeanRight | Exclamation | 1 | Â | Â |
LeftArmOnChest_LeanRight | Exclamation | 1 | Â | Â |
SpreadArms_FlexEnd | Exclamation | 1 | Â | Â |
StrongNodArmsUpAndDownLeaningBack | Exclamation | 1 | Â | Â |
WideBothArmsCircle_LeanLeft | Exclamation | 1 | Â | Â |
BothArmsShowGround_LeanBack | Exclamation | 0 | Â | Â |
GoToStance_Exclamation_Flex | Exclamation | 0 | Â | Â |
LittleArmsUpAndDownWithBump | Exclamation | 0 | Â | Â |
BothArmsUpAndDown_HeadShake | Negation | 1 | Â | Â |
DoubleHorizontalBumpRightArm | Negation | 1 | Â | Â |
GoToStance_Negation_Center | Negation | 1 | Â | Â |
GoToStance_Negation_LeanLeft | Negation | 1 | Â | Â |
LittleSpreadRightArm_HeadShake | Negation | 1 | Â | Â |
StrongBothArmsUpAndDown_LeanLeft | Negation | 1 | Â | Â |
WideHorizontalRightArm_LeanLeft_HeadShake | Negation | 1 | Â | Â |
RightArmUpAndDownWithBump_HeadShake | Negation | 0 | Â | Â |
FancyRightArmCircle_LeanRight | Question | 1 | Â | Â |
GoToStance_Question_Center | Question | 1 | Â | Â |
GoToStance_Question_Flex | Question | 1 | Â | Â |
GoToStance_Question_LeanFront | Question | 1 | Â | Â |
GoToStance_Question_LeanRight | Question | 1 | Â | Â |
LittleArmsBump | Question | 1 | Â | Â |
LittleArmsBumpInFront_LeanRight | Question | 1 | Â | Â |
LittleBowAndSpreadArms | Question | 1 | Â | Â |
SlowlyOfferBothHands | Question | 1 | Â | Â |
StrongHeadShakeSpreadArms_FlexEnd | Question | 1 | Â | Â |
WideSpreakArms_FlexEnd | Question | 1 | Â | Â |
BothHandsBumpWithBump | Self&Others | 1 | Â | Â |
FastPointAtUserLeftARm | Self&Others | 1 | Â | Â |
GoToStance_Self&Others_Center | Self&Others | 1 | Â | Â |
GoToStance_Self&Others_Flex | Self&Others | 1 | Â | Â |
GoToStance_Self&Others_LeanBack | Self&Others | 1 | Â | Â |
GoToStance_Self&Others_LeanFront | Self&Others | 1 | Â | Â |
GoToStance_Self&Others_LeanRight | Self&Others | 1 | Â | Â |
OpenArmInFrontWithBump | Self&Others | 1 | Â | Â |
PointAtSelfRightArm | Self&Others | 1 | Â | Â |
PointAtUserBothHands | Self&Others | 1 | Â | Â |
StrictPointAtUserRightArm | Self&Others | 1 | Â | Â |
WidePointAtUserRIghtArm_LeanRight | Self&Others | 1 | Â | Â |
BothArmsBump_LeanRight | Spacetime | 0 | Â | Â |
StrongrmsOpen_FlexEnd | Spacetime | 0 | Â | Â |
BothArmsBumpInFront | Spacetime | 1 | Â | Â |
GoToStance_Space&Time_Center | Spacetime | 1 | Â | Â |
GoToStance_Space&Time_LeanLeft | Spacetime | 1 | Â | Â |
GoToStance_Space&Time_LeanRight | Spacetime | 1 | Â | Â |
PointFromLeftArm_LeanLeft | Spacetime | 1 | Â | Â |
ShowFarDistanceLeft | Spacetime | 1 | Â | Â |
ShowNearDistanceLeft | Spacetime | 1 | Â | Â |
ShowNearDistanceRight | Spacetime | 1 | Â | Â |
Â