...
On today’s lab, we have Hong’s computer connected to Pepper robot and has run a few gesture examples of pepper robot. Maike, Hong and Yi have been discussing on what modules in Mediapipe library to use to have inputs from different users to teach Pepper robot. We have tried to use hands module on Mediapipe library and thinking to use different hands gestures as input to teach Pepper robot to differentiate users to have different actions, but it didn’t work. We have also tried to use object detection module on Mediapipe library to detect different objects with cameras.
...
Challenges and obstacles: We have difficulty in trying different modules of Mediapipe library and also other libraries to have reinforcement learning and Machine learning of Pepper robot. We are trying to figure that out. And also we try to use Choreographe to perform wave and high-five gestures on Pepper robot, but after installing Choreographe when we open the software, there comes an error. So we are trying to install Binary version of Choreographe to try to have it installed successfully.
...
On Saturday, I have been working on learning about Computer Vision libraries such as OpenCV and its functions of age_and_gender_detection. I have also used my laptop camera to have real-time age_and_gender_detection function running and see how is effect and how accurate for prediction. It seems age_and_gender_detection function is basically working well as long as I stay close to the camera. But sometimes when I turned my head, the function cannot recognize my gender correctly. Once I face the camera, it predicts correct. I was thinking how to have Pepper robot’s camera to perform age_and_gender_detection function.
...
Obstacles and challenges: To have Pepper’s camera to implement age and gender detection. And need to solve opening error problem of Choreographe. The third challenge is to load Speech Greeting in Korean languages after detecting users’ age and gender for different groups of human users.
...