Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 39 Next »

SIC

SIC is a framework for quickly getting started with social robotics by making it simple to combine complex devices such as Nao’s and powerful services such as Google Dialogflow.

Getting started with SIC consists of a few basic steps:

  1. Installing SIC on your device

  2. Installing SIC on your robot

  3. Starting Redis and SIC on your device

  4. Starting SIC on your robot

  5. Start your program to control the robot

Installation

You can find the instructions on how to install the framework here: Install.
Please follow those instructions carefully since you will also be installing the framework on the robot(s).

Setup

Once installed to all devices you want to use, we can start the framework.

This consists of three (or four) steps:

  1. Start redis

  2. Start the device services on the robot

  3. (Optional) Start a service, such as face detection

  4. Run your program

Starting Redis and SIC on your laptop

To enable communication between all your devices, we have to start Redis on some device.

This can be done in two ways: By starting redis yourself or using docker.

In a (WSL) terminal, start redis using

# in the `framework` folder:

redis-server conf/redis/redis.conf
 Docker alternative to start redis (for windows without WSL)

Start it on your laptop in the root framework framework folder (for MacOS and Windows: make sure Docker Desktop is running).

cd your/path/to/framework
docker compose up redis

This should start print Container framework-redis-1 Created which means Redis is up and running.

Optionally, you can now start other services on your laptop, such as text to speech, either using docker

docker compose up text2speech

Or by starting the service in a terminal. For example:

cd framework/sic_framework/services/text2speech
python3 text2speech_service.py

Starting SIC on the Robot (NAOv6)

 Notes on windows installation

This script sets environment variables and start the framework on the robot. However, running scripts on windows is not very simple. If you cannot execute the scripts by calling them from a powershell terminal, open them using a text editor and copy the commands into the terminal manually. Remember to adjust variables such as IP addresses

In a new terminal, start the framework on the robot using 

cd framework/sic_framework/scripts/
sh ./start_nao.sh -r ROBOT_IP 

# Windows:
.\start_nao.ps1 ROBOT_IP REDIS_IP

Where:

  • ROBOT_IP is the adress of the Nao or Pepper robot

  • REDIS_IP the ip adress of your laptop/desktop where redis is running

Example command:

sh ./start_nao.sh -h 192.168.0.116 
# or sh ./start_pepper.sh -h 192.168.0.116

# Windows
.\start_nao.ps1 192.168.0.116 192.168.0.181

This should show an output like 

nao@nao:~/framework/sic_framework/devices$ python nao.py 
Starting service manager on ip "192.168.0.151" with services:
 - NaoqiMicrophone
 - TopNaoCamera
 - BottomNaoCamera
Starting service manager on ip "192.168.0.151" with services:
 - NaoMotionReplayAction
 - NaoMotionRecorderAction
 - NaoMotionAction
 - NaoMotionStreamConsumer
 - NaoqiTextToSpeechAction
 - NaoMotionStreamProducer
 - NaoqiTabletService

Or due to a bug with stdout:

Starting robot (due to a bug output may or may not be produced until you start your program)
[SICSensorManager-192.168.0.151 192.168.0.151]: INFO: Manager on device 192.168.0.151 starting
[SICComponentManager-192.168.0.151 192.168.0.151]: INFO: Manager on device 192.168.0.151 starting

 Manually starting the device services

You can also log in to the robot and start the device services in a terminal.

ssh nao@ROBOT_IP
# or ssh pepper@ROBOT_IP

cd framework/sic_framework/devices

export DB_IP=REDIS_IP # replace with the ip of your computer

python nao.py
# or python pepper.py

Running a demo

To start a demo, for example to show pepper’s camera output on your screen, simply execute a python script with a SICApplication. Some demos are available in the docker/sic/sic_framework/tests folder.

Terminal

To start the camera demo from the terminal, use the following commands.

Note: This demo requires you to have the OpenCV and tqdm modules and libjpeg-turbo installed, as well as have the framework installed on a NAO robot (see above). On Windows, moreover, the libjpeg dependency may not be automatically be found, and you may need to set the path to libturbojpeg.dll manually.

cd framework/sic_framework/tests
python demo_nao_camera.py

If all went well, a display should pop up showing you the camera output of your robot!

API

The goal of SIC is to provide easy to use high level access to devices and services. To make a NAO robot say something, follow the startup instruction in https://socialrobotics.atlassian.net/wiki/spaces/CBSR/pages/2180415493/Install#Starting-SIC-on-the-Robot and run the following python script on your laptop.

from sic_framework.devices.common_naoqi.naoqi_speakers import NaoqiTextToSpeech, NaoqiTextToSpeechRequest

nao_tts = NaoqiTextToSpeech(ip='192.168.0.236')
nao_tts.request(NaoqiTextToSpeechRequest("Hello!"))
  • No labels