Page History
...
Watson is a real-time visual feedback recognition library for interactive interfaces that can recognize recognizes head gaze, head gestures, eye gaze and eye gestures using the images of a monocular or stereo camera.
...
You can start Watson from the toolkit Launcher (work in progress). By default, Watson for the toolkit Toolkit is configured to work with a USB camera using the VFW (Video for Windows) driver. If using a different camera or driver, you need to change the camera type parameter accordingly. See the developer section below for details.
Developers
Configuring
In order to To use Watson with the rest of the Virtual Human toolkitToolkit, set parameters need to be set in ParamWatsonUser.cfg found in core\Watson\Sequences\USB.
...
By default, Watson for the Toolkit is configured to work with a USB camera using the VFW (Video for Windows) driver. If using a different camera or driver, you need to change the camera type parameter accordingly.
...
CAMERA_TYPE is USB_DIRECTX for DirectX driver or DRAGONFLY for Point Grey DragonFly camera. If using Stereo Camera, please see the section on 'Configuration for Stereo Camera'.
Configuration for Stereo Camera
In order to To use Watson with the toolkit Toolkit using Stero cameraStereo Camera, use the 'Watson-Stereo Camera' shortcut created during installation. The 'Start In' or 'Working Directory' for stereo camera Stereo Camera is set to be core\Watson\Sequences\SRI. However, the configuration file 'ParamWatsonUser.cfg' in this directory is not configured to work with the rest of the Toolkit by default. The Add the section to set up ActiveMQ messaging needs to be added to the ParamWatsonUser.cfg so Watson can . This will enable Watson to send messages and work with the rest of the Toolkit. See the 'Setting up ActiveMQ messaging' sections for activating ActiveMQ messaging for Stereo Camera set up.
...
Note: If using the core\Watson\Sequences\USB\ configuration for VH toolkit, this section should already be set up in the configuration file. If using other Watson configuration (such as core\Watson\Sequences\SRI for stereo cameraStereo Camera, add this section to the ParamWatsonUser.cfg file
...
This activates ActiveMQ messaging and will start sending messages related to head nod nods and facing. The facing message tells which object (or character) you are facing.
...
The commands related to facing are deifined defined so that a region in 3D space is created and associated to a caption. To create the region of interest (ROI), imagine a plane parallel to the image plane of the camera.
Eg: e.g., In case of a webcam in a laptop, the computer screen is already parallel with the camera. The camera is the referential(0,0,0). When looking at the camera, the X axis goes (positive) to the right. The Y axis goes (positive) up.
Regions of Interest on the screen can be associated by adding the appropriate caption and coordinates as shown in the example below. The example assumes that we are creating two Regions of Interest with captions "doctor" and "elder" and shows how to associate coordinates to these captions in order to created create ROIs.
A "doctor" region can be associated to the right part of the screen by adding these two commands at the end of ParamWatsonUser.cfg (after the section statement):
...