Page History

• core\rapport\audio-laun - This is an audio detection app which listens to audio on the microphone, looking for key signals, like loudness, backchannel feedback, etc.  Whatever it detects, it sends out vhmsgs.
• core\rapport\gesturedetection - This is an app that communicates with Watson and based on the data received, detects if there's a head nod, head shake and other features.  It sends out vhmsgs for features that it detects.
• core\Watson - This is the vision system that uses a webcam or a firewire stereo webcam
• core\rapport\response - This is an app that receives the vhmsgs from 'audio-laun' and 'gesturedetection' and based on rules in the given config file, sends out vhmsgs to control the behavior of the character.
• core\rapport\soundwoz - This is a helper app that you can use to test out 'response' to make sure it's working correctly and the rules are set up properly.

Quick facts:

• Location: core core\rapport
• Main paper: Jonathan Gratch, Ning Wang, Jillian Gerten, Edward Fast and Robin Duffy. Creating Rapport with Virtual Agents. 7th International Conference on Intelligent Virtual Agents, Paris, France 2007