Page History
| Table of Contents | ||
|---|---|---|
|
Overview
This page explains The Toolkit provides an example of how to use the MultiSense framework framework (also known as multimodal framework, developed by Multicomp Lab) focusing on .
Multisense uses these technologies:
- CLM (developed by Jason Saragih et .al)
...
- Gavam (developed by Louis-Philippe Morency's Multicomp Lab) face-tracker
...
- Kinect
...
- FAAST (developed by Mixed Reality Group)
...
- ssi Library (developed by Johannes Wagner, University of Augsburg).
Each
...
module is implemented within the MultiSense framework and runs in separate threads in a synchronized manner. The output from the MultiSense framework is PML (the pml xml schema can be found at PML.xsd)
...
There are The Toolkit includes two main components within the that use MultiSense -:
- ssi_vhmsger (\core\multisense\ssi_vhmsger\)
This is the core application which is that uses MultiSense. It will only work if you have a web cam installed with on the system. This integrates all the many different MultiSense components like vision, audio and packages analysis into a single application whose output is a that outputs PML. - PerceptionTest (\core\multisense\PerceptionApplication)
This application is a middle-man between the ssi_vhmsger and any other application which plans to use the PML for specific capabilities. For example, in the toolkitToolkit, this application takes input the PML as input (via the vrPerception messagesmessage) and outputs messages to the smartbody Smartbody to mimic the head orientation of the detected user.
...
Overview
Content Tools
Activity