Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Clarified and simplified, removed redundant language, made Launcher suggested launch method, formatting

...

MultiSense currently supports a lot of modules like vision multiple modules, including a vision module (for tracking face features, smiles, gaze, attention, activity, gestures, among others), and a speech recognition module. To run the use MultiSense, the user needs to simply run the MultiSense application which basically sends out , and it will broadcast the vrPerception messages (based on pml) generated by each module, which can be subscribed to by any module for specific dataor external component.

...

Using MultiSense

There are two main steps involved in running MultiSense -Two components are required to make full use of MultiSense, the MultiSense Application, and the Perception Appliclation.

Running MultiSense Application

To run the MultiSense moduleApplication, either

  • Run the application from the Launcher
  • Navigate to \bin\multisense\ssi_vhmsger\bin folder and run "run.bat".
  • Or, after you run the launcher from \run-launcher.bat, click on the launch for MultiSense.

By default, only Gavam and CLM facetracker are turned on (for the toolkit; otherwise only the Gavam is turned on). If you wish to change the configuration for running other modules, you can navigate to edit \bin\multisense\ssi_vhmsger\bin\config.ini and change the "useXXXX"  parameter to "true" to make a module work. Note, that if the dependencies for the module are not setup correctly, the ssi_vhmsger will crash. Another thing to note is that If you want to run FAAST, make sure the "useKinect" as well as "useFAAST" parameters are both "true" in the config.ini. Make sure to have a web cam connected to the computer.

If the application fails to start, one of dependencies might be missing.

Currently the ssi_vhmsger will not get killed when you click the "Kill" button from the launcher. Also, if you try to kill it from the launcher, the ssi tool will turn yellow.

Running the Perception

...

Application (PerceptionTest)

To run the PerceptionTest application, either

  • Run it from the Launcher
  • Navigate to \bin\multisense\PerceptionTest\ and run "PerceptionTest.exe".Or, after you run the launcher from \run-launcher.bat, click on the launch for Perception Application.

Please contact either Unknown User (suri) or Unknown User (stratou) if you have any issues in running the application

...

  • The MultiSense Application currently does not listen to the vrKillComponent message, which means if the user tries to kill it from the launcherLauncher, it will turn yellow and not close. The user has to manually close the application.
  • If the application does not seem to start up, make sure the your camera is working properly in your computer. Also, if there is camera.option file present at the location "\bin\multisense\ssi_vhmsger\bin", delete it and try to run the application again. If there is a problem with running MultiSense, please contact us at vh-support@ict.usc.edu
  • If the user enables Gavam and sees a big red X on the screen, it only means that Gavam is not able to detect the face properly. Currently, there is no way to reset Reset (other than restarting the application). The user can restart CLM tracker though by right clicking the output window.

...