Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
  • If you checked the "'Run Virtual Human Toolkit Launcher" ' option at the end of the installation, the launcher will Launcher will begin automatically. Otherwise Otherwise, use "'run-launcher.bat" ' in your installation folder ("c:\vhtoolkit" by default).
  • The launcher Launcher allows users to launch and kill quite entire scenarios or a subset of the needed components. See  See the Launcher documentation for more detail.
  • In order to launch all components needed for Bradthe example scenario, click the Launch button button with the green icon ('launch') in the Run Checked row, under the Run It All section. Be sure to quickly click OK in the settings window that will pop up. 
  • A variety of modules start minimized, after which Unity comes up full-screen.  This can take a few moments. All kinds of windows will now pop up. After a while all the rows in the Launcher that have a checked check box should be green. If all of them are orange, make sure ActiveMQ is running. If a few are orange, try to load those manually.
  • When all modules are up and running correctly, select the VHToolkitGB window (the renderer, Gamebryo), and AcquireSpeech, a Java program. These are the only two windows you need in order to interact with Brad.
  • In AcquireSpeech, go to the Player tab, type in a question in the Text field and hit Enter or click Send. Try saying "hello", for example. Brad should greet you back. You should hear him talk and his lips should be moving. As the toolkit is currently not providing many animations, he might come across as a bit static, although he should be moving his body a little bit. For short answers he might not use any gestures, for longer answers Brad is more likely to gesture. Blinking is currently disabled. You can ask Brad high level questions about the toolkit and himself. Brad is not meant to be an online tutor on how to use the toolkit. If he does not answer some of your questions, we would love to hear which ones.

Notes:

  • fully loaded, Brad and Rachel will introduce themselves.  After this, a window will pop up with tips; you can read these or close the window.
  • By default, you can interact with the characters by holding the left mouse button for each question you ask them, just like a walky-talky.  For best results, use a good microphone, start holding the button half a second before you talk and release it half a second after you're done.  You'll notice that the blue microphone icon in the lower left turns orange when you hold the mouse button, indicating the characters are listening to you.  You will the the results of what the speech recognizer thinks you said in white letters above the character; you can toggle this on and off with the 'O' key.  Their response is subtitled in yellow, which you can toggle on and off with the 'I' key.
  • Alternatively, you can type in your questions.  Hit the 'M' key to turn off the microphone listening mode; this will grey out the microphone icon and gives you control over the mouse cursor.  Click the text box at the bottom, type your question, and hit enter to ask it. 
  • The characters can talk about themselves, the Toolkit and related topics.

Notes:

  • Before launching the scenario, you can change some of the default settings, like resolution and whether to play the intro.  Click 'Advanced' on the Launcher and change the parameters in the 'Renderer' row.
  • If you are not seeing the expected results, click 'Advanced' in the Launcher and see if all the checked rows are green.  If all of them are orange, make sure ActiveMQ is running; right-click on Computer in the start menu, select Manage, expand Services and Applications, click on Services and see if the ActiveMQ service is running.  If it is listed and not running, select it and click the Play icon above or right click and select Start. If it is not listed, use the Toolkit installer with 3rd party software and make sure the ActiveMQ box is selected. If some Launcher rows are green and others are orange, try launching the orange ones manually and note any errors. You can bring up the Launcher command line with 'CTRL + T'. 
  • If you run into any other problems, please see the FAQ for possible solutions or use the available Support channels.
  • Use the 'J' key to toggle mouse look, and the 'W', 'A', 'S' and 'D' keys to move the camera. For more keyboard controls in Unity, see vhtoolkitUnity
  • A renderer needs to be up and running before SmartBody starts. Both Gamebryo and Ogre will present you with a small settings window in which you can change settings like resolution. By default, all modules wait for 15 seconds on the renderer before starting. This means you need to quickly select OK in order for the renderer to start loading. If the renderer has not finished loading before all other modules start, go to the Launcher, kill the renderer and SmartBody, and manually launch the renderer again. This time, wait till it has finished loading and then launch Smartbody.
  • You can disable the Gamebryo settings window from popping up by checking "Do not show this dialog again". If you have changed the settings, also check "Save settings" so that the next time Gamebryo loads, it has your preferred settings. You can get the settings window back by deleting "c:\svn_vhtoolkit_trunk\core\vhtoolkitGB\AppSettings.ini".
  • For better graphics, try increasing the resolution or the multisampling. The latter will show Brad with less hard edges. To do this, click Advanced and select a value from the Multisampling drop down menu. 2 or 4 multisamples should provide a noticeable difference.
  • If the graphics seem sluggish, select the Gamebryo window and hit the Z key on your keyboard. This will show the framerate at the top left of the screen. If this is low (under 20 to 30 frames per second), select the '-' key (minus, next to zero) on your keyboard to disable dynamic shadows. This should improve the framerate considerably, although the graphics will look a lot less good. We are currently working on a happy medium.
  • If you run into any problems, please see the FAQ for possible solutions.