Page History

...

Unity3D is a 3rd party proprietary rendering engine and is provided as binary-only with the Virtual Human Toolkit. For changing art assets, you would need to purchase Unity Pro here. The toolkit also contains an open source renderer, Ogre, which only serves as a proof-of-concept and is not fully supported.

Users

Launching Unity

In the Launcher, click the Launch button in the Renderer row (click the Advanced button if you don't see any rows). Be sure to have the Engine parameter set to 'Unity'. A small option screen pops up allowing you to select several graphical settings. The most important ones are:

...

Once you're happy with your settings, click Play!. Unity should now continue loading.

Navigating Unity

You can use the W,A,S and D keys to move the camera around, Q and E to move it up and down. Hit J to toggle mouse look; this allows you to use the mouse to change the direction the camera is facing.

Interact with Brad Using Text

Toggle the text box with L. Use the arrow keys to see suggested questions, or type in your own questions. Hit Say to ask Brad the question.

Interact with Brad Using Speech

You can talk to Brad using a mouse and microphone when Unity is in full screen mode. Use the M key to turn this ability on and off. When the ability is on, click and hold the left mouse button while you are asking your question, and release when you're done talking.

Keyboard Commands

• W,A,S,D - camera movement. Q & E - camera up/down
• J - mouse visibility toggle - mouse look mode
• L - toggles the fake recognizer text box
• O - toggles the user's recognized text
• M - (fullscreen window only) - toggles speech recognition mode. When on, click and hold and talk in the mic. Release to quit talking.
• X - reset camera
• Z - show debug statistics
• I - Toggles sbm character subtitles
• P - Toggle entire GUI
• Alt-enter - toggle windowed / fullscreen
• Escape - quit

Command Console

Use the ~ key to bring up the console.

See Using the Console

Developers

Loading VHToolkit Scene

1. Open Unity
2. File->Open Project (this may already be done for you if this is the first time you've launched Unity)
3. On the Open Project tab, click the Open Other button.
4. Navigate to the VHToolkit Unity Project here: <VHToolkit>\core\vhtoolkitUnity
5. Click Select Folder
6. In the Project column, double click on vhtoolkitScene.
7. Click Play

Creating your own Project using the VHToolkit Unity Package

1. Open Unity
2. File->New Project
3. Copy the vhAssetsPackage.unitypackage file to this new project. You'll find it here: <VHToolkit>\bin\vhtoolkitUnity\vhAssetsPackage.unitypackage. Copy this file to <your project>\Assets
4. In Unity, in the Project column, double click on the vhAssetsPackage file
5. You now have a Unity project containing all of the VHToolkit code needed to create your own virtual human.

Creating a Virtual Human using the VHToolkit Unity Package (simple)

1. Open Unity
2. Copy bin/vhtoolkitUnity/vhAssetsPackage.unityPackage and bin/vhtoolkitUnity/vhAssetsTestScenePackage.unityPackage into <your project>\Assets
3. Double click vhAssetsPackage in the project view and import
4. Double click vhAssetsTestScenePackage in the project view and import
5. Open vhAssetsTextScene

Creating a Virtual Human using the VHToolkit Unity Package (detailed)

These steps assume you have virtual human art assets.

...

1. 1. (Unity Pro) Go to GameObject->Create Empty.
   2. (Unity Pro) Drag NewBehaviourScript to GameObject in the Hierarchy
   3. (Unity Pro) Copy sbm-common folder to get Smartbody assets. Copy <VHToolkit>\data\sbm-common to <your project>\Assets\sbm-common
   4. <todo> Add simple lighting
2. Now we are ready to test
   1. In Unity, hit Play button
   2. (Unity Free) Launch Smartbody as a separate process. Run <VHToolkit>\tools\launch-scripts\run-toolkit-sbm.bat
   3. Brad should appear and animating with his idle animation.
   4. Try and play an animation
   5. Open the Unity debug console by hitting tilde (~)
   6. Type the following command: vhmsg sbm bml char brad anim HandsAtSide_Arms_Chop

Message API

ReceivingReceives:

• vrAllCall
• vrKillComponent
• PlaySound

SendingSends:

• vrComponent
• vrProcEnd

Using the Console

Hit the ~ key to bring up the console. Here you can see some debug information. Type 'help' for all available commands.

...