Animaze FAQ | Learn how to use Animaze by Facerig

Animaze Desktop: How can I use audio based lip sync?

Audio Based Lip Sync is composed of Complex Audio Based Lip Sync, SimpleAudio Based Lip Sync, Criware (default On) and Oculus Lipsync.

Animaze FAQ | Learn how to use Animaze by Facerig



1. Complex Audio Based Lip Sync supports 16 mouth shapes and is generally best used for 3D avatars, or 2D avatars with very detailed mouths. Tune the Complex Audio Based Lip Sync to your setup with the following controls:

a. Noise threshold is used to change the amplitude of the sound needed to open the avatar’s mouth. If you are in a very quiet setting, set the noise threshold low for maximum responsiveness. If there is some din, increase the noise threshold so your avatar won't appear to be chewing.

b. Hold duration (ms) sets the time duration between the moment the noise gate opens and closes. It is used to prevent the noise gate from closing between words. A longer hold duration will require more input before the mouth starts moving and a longer pause before the mouth stops moving.

c. Attack Duration (ms) represents the time duration between the moment the noise gate closes and opens. It is used to delay the lip sync interpretation from the audio input.

d. The Vowels smoothing value smoothes the mouth shapes that represent vowels.

e. The Consonants smoothing value smoothes the mouth shapes that represent consonants. 

Animaze FAQ | Learn how to use Animaze by Facerig



2. Simple Audio Based Lip Sync supports 3 mouth shapes. It is generally best for 2D avatars.

a. Voice Pitch adjusts the lip sync algorithm to the user’s voice frequency. The higher your voice is, the higher the value of the slider should be. Conversely, if your voice frequency is lower, the lower the value of the slider should be.

b. Voice Speed adjusts the lip sync algorithm to the user’s speech rate. The faster your speech rate, the higher the value of the slider should be. Conversely, if your speech rate is slower, the lower the value of the slider should be. 

c. Microphone Sensitivity adjusts how much the audio input is amplified. If you are close to the microphone, then the value should be lower. Conversely, if you are farther away from the microphone, the higher the value of the slider should be.

Animaze FAQ | Learn how to use Animaze by Facerig



3. Criware (default On) detects vowels that are remapped to the Animaze viseme system.

a. Noise threshold is used to change the amplitude of the sound needed to open the avatar’s mouth. If you are in a very quiet setting, set the noise threshold low for maximum responsiveness. If there is some din, increase the noise threshold so your avatar won't appear to be chewing.

b. Hold duration (ms) sets the time duration between the moment the noise gate opens and closes. It is used to prevent the noise gate from closing between words. A longer hold duration will require more input before the mouth starts moving and a longer pause before the mouth stops moving.

c. Attack Duration (ms) represents the time duration between the moment the noise gate closes and opens. It is used to delay the lip sync interpretation from the audio input.

Animaze FAQ | Learn how to use Animaze by Facerig

4. OVR Lip-Sync (Oculus) detects 15 mouth shapes that are remapped to the Animaze viseme system.

a. Noise threshold is used to change the amplitude of the sound needed to open the avatar’s mouth. If you are in a very quiet setting, set the noise threshold low for maximum responsiveness. If there is some din, increase the noise threshold so your avatar won't appear to be chewing.

b. Hold duration (ms) sets the time duration between the moment the noise gate opens and closes. It is used to prevent the noise gate from closing between words. A longer hold duration will require more input before the mouth starts moving and a longer pause before the mouth stops moving.

c. Attack Duration (ms) represents the time duration between the moment the noise gate closes and opens. It is used to delay the lip sync interpretation from the audio input.

Animaze FAQ | Learn how to use Animaze by Facerig


After you have enabled one of the available lip sync trackers and made changes to it, click on Save to save your tracking preferences and exit the Audio Based Lip Sync drawer menu.


©2020, Animaze, Inc. and the Animaze logo are registered and/or unregistered trademarks of Holotech Studios Inc.