Playing audio and lip sync

There are avatars and BOT. So far BOT is for chatting and Avatar is kind of animation. With the avatar it should be possible to play audio sound with lip sync.

What kind of API support is there to achieve this in IOS and Java?

The avatars normally use our Text To Speech support for speech (or native TTS in HTML5, Android, and iOS).

You can also associate audio files for actions and poses.

We do not have support for associating real speech audio files with responses yet, but that is something we plan on. Currently if you have your own speech audio files you can use our SDK to have an avatar simulate speaking them. You can copy the SDK source code that uses our TTS audio and insert your own speech audio. You will need to code this yourself.

Currently if you have your own speech audio files you can use our SDK to have an avatar simulate speaking them. You can copy the SDK source code that uses our TTS audio and insert your own speech audio.

-> Could you please let me know in which file / class we can insert our own audio files?

You can copy the SDK source code that uses our TTS audio and insert your own speech audio.

-> So far, in Java SDK source code I did not find any such place to insert own audio. What I have found in the sample application that it plays the audio file returned from server in default player and the video of the avatar in media player in Android. According to the sample the video is looping until the audio is finished.

Could you please clarify this!

Which SDK are you using, JavaScript, Android, or iOS?

Actually we are investigating Java SDK for Android / Java app and JavaScript both SDK.

There is no support in the SDK for playing your own audio file.
You will need to modify the code, or subclass the class and overwrite the code playing the audio and switch it to use your own audio file.

Playing audio and lip sync

Browse

Help

Info

Links