- Creator: Utrecht University Virtual Human Controller email
- Publisher: Rage project
- Owner: Utrecht University email
LipSync Generator generates lip-synchronized speech animation for the game characters given text as input.
LipSync Generator is implemented as a Unity 3D plug-in. The component works together with a Text-to-Speech (TTS) system. Since Unity 3D is multi-platform, the component can be deployed on different platforms including Web and mobile applications.
The component takes as input text, sends it to the text-to-speech (TTS) system, parses the phonemes, maps them to visemes (visual counterparts of phonemes) and finally blends them for smooth speech animation. It currently uses an off-the-shelf text-to-speech (CereVoice) library. It is also possible to link it with other TTS systems. The component provides a state-of-the-art co-articulation algorithm to generate natural lip-sync animation for game characters.
Apache 2.0 (Apache License 2.0)