met4citizen/talkinghead is a JavaScript class that implements real-time lip sync in the browser, moving a 3D avatar's mouth shapes to match the voice. The latest release is v1.7.0, and the changelog for this release is not in the material. The repository was created in August 2023.
It is a project that handles the visual representation of avatars in conversational services. It converts emojis into facial expressions, supports full-body avatars in GLB format and Mixamo animations, and renders 3D with ThreeJS and WebGL. Speech uses Google Cloud TTS by default and supports lip sync in multiple languages. It can also integrate with external TTS services that provide timestamps, so mouth shapes can be aligned to the moment of utterance. It is written in JavaScript, the license is MIT, and the GitHub star count is 1623.
The verifiable scope extends only as far as the README's feature list. There are no benchmarks in the material for rendering performance or lip sync latency. The default speech path is Google Cloud TTS, so it depends on an external API. Since the repository was created in August 2023, it is not a newly released project. The research record's momentum score is 3.1, and the novelty, technology and quality scores are not filled in. It looks like a project worth referencing when building the avatar visual representation layer yourself, but actual conversation quality and latency cannot be judged from this material alone.