About the Role
We are building a next-generation, global AI digital teacher capable of delivering personalized experiences for millions of users, featuring real-time interaction, precise lip-syncing, and emotion-driven gestures.
Key Responsibilities:
- Design and develop a Web player SDK for virtual character animation models, allowing business users to load and control virtual characters using a simple API.
- Based on Phaser 4.1 or related Web graphics technologies, implement capabilities such as character animation rendering, sequence frame atlas playback, action switching, and synchronized audio playback.
- Implement playback modes such as RTH/FFA/CFA:
- RTH: Real-time mixed frame animation in basic state, supporting real-time lip-syncing with AIGC body + mouth patch.
- FFA: Advanced action full-frame animation, supporting synchronized playback of sequence frames and fixed audio.
- CFA: Controllable frame animation, supporting control of action frames and audio playback based on business events.
- Collaborate with the TTS/viseme team to implement the lip-sync timeline protocol, achieving runtime driving from phoneme/viseme timeline to lip-sync animation.
- Design the player's internal state machine, supporting stable switching between basic state, speaking state, advanced actions, and custom actions.
- Responsible for animation resource loading, caching, preloading, memory control, and performance optimization on low-end devices.
- Collaborate with media pipeline engineers to define and consume data formats such as role configurations, atlas manifest, mouth time line, and Mouth Attachment.
- Output player integration documentation, API documentation, demo examples, and debugging tools to support integration with business-side applications such as online course products.
Requirement:
- 3+ years of web front-end development experience, with experience in complex animations, interactive H5, mini-games, web visualizations, or player SDK related projects.
- Proficient in using AI programming and efficiency tools to assist R&D work, able to leverage AI to improve efficiency in solution research, code implementation, troubleshooting, documentation, and automation tool development.
- Familiar with JavaScript/TypeScript, possessing strong engineering and module design capabilities.
- Familiar with at least one web graphics or game rendering technology, such as Phaser, PixiJS, Canvas, WebGL, Three.js, Cocos Creator Web, etc.
- Understand basic concepts such as sequence frame animation, Texture Atlas, frame rate control, resource preloading, and animation state machines.
- 6. Possess performance optimization awareness, able to handle loading speed, memory usage, frame rate, and stuttering issues on low-end mobile devices.
- Able to collaborate efficiently with animation, art, algorithm, backend/TTS, and business front-end teams to ensure the stable implementation of player capabilities.
- Requirements for code quality, interface design and maintainability; the ability to develop reusable SDKs, rather than just writing one-off demos.
Bonus Points:
- Experience with Phaser/PixiJS/WebGL/Canvas games or interactive animation projects.
- Experience with Lottie, Spine, Live2D, Rive, SVGA, PAG, and sequence frame players.
- Experience with audio synchronization, TTS, subtitle timelines, lip-sync, and virtual or digital human projects.
- Familiar with web resource packaging, CDN loading, image compression, AVIF/WebP, texture atlas, and caching strategies.
- Experience with SDK design, capable of designing stable and clear business access APIs.
- Experience with educational products, children's interactive content, and gamified learning products.
