Chinese startup Xinchangyuan is developing a platform based on multimodal AI to create realistic 3D avatars that will become “residents” of the metaverse. The technology includes 22 cameras, 16 of which record body movement, and the remaining 6 - facial expressions. 💡🌐
Xinchangyuan uses the innovative AvatarReX training method based on NeRF (Neural Radiance Fields). This allows avatars to convey rich body language, facial expressions and even eye movements. The platform offers extensive control over the body, face and hands of avatars. 😃😠
From 2023, China is expected to begin actively populating the metaverse with its digital citizens.