Led by i2CAT, the EVOLVE project develops the key technological enablers for realistic and volumetric Metaverse experiences by integrating volumetric video, AI, and Human-Machine Interaction. The initiative promotes a multi-user holographic communication platform that optimizes the real-time capture of participants using low-cost equipment and intelligent processing. By utilizing adaptive low-latency streaming methods and existing standards, the project ensures fluid, interoperable communication that is easy for any entity or individual to adopt.
Additionally, the project employs Neural Radiance Fields (NeRF) and 3D Gaussian Splatting to replicate real-world environments in a hyper-realistic and volumetric manner, enabling interaction with dynamic elements through AI-assisted semantic segmentation. This technical infrastructure supports virtual teleportation services where people can collaborate or receive assistance in shared environments with high precision. With a user-centred approach, i2CAT ensures these solutions are compatible with current commercial equipment, facilitating access to new forms of social and professional interaction.
The main objective of Evolve is to leverage AI and multimedia to enable real-time, interactive hyper-realistic holographic communication within immersive digital environments. To achieve this, the project focuses on five strategic areas: volumetric capture and representation of both people and environments, optimized video processing and streaming, semantic content analysis, and hybridization for advanced interaction. By moving beyond the current state of the art, the project seeks not only excellence in user experience (UX) but also to ensure that these innovations are fully compatible with existing commercial infrastructure and equipment, relying on standards to ensure seamless technical adoption and minimized costs.
Regarding impact, the versatility and modularity of the solution designed by i2CAT facilitate its deployment across various strategic sectors, such as education, culture, or smart industries. EVOLVE investigates the applicability of these technologies to maximize social benefit, providing tools that enable more human and efficient remote collaboration.
EVOLVE, project funded by MICIU/AEI/10.13039/501100011033/FEDER, UE
