PRESENCE (A toolset for hyper-realistic and XR-based human-human and human-machine interactions) will reach the next level of realism for XR devices and applications, focusing on a human-centred approach and enhancing the impact of immersive human-to-human and human-machine interactions, delivering a toolset of technologies such as holoportation, haptics and virtual humans, integrated and demonstrated in XR professional and social setups, analysed in user studies. The goal is to improve our daily lives by revolutionising the way we work, communicate and, in general, how we participate in social activities. i2CAT coordinates the project, which brings together 17 European partners, including research centres, universities and technological companies.One of the key aspects of PRESENCE is to digitalize and transfer humans into shared virtual worlds, simultaneously and with multiple people remotely connected, offering a more intuitive and realistic experience. For that, researchers will develop a photorealistic multiuser holoportation system for multiple users in real-time communications scenarios. The system requires improving the current volumetric video compression technologies for live communications.The second key aspect of the project is to enrich XR experiences at a multisensory level by exploring novel haptic technologies, enabling remote interactions among users and between users and objects. Toward this goal, researchers will develop novel tactile tracking and capturing systems to interpret properties such as form, texture or velocity.Finally, PRESENCE aims at generating realistic 3D humanoid models for intelligent virtual agents and embodied smart avatars. Especially the latter, will be used to realistically represent humans in the virtual world. Such models require AI-powered intelligent virtual humans (e.g., via human speech, facial expression, gaze, body language, etc.), allowing natural appearances and physically realistic behaviours in the virtual world.The technologies developed within PRESENCE will be validated in realistic scenarios, targeting XR applications for professional and social setups and addressing four use cases in professional collaboration, manufacturing, health, and cultural heritage.
Funded by the European Union. Views and opinions expressed are, however, those of the author(s) only and do not necessarily reflect those of the European Union or [name of the granting authority]. Neither the European Union nor the granting authority can be held responsible for them.
