i2CAT will explore novel AI and XR technologies within the HoloNeXT project to enable immersive media creation


The i2CAT Foundation will lead HoloNeXT (Holographic transmission and Neural radiance fields for a novel XR production Tool), a research project that will explore novel Neural and Volumetric technologies to provide a solution capable of automatically delivering new integrated 3D media content and formats for XR media production. This project has been recently selected as one of the open research challenges of the H2020 project AI4Media (A European Excellence Centre for Media, Society and Democracy). The i2CAT’s Distributed Artificial Intelligence (DAI) research area, in collaboration with the Media Internet Area (MIA), will lead the project for one year (from March 2023 to the end of February 2024). Overall, the main goal of HoloNeXT is to foster the development and production of novel media experiences by introducing AI and XR novel technologies as media production tools.

Mainly, researchers will try to develop automatic media content creation of 3D assets and a real-time holoportation functionality. The created 3D media content will be leveraged from 2D media collections and reused for different XR applications to create new content. The project will explore novel AI-based tools for high-quality and impactful content creation. Also, HoloNeXT will provide a novel neural-based method for automatically generating video game content to achieve a more natural game interaction. The player will be holoportated within a 3D scenario to create a more immersive experience. The project is based on an AI for Human Co-creation approach, so the proposed Neural-based 3D content creation tool and the holoportation system can assist content creators in their creative process.

“HoloNeXT will provide novel tools for media productions in real-time and near-to-real-time scenarios by giving the possibility of creating automatically immersive and 3D content. That content can be integrated into VR scenarios with real-time holoportation systems for novel media production and entertainment purposes”, explains Ivan Huerta, Deep Learning Lead Research Engineer at the i2CAT Foundation.

With HoloNeXT, the i2CAT Foundation reinforces its research line in immersive technologies, witnessed by the participation in XR EU-funded research projects such as VR-Together, ImmersiaTV, Med Gaims and XReco. The project could also facilitate the centre to develop and patent new solutions based on Media related technologies such as Holomit.