Apple cooperates to develop a breakthrough algorithm to reconstruct 3D images from dynamic RGB images in real time.

CTOnews.com, Nov. 2, Apple recently teamed up with researchers at the University of California, Santa Barbara to demonstrate and introduce a breakthrough algorithm that can reconstruct 3D images online from dynamic RGB images.

The two teams challenge low-texture areas and try to solve the inherent fuzziness in the reconstructed images, focusing on practical solutions for real-time execution, which will be introduced to mobile devices such as smartphones in the future.

The new algorithm generates accurate incremental reconstruction based on historical and current observations, solves the dynamic characteristics of synchronous positioning and map mapping (SLAM) system, and ensures consistency with SLAM updates.

In the past, in the aspect of intensive pure RGB reconstruction, the dynamic characteristics of camera attitude estimation in online applications were largely ignored, and the traditional representation of static input images was still adopted in the reconstruction process.

The research team incorporated the dynamic characteristics into the algorithm and integrated it into the existing RGB technology. Inspired by BundleFusion, a RGB-D technology that integrates new views into the scene using a linear update algorithm, the team explored deconstructing the old views and then reintegrating the location data.

Researchers at Apple and the University of California, Santa Barbara have introduced a unique nonlinear disintegration technique based on deep learning, which is designed to promote the online reconstruction of technologies such as NeuralRecon, which relies on the nonlinear update rules of learning.

To validate their approach, they introduced the LivePose dataset, a groundbreaking resource that contains a complete dynamic pose sequence of ScanNet generated using BundleFusion. The dataset is a key tool for evaluating its technology and promoting future research.

This breakthrough has the potential to open up new possibilities for augmented reality, virtual reality and other industries that need accurate 3D modeling.

CTOnews.com is attached with a link to Apple's official introduction, which can be read in depth by interested users.