{"id":28056,"date":"2025-09-07T03:00:41","date_gmt":"2025-09-07T03:00:41","guid":{"rendered":"https:\/\/metaverseplanet.net\/blog\/?p=28056"},"modified":"2026-01-05T09:10:45","modified_gmt":"2026-01-05T09:10:45","slug":"ai-that-turns-photos-into-3d-worlds-tencent-voyager","status":"publish","type":"post","link":"https:\/\/metaverseplanet.net\/blog\/ai-that-turns-photos-into-3d-worlds-tencent-voyager\/","title":{"rendered":"AI That Turns Photos into 3D Worlds: Tencent Voyager"},"content":{"rendered":"\n

Tencent has introduced Voyager<\/strong>, an impressive new AI model that can transform a single photograph into a three-dimensional scene. The model simultaneously generates both an RGB video and depth information, offering a powerful approach to 3D reconstruction without the need for traditional modeling techniques. However, it requires a significant amount of hardware to run effectively.<\/p>\n\n\n\n

\n\n\n\n

How Voyager Works<\/h2>\n\n\n\n
\"\"<\/figure>\n\n\n\n

The HunyuanWorld-Voyager<\/strong> model takes a single image and a user-defined camera path\u2014such as a pan, tilt, or dolly-in motion\u2014to generate a short video. It produces both the video and a simultaneous depth map, ensuring that the spatial relationships of objects in the scene remain consistent. The system maintains geometric coherence by comparing each new frame with the previous content using 3D point clouds. However, distortions can still occur with long or complex camera movements, particularly with 360-degree rotations.<\/p>\n\n\n\n

Tencent<\/a><\/em><\/strong>‘s technical report highlights an additional component called the “world cache,”<\/strong> which stores data from each new frame. This allows for data reuse in subsequent frames, significantly preserving geometric consistency over videos that are several minutes long.<\/p>\n\n\n\n

\n\n\n\n

Training and Requirements<\/h2>\n\n\n\n
\"\"<\/figure>\n\n\n\n

Voyager was trained on a massive dataset of over 100,000 real and synthetic video clips<\/strong>, including scenes from Unreal Engine<\/strong> environments. This extensive training helped the model understand various camera movements. The training process used an automated depth estimation method, eliminating the need for manual labeling.<\/p>\n\n\n\n

While technologically powerful, Voyager has high hardware requirements. Running the model at a 540p resolution<\/strong> requires 60 GB of GPU memory<\/strong>, and optimal results need 80 GB<\/strong>. The system supports multi-GPU scaling, with an 8-GPU<\/strong> setup running approximately 6.7 times faster<\/strong> than a single GPU. The model weights have been made available to researchers on Hugging Face.<\/p>\n\n\n\n

\n\n\n\n

Voyager vs. Other AI Models<\/h2>\n\n\n\n

Voyager’s approach sets it apart from existing video generation models. Unlike OpenAI’s Sora<\/strong>, which focuses on visual realism, Voyager prioritizes geometric consistency<\/strong> between frames. This focus helped it achieve a top score of 77.62<\/strong> on Stanford’s WorldScore benchmark<\/strong>, outperforming competitors like WonderWorld and CogVideoX-I2V. However, it still has some limitations in precise camera control.<\/p>\n\n\n\n

Additionally, there are some licensing restrictions for Voyager. Its use is prohibited in the European Union<\/strong>, the United Kingdom<\/strong>, and South Korea<\/strong>. Commercial applications serving over 100 million active users<\/strong> require an additional agreement.<\/p>\n\n\n\n

You Might Also Like;<\/h3>\n\n\n