Matrix-3D

Skywork AI · Released August 2025

Matrix-3D turns a single image or a text prompt into an explorable 3D scene: it generates a panoramic video along a camera path, then reconstructs the scene in 3D. Two reconstruction modes trade speed for detail, and the weights are MIT.

Weights
Open weightsMIT
Commercial use
Permissive license
Real-time
No real-time claim
Where to try
Run it yourself

01 Controls

What you control

  • A single image or a text prompt
  • A camera trajectory for the panoramic video
  • Fast or detailed 3D reconstruction

02 License

Can you use it commercially?

Permissive license

The weights' model card declares MIT, a permissive license that allows commercial use. Downloads require accepting the card's terms on Hugging Face.

Declared license: MIT · Model card

A reading of the published license text, not legal advice.

03 Speed

Does it run in real time?

No real-time claim. The cited sources make no real-time claim.

Figures are the authors' own, with their settings and hardware. They are not comparable across models.

04 Setup

How to run it

  1. 01Clone SkyworkAI/Matrix-3D with its submodules, create a Python 3.10 environment, install PyTorch and run the installation script.
  2. 02Download the checkpoints with python code/download_checkpoints.py.
  3. 03Generate a panorama, turn it into a panoramic video, then into a 3D scene, with the scripts in code/. A Gradio demo is also included.

Summarised from the project's own instructions. Follow the source for exact commands and versions.

05 Access

Where to try it

No hosted version was verified. Run the published weights yourself.

Listed alphabetically. Windflow maintains this directory and is one of the hosts; a listing does not promise capacity at any given moment.

06 Questions

Matrix-3D FAQ

Is Matrix-3D open source?

Matrix-3D publishes downloadable weights under MIT. The declared license is permissive.

Can I use Matrix-3D commercially?

The weights' model card declares MIT, a permissive license that allows commercial use. Downloads require accepting the card's terms on Hugging Face.

Does Matrix-3D run in real time?

The cited sources do not claim real-time operation.

Where can I try Matrix-3D?

No hosted version was verified; run the published weights yourself.

What does Matrix-3D take as input?

You give it a single image or a text prompt, a camera trajectory for the panoramic video and fast or detailed 3D reconstruction.

How do I run Matrix-3D?

Following the official instructions: Clone SkyworkAI/Matrix-3D with its submodules, create a Python 3.10 environment, install PyTorch and run the installation script. Download the checkpoints with python code/download_checkpoints.py. Generate a panorama, turn it into a panoramic video, then into a 3D scene, with the scripts in code/. A Gradio demo is also included.

What are alternatives to Matrix-3D?

Similar models in this directory include HunyuanWorld 1.0 (open weights, custom terms), HY-World 2.0 (open weights, custom terms) and Marble (no public weights, service terms).