AGI is multimodal and reality is the dataset of AGI

When we started Luma almost 4yrs ago, we wrote:

Through our research on video, 3D, and now multimodal models at Luma, we have arrived at an inescapable conclusion -

AGI is multimodal and reality is the dataset of AGI.

For AI to be able to help humans in the physical world, we need systems that can understand and simulate the universe. To simulate the universe, LLMs and text is not enough.

AI needs to be jointly trained over all signal modalities – text, video, audio, images – analogous to the human brain. In Ray3, the world’s first reasoning video model, we demonstrated that this approach leads to frontier generative models that are widely useful and adopted. Next, we are scaling this new paradigm to build intelligent general models that will enable humans to design and simulate complex systems like rocket engines in a year instead of a decade, let small creative teams make epic movies that move us, give a world-class interactive teacher to every child no matter where they are, and build the foundations of general purpose robot brains.

To train and deploy Multimodal Models at scale, today we are pleased to announce that Luma has raised a 900M Series-C and we are partnering with Humain to build a 2GW compute supercluster – Project Halo. This colossal infrastructure will begin deploying starting Q1 2026 and finish by 2028-29 and will be used for training and inference workloads to further advance Luma’s leadership position in this space. This round was led by Humain with significant participation from AMD, and we are also excited to deepen our partnership with Andreessen Horowitz, Omniva, Amplify Partners, and Matrix Partners.

We have grown our team to over 130 researchers, engineers, designers, artists, and operators. Luma’s technology is seeing accelerating adoption by Fortune 500 companies in media, entertainment, and advertising industries. Our models and the Dream Machine platform are being used by creatives to tell some of the most impactful stories in the world.

This funding will enable us to expand our research and engineering, scale-up our teams to widely deploy these beneficial capabilities, and accelerate humanity’s path to the next step in artificial general intelligence.