March 31, 2025
At Luma we have long believed that creative control over generative models is the key to unlocking their massive potential. That’s why we have been doing research on a new advanced method of teaching generative models new ideas and controls – we call them Concepts.
Concepts are learnable from just one or a few examples, and can be composed to enable powerful new creative workflows. We will share more about this new approach in the near future.
Today, we are releasing our first set of Concepts for Ray2 – Camera Motion Concepts – allowing reliable and composable control over camera motion in video generation.
Concepts enable learning any camera move from one or very few examples, and can reliably reproduce these learnt motions across a wide variety of shots and styles.
Unlike other methods of model customization, like LoRA or finetuning, many Concepts can be combined easily through natural language at inference time. Composition enables new and interesting camera moves that might not be physically possible at all – meaning training examples do not exist to learn these in any other way. Composition enables combinatorial explosion of creative possibilities.
Ray2 is a frontier quality production-ready video generative model. Teaching Ray2 new concepts does not compromise its quality, stylistic range, or capabilities in any way . This is a critical unlock for customizability in creative workflows as existing methods, like LoRA or finetuning, collapse model capabilities to the mode of the data used for such customisation.
Camera Concepts interoperate with Ray2’s other capabilities, including image-to-video, start and end keyframes, and loop.
Camera Concepts are available in Dream Machine starting today. We are releasing Camera Motion Concepts, and if you’d like to see new ones - let us know by replying here.
In the coming days and weeks, we will share more learnings from the Concepts research track, and bring new capabilities to Ray2 and Dream Machine unlocked by this powerful new technology. If you are passionate about fundamental research that gives people new superpowers, you should consider join us.