Modify Video API Release

One Shot, Infinite Possibilities

Redesign for scale, design for creativity

Modify Video API is now available - Build custom modification workflows that reimagine simple clips into cinematic, restyled, and altered outputs with precision control over motion preservation, visual transformation, and creative styling.

Key Features

API Availability

• API & SDKs: Full API integration now available
• Model Support: Ray2 with enhanced capabilities
• API Documentation: https://docs.lumalabs.ai/docs/modify-video
• Reference: docs.lumalabs.ai/reference/modifyvideo

Technical Specifications

• Maximum Duration: 10 seconds
• Maximum File Size: 100 MB
• Supported Formats: Video and image inputs
• Frame Rate: 24fps

Available now API in SDKs

• Python: https://pypi.org/project/lumaai/1.15.0/
• TS/JS: https://npmjs.com/package/lumaai/v/1.15.0

Core Parameters

• prompt: Text guidance for video modification
• media.url: Source video file URL
• first_frame.url: Optional first frame guidance (recommended)
• mode: 9 modification modes across 3 categories
• model: Ray2 engine

Pricing

Model: Ray2
Cost: $0.01582 per million pixels
Example Config: 720p, 5 seconds, 16:9 aspect ratio = $1.75

More about API pricing: https://lumalabs.ai/api/pricing

Modification Modes

Adhere

(adhere_1, adhere_2, adhere_3)

Perfect for subtle enhancements, minor retexturing, or applying light stylistic filters while preserving the original content structure.

Flex

(flex_1, flex_2, flex_3)

Enables significant stylistic changes while maintaining recognizable elements from the original footage. Ideal for balanced creative control.

Reimagine

(reimagine_1, reimagine_2, reimagine_3)

Maximum creative freedom for fundamental transformations. Change worlds, styles, characters, and objects into completely different forms.

Use Cases

Motion & Performance Preservation

• Full-body motion tracking and facial performance retention
• Choreography and lip sync preservation
• Nuanced expression maintenance

Visual Transformation

• Live-action to CG or stylized animation conversion
• Complete restyling and retexturing capabilities
• Wardrobe, props, and aesthetic modifications

Environment Control

• Background and location swapping
• Time period transitions
• Weather and atmospheric changes

Element-Level Editing

• Isolated outfit, face, or prop modifications
• Generative effects integration (smoke, fire, water, etc.)
• Precision editing capabilities

How to use Modify Video & Tutorials: https://lumalabs.ai/learning-hub/how-to-use-modify-video

Support & Feedback

Changelog & Announcements

Stay updated on new features and improvements by re-visiting this changelog or get the latest insights through our news blog.

Tutorials & Learning Hub

Explore our Learning Hub full of in-depth guides and video walkthroughs tailored to supporting creative workflows from experiencing to experiencing to expert!

Feedback & Bug Reports

Share your thoughts and report issues to support@lumalabs.ai. Your input helps us shape the future of Dream Machine.

Enjoy Dream Machine!

Final Words

We're excited to have you as part of the Dream Machine community. Dive into the tools, experiment with workflows, and let your imagination guide you. From creating stunning visuals to animating unique videos, Dream Machine is here to turn your ideas into reality. Let's create something amazing together!