Introducing Modify with Instructions

Introducing Modify with Instructions in Dream Machine. Use natural language to direct changes across VFX, advertising, film, and design workflows. Native object removal, swapping, virtual sets, character refinements, and restyling are now available to all subscribers.

How to use Modify with Instructions

Start by selecting a single frame from your video where the element you want to change is clearly visible. Then, type a simple prompt describing what you’d like to modify—for example, “change the red dress to a blue suit” or “replace the coffee cup with a wine glass.” Modify uses this input to understand your intent before applying the change across the full clip.

VFX - Object Removal

VFX - Set Extension

VFX - Virtual Weather

VFX - Virtual Seasons

Advertising - Virtual Product Placement

Advertising - Ingredient Swap

Advertising - Virtual Makeup

Film & Storytelling - Virtual Environment

Film & Storytelling - Set Redesign

Film & Storytelling - Virtual Fashion

Film & Storytelling - Virtual Wardrobe

Design - Restyle & Retexture

Design - Material Swap

Design - Color Swap

Limitations

• Experiment with the strength value. Dial it low to preserve detail. Turn it up to dream bigger. Experiment with Strength intensity levels across the slider from Adhere, Flex, and Reimagine to see which Strength level works best for your idea and your video.
• To ensure the instruction lands properly, make sure the target of the modification is present in the first frame.
• When uploading a video that is not compatible with our preset aspect ratios, Dream Machine will crop and reformat into one of our preset aspect ratios. Video modification might degrade during this aspect ratio process. To ensure consistent scale and composition, please reference our compatible preset aspect ratios before uploading.
• Compatible aspect ratios: 9:16, 3:4, 1:1, 4:3, 16:9, 21:9.

Availability

Modify with Instructions is now available to all Dream Machine subscribers. It’s still early, and we’re learning fast. In the coming weeks, we’ll be expanding its capabilities and pushing what’s possible with frame-level video editing. If you have ideas or want to see something specific, let us know—we’re building this with you. And if you're excited about shaping the future of video, you should consider joining us.

Learn more at our Learning Hub.