Introducing Modify with Instructions

Introducing Modify with Instructions in Dream Machine. Use natural language to direct changes across VFX, advertising, film, and design workflows. Native object removal, swapping, virtual sets, character refinements, and restyling will roll out soon to all subscribers.

How to use Modify with Instructions

Start by selecting a single frame from your video where the element you want to change is clearly visible. Then, type a simple prompt describing what you’d like to modify—for example, “change the red dress to a blue suit” or “replace the coffee cup with a wine glass.” Modify uses this input to understand your intent before applying the change across the full clip.

VFX - Object Removal

VFX - Set Extension

VFX - Virtual Weather

VFX - Virtual Seasons

Advertising - Virtual Product Placement

Advertising - Ingredient Swap

Advertising - Virtual Makeup

Film & Storytelling - Virtual Environment

Film & Storytelling - Set Redesign

Film & Storytelling - Virtual Fashion

Film & Storytelling - Virtual Wardrobe

Design - Restyle & Retexture

Design - Material Swap

Design - Color Swap

Limitations

• Experiment with the strength value. Dial it low to preserve detail. Turn it up to dream bigger. Experiment with Strength intensity levels across the slider from Adhere, Flex, and Reimagine to see which Strength level works best for your idea and your video.
• To ensure the instruction lands properly, make sure the target of the modification is present in the first frame.
• We are fixing some inconsistency with modified video’s scale with the original video.
• When uploading a video that is not part of the preset aspect ratios, we will crop into one of our preset aspect ratios. Video modification might degrade during this aspect ratio process.

Availability

Modify with Instructions will roll out soon to all Dream Machine subscribers. It’s still early, and we’re learning fast. In the coming weeks, we’ll be expanding its capabilities and pushing what’s possible with frame-level video editing. If you have ideas or want to see something specific, let us know—we’re building this with you. And if you're excited about shaping the future of video, you should consider joining us.