Modify Video

Now available in API & SDKs

API Reference

image

video

Basic Usage

• prompt: text value to guide how to modify the video
• media.url: url of the video file
• first_frame.url: optional (but preferred) provide the first frame of the modified video (to guide it)
• mode: adhere_1, adhere_2, adhere_3, flex_1, flex_2, flex_3, reimagine_1, reimagine_2, reimagine_3
• model: ray-2

Pricing

Example

learn more

Example

{
    "prompt": "you can direct how to modify the video by providing a text prompt here",
    "media": {
        "url": "https://example.com/video.mp4"
    },
    "first_frame": {
        "url": "https://example.com/image.png"
    },
    "mode": "flex_1",
    "model": "ray-2"
}

Modes

a) Adhere — The output adheres very closely to the source video. This is ideal for subtle enhancements, minor retexturing, or applying a light stylistic filter without drastically altering the original content.

b) Flex — The output flexibly adheres somewhat to the shapes, characters, and details of the source video. This range allows for more significant stylistic changes while still maintaining recognizable elements from the original footage.

c) Reimagine — The output adheres much more loosely to the source video. This setting is best for fundamentally changing the world and style to something entirely new, even transforming the characters or objects into completely different forms.

What can I achieve with Modify Video?

Preserve full-body motion and facial performance, including choreography, lip sync, and nuanced expression

Restyle or retexture the entire shot, from turning live-action into CG or stylized animation, to changing wardrobe, props, or the overall aesthetic

Swap environments or time periods, giving you control over background, location, or even weather

Edit at the element level, like isolating just the outfit, face, or prop — or adding generative FX (smoke, fire, water, etc.) on top

API Reference

https://docs.lumalabs.ai/reference/modifyvideo