Adobe Releases Firefly AI Video Generator
The Firefly video model is trained only on licensed content, ensuring a safer option in an increasingly crowded market for AI video generators.
Adobe is expanding its generative AI capabilities with a new video generation model, a major move aimed at giving professional creators safe tools for commercial projects.
A couple of days ago, the company announced that its Firefly Video Model is now in public beta. This video model is trained only on licensed content, ensuring a safer option in an increasingly crowded market for AI video generators.
If you’ve signed up for early access, you should have received an email that Firefly is now available for public access.
We’ve got great news — Generate Video (beta) is now available. Powered by the Adobe Firefly Video Model, Generate Video (beta) lets you generate new, commercially safe video clips with the ease of creative AI. Quickly communicate your creative intent, create b-roll to fill gaps, add new elements to a shot, and so much more.
What is Firefly Video Generator?
Adobe Firefly video generator turns text or images into short video clips. With this tool, you can create quick videos by simply writing a description or uploading an image. The tool then generates a 1080p 5-second video clip in MP4 format.
In addition to generating videos, Adobe Firefly lets you add extra effects. You can enhance your clips with elements like smoke, lens flares, or simple camera movements, which add a creative touch to your projects.
Perhaps the most interesting part of this new AI tool is that these videos are built using licensed and public domain content, so you don’t have to worry about copyright issues.
How to Use Firefly Video Generator?
To get started with Adobe’s video generator, head over to firefly.adobe.com and sign in or create an account. Once you’re logged in, you should see a set of AI tools in the featured tab (see image below). Click on the “Text to video” button to start using the video tool.
This is what the video generation dashboard looks like:
If you’ve tried the Firefly image generator before, you should be familiar with how the UI is laid out in this tool. Let’s all leave the settings at default for now and generate a sample video with the prompt below:
Prompt: An astronaut exploring Mars, dust storms in the background, and a red sunset.
The result is a 5-second video clip in MP4 format and 1920 × 1080 resolution.
It’s important to keep the browser tab open until the video is generated. Closing the tab clears your browser session, and all video progress will be lost. This is a bit strange as other platforms like OpenAI’s Sora or Kling process the video generation on the cloud, so you can close the browser tab anytime.
Also, a few tips when writing your prompt:
The optimal structure of a text prompt for Text to Video describes the shot type, character, action, location, and aesthetic.
Be specific to get the best results, up to the maximum limit of 175 words.
For example, “a cinematic, medium shot, eye level, of a beautiful fluffy rabbit in a snowy forest at sunrise, dreamy bokeh, lens flares, the color grade is warm, the rabbit is realistic with soft, detailed fur glistening in the sunlight, camera movement is subtle and soft and in slow motion, shot on film, film grain, snowflakes falling softly in the background, highly detailed.”
Image to Video
Another cool thing you can do is use a reference image to generate your video. If you don’t have a license-free image, you can create one using Flux Labs AI.
Prompt: An image of an asian influencer happily talking in front of the camera, making all sorts of hand gestures
Take note that you can’t just upload any image on the platform. You must have the rights to that image. Otherwise, your access could be revoked.
To use this feature, you must have the rights to any third-party images you upload. All images uploaded or content generated must meet our User Guidelines. Access will be revoked for any violation of User Guidelines or for creating content that is harmful to others.
Download it to your local disk and upload it to the Firefly video generator. Add in the description of the video and click on the Generate button.
Here’s the final video result: