Adobe's Firefly AI Takes a Step Forward in Video Creation with New Tools

Adobe is taking its generative AI game to the next level, introducing new tools that could change how creatives work with video. As of today, the much-anticipated Firefly Video Model is finally here, bringing AI-driven video generation right into the heart of Adobe Premiere Pro, and a few other apps. Whether you're looking to extend footage, generate video from still images or text prompts, Adobe has something for you.


The headliner of this release is Generative Extend, a new tool that will allow users to tweak their footage by extending clips by up to two seconds. Need to make a shot just a little longer? No problem. Generative Extend works on the edges of clips or even mid-shot, correcting small issues like shifting eye-lines or unwanted movements. While it won't fix massive blunders, it can definitely save you from doing a complete reshoot for minor mistakes. Currently, you can only extend clips at 720p or 1080p and up to 24 frames per second, but that's good enough for most small edits.

Meanwhile, Adobe is also launching Text-to-Video and Image-to-Video tools on the Firefly web app, now available in a limited public beta. These tools let you generate videos from either a simple text description or a combination of text and an image. Imagine creating b-roll footage out of a photograph or even visualizing reshoots using a still from your project. While the technology isn't yet advanced enough to completely replace reshoots, it's still a game-changer for planning and quick mock-ups.

One catch tho': these videos are only five seconds long and top out at 720p. Adobe isn't the only one working on this kind of AI, and competitors like OpenAI's Sora promise longer, higher-quality results. But unlike those still-locked beta programs, Adobe's tools are out now and ready to use. Plus, the company is working on speeding up the generation time, which currently takes around 90 seconds per clip.

For those concerned about the ethics of AI content, Adobe assures users that its Firefly video tools are trained on legally sourced material, sidestepping the legal headaches that competitors like Runway are facing. Also, Adobe's new AI-powered content can be tagged with Content Credentials, ensuring transparency around the use of AI in the creation process.

This all comes fresh off the stage from Adobe's MAX conference, where these tools—and others—are taking center stage.

Want to read this in Spanish? Spanish Version >>