Adobe previews Firefly's new gen AI enhanced 'Video Model' for on-demand clip creation

Adobe Firefly will receive a new “Video Model” later this year allowing the artificial intelligence (AI) platform to generate short videos on demand. The company even made a teaser trailer demonstrating what it’s capable of. According to the announcement, the new model consists of two main parts. First, a “Text to Video” component, lets users create clips via text prompt. You can instruct the AI to include details like specific camera angles and zoom-in speed.

Also: The best AI image generators to try right now

The second is Image to Video. This takes uploaded still images or illustrations and introduces new animations transforming them into moving clips. “Text to Video” and “Image to Video” will be rolling out later this year to the official Adobe Firefly website. 

There is a third tool called “Generative Extend” although it’ll be exclusive to Adobe Premiere Pro. It fills in the gaps between two pieces of footage with generated, contextually aware content. “Generative Extend” will also be released in the coming months but as a beta. However, no word on when the final version will launch.

The language surrounding this reveal is quite interesting. Unlike OpenAI’s Sora which aims to make proper films, Firefly’s new model aims to be more of a support tool. Adobe wants it to enrich a creator’s “ability to tell beautiful and compelling stories.” 

Throughout the trailer and post, the company frequently mentions how the AI is “commercially safe.” It was trained on either “public domain or licensed content — never user content.” The issue of copyright infringement has been a major sticking point for generative AI critics. They argue this tech could be used to infringe on a creator’s work by taking content without permission or producing derivatives. 

It seems Adobe is aware of these problems, so it is making it abundantly clear that they’re not taking anyone’s work without permission.  

Also: Adobe will let you create AI-generated images in your PDFs – for free.

The company has yet to say when the final version of Firefly’s “Video Model” will roll out. But if you’re interested, you can sign up to receive a notification when it becomes available on Adobe’s website. There are even a couple of AI-made samples for you to check out.