Adobe will soon launch new AI video generation tool

Adobe’s head office in San Jose, California

Adobe will unveil a new generative AI-powered video creation and editing tool in a limited release later this year, the software maker said on Wednesday, as it looks to beef up its suite of applications catering to creative professionals.

Dubbed Adobe Firefly Video Model, the artificial intelligence tool will be released in beta and will join the Photoshop maker’s existing line of Firefly image-generating applications that allow users to produce still images, designs and vector graphics.

The model will establish Adobe in the growing market for AI-based video generation tools, a space already targeted by OpenAI’s Sora, Stability AI’s Stable Video Diffusion and other AI video apps from smaller start-ups.

The model will establish Adobe in the growing market for AI-based video generation tools

The tool can generate a five-second clip for a single prompt and can interpret both text and image prompts, said Alexandru Costin, vice president of generative AI at Adobe. Users can also specify the required camera angle, panning, motion and zoom.

“We’ve invested in making this model reach the level of quality and prompt understanding that videographers expect. We’ve invested in making sure we really pay attention to the prompt … respecting guidance from videographers much better than other AI video models,” Costin said in an interview.

Adobe said the video model is trained on public domain or licensed content that it has permission to use, and not on any Adobe customer content.

Generative Extend

“We only train them on the Adobe Stock database of content that contains 400 million images, illustrations and videos that are curated to not contain intellectual property, trademarks or recognisable characters,” Costin said.

Adobe is also rolling out Generative Extend, a tool that will be available in its Premiere Pro video editing software, which can extend any existing clip by two seconds by generating an appropriate insert to fill gaps in the footage.