AI & Big Tech

Automation & Creators

Adobe Firefly Video Model Launches for Web and Premiere Pro
Photo: Wikimedia Commons

Adobe officially launched its Firefly Video Model in a public beta today. The new tool allows video editors to generate video clips from text prompts and automatically extend existing video footage. Creators can access these features on the web and directly inside Adobe Premiere Pro.

What Is the Adobe Firefly Video Model

The Firefly Video Model is Adobe's first public generative AI model built specifically for video creation. It joins Adobe's existing image, vector, and design models inside the Firefly family. Adobe trained this model on public domain content and licensed media from Adobe Stock to make sure it is safe for commercial use.

The software offers two main capabilities during its initial beta release. The first is Text to Video, which turns written descriptions into five-second video clips. The second feature is Generative Extend, which adds extra frames to the beginning or end of existing video clips to help editors make smoother cuts.

How Generative Extend Works in Premiere Pro

Editors often deal with clips that end a second too early. Generative Extend solves this issue by creating missing frames inside Premiere Pro. The user selects the end of a clip and drags the edge to expand it. The model analyzes the original footage and creates up to two seconds of matching video and audio.

This tool also fixes audio timing issues. It can create extra room ambient noise to cover gaps in sound tracks. It does not generate spoken words, but it helps prevent jarring quiet spots when cutting between interview takes.

Who Can Use the Firefly Video Model Today

Adobe opened the Firefly Video Model to adults worldwide with a free or paid Adobe account. Free users get a limited pool of generative credits each month, while paid Creative Cloud subscribers receive higher credit limits. Adobe integrated these tools across two main platforms today:

  • The Firefly Web Application: Users can generate text-to-video and image-to-video clips in a browser. They can adjust camera angles, motion controls, and aspect ratios before downloading the file.
  • Adobe Premiere Pro Beta: Professional editors can use Generative Extend directly on their editing timelines without exporting files to another application.
  • Enterprise Workspaces: Business accounts gain access to commercially safe generation features backed by Adobe IP indemnification policies.

The system supports resolution up to 720p at 24 frames per second during this early beta phase. Adobe stated that 1080p output and higher frame rates will arrive in future software updates.

What Are the Unknowns and Current Limits

While the initial results look smooth, the technology still has clear technical boundaries. Generation times can take up to two minutes for a five-second clip, depending on server traffic. Complex motions like detailed hand movements or rapid sports action still show visual glitches in early tests.

Cost structure after the beta period remains another unknown. Adobe uses a credit system for AI generations, but the company has not revealed final credit pricing for long-form video tools. Editors must monitor how many credits each video generation consumes as they work.

Key Takeaways

  • Commercial Safety: Adobe trained the model on Adobe Stock and public domain media to avoid copyright issues for paid clients.
  • Timeline Integration: Generative Extend runs directly inside the Premiere Pro timeline to fix short clips.
  • Web Generation: The Firefly website lets users create clips using camera controls like pan, tilt, and zoom.
  • Audio Generation: The system creates matching background noise to cover audio gaps in video edits.
  • Beta Limits: Current output caps at 720p resolution and two seconds of generated extension length.

Frequently Asked Questions

Can I use Firefly video generations in commercial projects?

Yes. Adobe built the Firefly Video Model using licensed Adobe Stock assets and public content. Commercial users can use the generated footage in client work and monetized videos.

How much does the Firefly Video Model cost?

The beta is included with existing Adobe Creative Cloud plans and free Firefly web accounts. Generations use monthly generative credits, which refresh at the start of each billing cycle.

Does Generative Extend create realistic human speech?

No. Generative Extend does not create human speech or spoken dialogue. It creates room noise and sound effects to smooth out edits between takes.

What clip length can I generate from text?

The Text to Video tool currently produces video clips up to five seconds long. You can generate new clips or expand existing footage by up to two seconds.

Official Sources

  • Adobe Official Announcement
  • Adobe Premiere Pro Help Documentation

If you edit video regularly, open your Premiere Pro Beta app today to try extending short clips on your timeline.

No comments:

Post a Comment