Adobe unveiled advancements to its generative AI video capabilities, powered by the Adobe Firefly Video model. The new video features are designed to give film editors and video professionals the tools to unlock their creativity and add new elements to existing footage.
The Adobe Firefly Video Model extends Adobe’s family of generative AI models – Image, Vector and Design models – to provide a comprehensive tool for creative teams.
How it works
The text-to-video and image-to-video capabilities will be available on Firefly.Adobe.com later this year, along with a generation extension built directly into Adobe Premiere Pro.
The “Text to Video” feature lets you generate videos from text prompts, tweaking camera angles, motion, zoom, etc. You can also reference images to generate B-roll to fill gaps in your timeline.
The “image-to-video” feature can turn still images and illustrations into live-action clips to bring your videos to life. This Adobe Firefly Video model will be available as soon as the beta is released, and there is also a beta waitlist.
“Adobe is committed to providing the highest level of customer service to our customers,” said Ashley Still, senior vice president of the Creative Products Group at Adobe. “The Adobe Firefly Video model is designed to bring new capabilities to the professional video community, streamline workflows and support creative ideas. We are excited about the new Produce extensions for Adobe Premiere Pro, which give you new levels of creative control and efficiency.”
Adobe Firefly Video models are designed for a variety of use cases to help video professionals create the ideal clips: take advantage of camera angle and motion controls to create compelling animations and effects, use camera motion to generate inserts for key shots, and combine with professionally shot footage to tell your story faster.
Like the other Adobe Firefly models (Image 3 model, Vector model, and Design model), the Adobe Firefly Video model is designed for commercial use. Adobe trains the model using only Adobe-approved content, without using any customer content, so you can use it with confidence. To date, Adobe Firefly has generated over 12 billion images worldwide.
