Meta Unveils AI-Powered Video Generation Model ‘Movie Gen’
Meta has taken a significant step forward in generative AI research by announcing its new AI-powered video generation tool, “Meta Movie Gen.” Building on earlier AI models like Make-A-Scene and Llama Image, this new tool allows users to create and edit videos using simple text inputs.
Meta shared these developments in a blog post on Oct. 4, where it outlined the capabilities and potential applications of Movie Gen. The AI model is currently available to select Meta employees and outside partners.
There are also plans to roll it out across Meta’s platforms in the coming year. According to Connor Hayes, a Meta vice president specializing in generative AI products, the tool will eventually be integrated into the company’s popular apps, such as Instagram and WhatsApp.
How Meta Movie Gen Works
Movie Gen allows users to generate 16-second videos at 16 frames per second by providing a text prompt. The model also accounts for elements like object motion, subject-object interactions, and camera movements, giving users more precision when creating their videos.
Additionally, the AI model offers personalized video generation based on a user’s image. One standout feature is Movie Gen’s ability to edit existing videos. Users can add, remove, or replace specific elements while preserving the original content, as the model targets only relevant pixels.
For instance, users can change backgrounds or modify the style of a video. This makes this tool particularly useful for social media content creators. In addition to video generation and editing, Movie Gen can produce up to 45 seconds of synchronized audio.
This includes ambient sound, background music, and sound effects based on the video and text prompts provided by the user. Meta aims to make this tool accessible to anyone looking to enhance their creative content.
Safeguarding and Future Use Cases
Before Movie Gen is made available to the public, Meta is addressing concerns regarding the ethical use of the technology. One of the primary goals is to ensure that AI is not used to create videos of individuals without their consent. Meta has stated that AI-manipulated content will be labeled as “Made with AI” across three of its platforms.
Potential future uses for Movie Gen include editing videos for Instagram Reels and creating custom animated greetings for WhatsApp. The tool’s intuitive text-based functionality could revolutionize content creation by empowering users with little to no video editing experience to create professional-quality videos.
Meta’s blog post emphasized that while Movie Gen opens up new creative possibilities, it is not intended to replace the work of artists and animators. “We believe in the power of this technology to help people express themselves in new ways and to provide opportunities to people who might not otherwise have them,” the company wrote.
A Collaborative Approach
Meta is committed to taking a collaborative approach as it continues to refine Movie Gen. The company has pledged to work closely with filmmakers and content creators to gather feedback and ensure the tool serves as a valuable resource for enhancing creativity. “As we continue to improve our models and move toward a potential future release, we’ll work closely with filmmakers and creators to integrate their feedback,” the post stated.
