Meta Introduces Movie Gen: AI to create videos and music based on text prompts

Meta recently introduced Movie Gen, an innovative artificial intelligence model that simplifies the creation and editing of videos integrated with music and sound effects through text prompts. This model, boasting an impressive 30 billion parameters, can craft 16-second HD clips. These are generated by pre-training with 1 billion images and 100 million videos. Augmenting its capabilities, Movie Gen Audio, equipped with 13 billion parameters, produces sound effects and music from text instructions, using a training set of a million hours of audio. The AI lends life-like characteristics to animations and sequences, cedermysteriously enhances synchronicity with sound elements tailored to video rhythms.

In a revelation by Meta's blogpost, the Facebook and Instagram owner rolled out this new AI model, asserting Movie Gen crafts videos and audio clips comparable to elite media generation startups. Showcase examples included endearing visuals like animals swimming or surfing, along with transformative actions like turning static photos into dynamic portrayals of individuals, such as painting on a canvas. Users can edit pre-existing videos; alterations may add hand-held pompoms to a desert runner or coat a skateboard-friendly expanse with splashy puddles.

Moreover, this AI successfully creates longer sound sequences, functional up to 45 seconds. In tests by Meta, Movie Gen's outputs paralleled industry counterparts, including Runway, OpenAI, and ElevenLabs, fervently highlighted amidst Hollywood's interest in generative video AI since Microsoft's OpenAI debut showcased film-style outputs initiated by text directives. In the tempest of technological curiosity, Movie Gen surfaces amid dialogue on employing copyright works, briefing lawmakers given AI-deepfake impingements in electoral landscapes globally.

While uncertain of a wider developer release akin to its Llama models, Meta upholds content cooperation with creatives and says evolutions may integrate Movie Gen within Meta apparatus pending safety assurances. Exclusively steering away from generic distribution, Meta plans to partner with entertainment industry influencers. Always provigilant in ensuring security pre-releases, Meta envisions the AI embodying safe, constructive creative synergy.

Earlier, SSP wrote that a new Android feature makes phones useless if stolen.