AI Visual Dubbing in Swedish Movie ‘Watch the Skies’

The Swedish UFO thriller Watch the Skies is set to premiere in US theaters in May, but it is generating attention for an unconventional reason: it will be dubbed in English using generative AI technology.

The film, originally titled UFO Sweden, was shot with Swedish actors, but for its American release, the English dialogue will be synchronised to the actors' lip movements via AI.

This "visual dubbing" technique, developed by AI firm Flawless, uses TrueSync machine learning technology to ensure the actors' performances match the new language seamlessly.

This is insane 🤯

A Swedish sci-fi film just dropped in any language you want - without subtitles or awkward dubs.

Thanks to AI visual dubbing, actors’ faces actually speak your language.
No joke. The future of global cinema is here. pic.twitter.com/7uU394hKFq

— mii4 (@mii4Web3) March 22, 2025

Director and writer Victor Danelle views the AI innovation as a way to reach a broader audience, acknowledging the potential concerns from actors and the public about AI's increasing role in filmmaking.

Despite potential backlash, Danelle emphasizes that the use of this technology allows the film to retain its essence while making it accessible to English-speaking viewers.

The project has received the full backing of the SAG-AFTRA, the actors' union, which has expressed concerns over AI's impact on the industry.

Danelle remains confident, stating that the film remains authentic with the same actors and performances, only in a different language.

He said:

“A lot of filmmakers and a lot of actors will be afraid of this technology at first, but we have the creative control, and to act out the film in English was a real exciting experience. It’s still our movie, it’s still the actors’ performance, and that’s the key part.”

Backlash for AI Use in Movies

Scott Mann, co-founder of Flawless, explained in a 2023 presentation that the company’s TrueSync technology uses deep learning to create a 3D model of an actor's face throughout a film.

This model allows the technology to adjust the actors' facial expressions to match the desired dubbed language.

🎥 Step inside the future of filmmaking. Go behind the scenes of WATCH THE SKIES, the first-ever theatrical feature to use AI for immersive dubbing. Only in @AMCTheatres May 9th! pic.twitter.com/6cyZ82j2fS

— Flawless (@Flawlessai) March 21, 2025

TrueSync was previously used in the 2022 film Fall, where it helped produce a PG-13 version by removing profanity.

Flawless has also developed DeepEditor, a tool that allows editors to transfer an actor's performance from one scene to another without the need for reshoots.

In partnership with distributor XYZ Films, Flawless is also localising several upcoming projects, including The Light, Vincent Must Die, and Smugglers using TrueSync.

While the technology has been well-received in some circles, its use in filmmaking has sparked broader concerns.

A recent example occurred in Netflix's docuseries American Murder: Gabby Petito, where AI-generated voices were used to portray the deceased character.

The decision faced criticism, especially after Petito's parents expressed discomfort with hearing an AI-generated version of their daughter’s voice, despite consenting to the series.

Watching the Gabby Petito doc, absolutely invested… until the part it started using AI to make HER read out her texts and journal entries. That is absolutely NOT okay. She’s a murder victim. You are violating her again. #AmericanMurder pic.twitter.com/jUH6LigJht

— jodie (@__jodie___) February 17, 2025

This incident reflects the growing debate over AI’s role in the creative industries and its potential impact on authenticity and respect for the subjects involved.

Say Goodbye to Subtitles in Movies?

AI dubbing technologies, such as Flawless’ TrueSync, offer significant benefits for the film industry by enabling movies to reach global audiences more efficiently, as seen in EWatch the Skies.

These technologies streamline the dubbing process, saving time and resources while enhancing accessibility for viewers across language barriers.

Additionally, innovations like DeepEditor improve the post-production process, creating further efficiencies.

However, there are notable concerns.

AI dubbing may lack the authenticity and emotional depth that human actors bring to their performances, potentially undermining the viewer's connection to the film.

The use of AI in sensitive contexts, such as generating voices for deceased individuals, has raised ethical issues, as seen in the American Murder: Gabby Petito docuseries.

I'm watching #AmericanMurderGabbyPetito and HOLY SHIT. They've used AI voice recreation to have Gabby Petito reading journal entries and text messages from the last months of her life.

I'm assuming they got permission from the family, but this is a deeply unsettling use of AI. pic.twitter.com/uKd4bIFfBu

— Laura (@editedbylaura) February 17, 2025

Additionally, the increasing reliance on AI could lead to job displacement for human professionals, further fuelling concerns about the erosion of human artistry.

In a nutshell, while AI dubbing offers considerable advantages in terms of efficiency and accessibility, the film industry must balance innovation with the preservation of human talent and ethical standards to ensure AI’s role remains beneficial without compromising the essence of cinema.