Google apologises after Gemini AI generates images of Nazis as people of colour

The company has paused the tool after it was found to be creating historically inaccurate images.
By Sam Haysom  on 
A close-up of a smartphone shows a finger about to touch the Gemini app.
Credit: Jonathan Raa/NurPhoto via Getty Images

Google has paused its Gemini AI tool (formerly Bard)'s ability to generate images of people. The company also issued an apology after the tool was found to be generating historically inaccurate illustrations, including depictions of Nazi soldiers as people of colour.

As reported by The Verge, a number of different prompts led to the bot responding with historical inaccuracies. People of colour were reportedly shown in illustrations offered for queries about German soldiers in 1943, as well as requests to show U.S. Senators in the 1800s.

"We're already working to address recent issues with Gemini's image generation feature," said Google on X. "While we do this, we're going to pause the image generation of people and will re-release an improved version soon."

In an earlier statement, Google had confirmed that Gemini's AI image generation generates a wide range of people.

"That's generally a good thing because people around the world use it," Google said. "But it's missing the mark here."

AI image generators have been found to perpetuate racist stereotypes, and one of Google's AI principles is to "avoid creating or reinforcing unfair bias." But as Jack Krawczyk, who works on Gemini, pointed out on X, "historical contexts have more nuance to them."

"As part of our AI principles we design our image generation capabilities to reflect our global user base, and we take representation and bias seriously," Krawzyk wrote. "We will continue to do this for open ended prompts."

Mashable Image
Sam Haysom

Sam Haysom is the Deputy UK Editor for Mashable. He covers entertainment and online culture, and writes horror fiction in his spare time.


Recommended For You

Google Maps: It's getting a new generative AI feature
An animated image of two women talking next to a smartphone screen showing the new Google Maps AI feature

Google's new AI video generator is great — but what about deepfakes?
a grid of examples of Lumiere AI-generated videos in a still screenshot

Samsung Galaxy S24 series comes with Google's Gemini AI model
android showing a message and an ai-generated summary

The best sexting apps for sending naughty messages
Messages on phone

Trending on Mashable
NYT Connections today: See hints and answers for March 8
A phone displaying the New York Times game 'Connections.'

Wordle today: Here's the answer and hints for March 9
a phone displaying Wordle

NYT Connections today: See hints and answers for March 9
A phone displaying the New York Times game 'Connections.'

Wordle today: Here's the answer and hints for March 8
a phone displaying Wordle

NYT's The Mini crossword answers for March 8
Closeup view of crossword puzzle clues
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!