31
Google pauses Gemini’s ability to generate AI images of people after diversity errors
(www.theverge.com)
this post was submitted on 22 Feb 2024
31 points (97.0% liked)
Technology
1934 readers
242 users here now
Which posts fit here?
Anything that is at least tangentially connected to the technology, social media platforms, informational technologies and tech policy.
Rules
1. English only
Title and associated content has to be in English.
2. Use original link
Post URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communication
All communication has to be respectful of differing opinions, viewpoints, and experiences.
4. Inclusivity
Everyone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacks
Any kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangents
Stay on topic. Keep it relevant.
7. Instance rules may apply
If something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.
Companion communities
[email protected]
[email protected]
Icon attribution | Banner attribution
If someone is interested in moderating this community, message @[email protected].
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
What did people expect, that a text-to-image model would be able to understand centuries of human stupidity and the politics it have created?
I am not tech savvy but I expect that there is probably a large set of images that the model was trained on. Based on my experience, almost all images that could be labeled “German soldier, 1943” would show people with similar physical characteristics to the first of the four images. I guess my thesis is that I’m not sure that the historical context is necessary when the source/training data is likely fairly homogeneous. To get outputs such as they show in the example suggests that either the training data was not reliable or someone behind the scenes has their thumb on the scale to push the model toward racial/gender diversity even when that doesn’t match the input.
I thought it obviously was the case here.
And it is understandable, these models work by putting the most likely pixel after another until it ends with a picture, and the average picture is filled with the average stereotype (bad or good). And pushing it away from that will of course affect everything in the model. The computer cant handle every exception we need to put into it for it to be clean and sellable. Theres gonna be many more ai generated pictures like this but shocking in a different way, in the future. Probably even worse.