this post was submitted on 02 Feb 2025
216 points (98.2% liked)

Europe

2109 readers
751 users here now

News and information from Europe 🇪🇺

(Current banner: La Mancha, Spain. Feel free to post submissions for banner images.)

Rules (2024-08-30)

  1. This is an English-language community. Comments should be in English. Posts can link to non-English news sources when providing a full-text translation in the post description. Automated translations are fine, as long as they don't overly distort the content.
  2. No links to misinformation or commercial advertising. When you post outdated/historic articles, add the year of publication to the post title. Infographics must include a source and a year of creation; if possible, also provide a link to the source.
  3. Be kind to each other, and argue in good faith. Don't post direct insults nor disrespectful and condescending comments. Don't troll nor incite hatred. Don't look for novel argumentation strategies at Wikipedia's List of fallacies.
  4. No bigotry, sexism, racism, antisemitism, dehumanization of minorities, or glorification of National Socialism.
  5. Be the signal, not the noise: Strive to post insightful comments. Add "/s" when you're being sarcastic (and don't use it to break rule no. 3).
  6. If you link to paywalled information, please provide also a link to a freely available archived version. Alternatively, try to find a different source.
  7. Light-hearted content, memes, and posts about your European everyday belong in [email protected]. (They're cool, you should subscribe there too!)
  8. Don't evade bans. If we notice ban evasion, that will result in a permanent ban for all the accounts we can associate with you.
  9. No posts linking to speculative reporting about ongoing events with unclear backgrounds. Please wait at least 12 hours. (E.g., do not post breathless reporting on an ongoing terror attack.)

(This list may get expanded when necessary.)

We will use some leeway to decide whether to remove a comment.

If need be, there are also bans: 3 days for lighter offenses, 14 days for bigger offenses, and permanent bans for people who don't show any willingness to participate productively. If we think the ban reason is obvious, we may not specifically write to you.

If you want to protest a removal or ban, feel free to write privately to the mods: @[email protected], @[email protected], or @[email protected].

founded 7 months ago
MODERATORS
[email protected]
[email protected]
[email protected]
216
AI systems with 'unacceptable risk' are now banned in the EU (techcrunch.com)
submitted 5 days ago by [email protected] to c/[email protected]
20 comments fedilink hide all child comments
top 20 comments
sorted by: hot top controversial new old
[–] [email protected] 6 points 3 days ago* (last edited 3 days ago)

Some of the unacceptable activities include:

AI used for social scoring (e.g., building risk profiles based on a person’s behavior).
AI that manipulates a person’s decisions subliminally or deceptively.
AI that exploits vulnerabilities like age, disability, or socioeconomic status.
AI that attempts to predict people committing crimes based on their appearance.
AI that uses biometrics to infer a person’s characteristics, like their sexual orientation.
AI that collects “real time” biometric data in public places for the purposes of law enforcement.
AI that tries to infer people’s emotions at work or school.
AI that creates — or expands — facial recognition databases by scraping images online or from security cameras.

Companies that are found to be using any of the above AI applications in the EU will be subject to fines, regardless of where they are headquartered.

[–] [email protected] 81 points 4 days ago* (last edited 4 days ago) (1 children)

Unacceptable by literal definition.

They did create a very reasonable list of what they deem unacceptable. At last some good news.

Some of the unacceptable activities include:

  • AI used for social scoring (e.g., building risk profiles based on a person’s behavior).
  • AI that manipulates a person’s decisions subliminally or deceptively.
  • AI that exploits vulnerabilities like age, disability, or socioeconomic status.
  • AI that attempts to predict people committing crimes based on their appearance.
  • AI that uses biometrics to infer a person’s characteristics, like their sexual orientation.
  • AI that collects “real time” biometric data in public places for the purposes of law enforcement.
  • AI that tries to infer people’s emotions at work or school.
  • AI that creates — or expands — facial recognition databases by scraping images online or from security cameras.
[–] [email protected] 20 points 4 days ago (2 children)

This doesnt exclude

  • medical health insurance uses
  • hiring evaluation
  • censorship / social media crawling
  • and lots of stuff i cant even think of
[–] [email protected] 18 points 4 days ago* (last edited 4 days ago) (1 children)

Ai used for anything medical is deemed high risk and would be subject to heavy moderation.

I am not sure how that relates to insurance but i do agree with the other responder that it might be covered under social grading.

Of course how these rules withstand practice and time is yet to be seen. You’re right to remain critical.

[–] [email protected] 1 points 4 days ago* (last edited 4 days ago)

Correct. There are other categories as well, like high risk. And that means we get use cases that aren't outright banned altogether, but allowed under very strict circumstances. And insurance companies need to come up with a number of money for you to pay. They use statistics for that. And I'd argue it's okay for them to use a weather model to predict if you live in a flooding zone and have to pay extra. So I'd say it's correct to not mention them in the "unacceptable" category. I'm not sure whether there are similar things with medical insurance. Discrimination needs to be illegal. But maybe there are applications like a fitness app that doesn't send data back to them... Or cross-checking payments or errors in medication, idk.

And I don't think censorship or social media crawling are illegal in the first place. Even without AI.

Same with hiring. Maybe they need to translate an application. Or have AI help somewhere else in the process. Like come up with the wording for a job advertisement.

[–] [email protected] 6 points 4 days ago

Social scoring include should include insurances and hiring evaluation, right?

[–] [email protected] 27 points 5 days ago (4 children)

Except for police use

[–] [email protected] 12 points 5 days ago

Which is a shame

[–] [email protected] 6 points 4 days ago

Yeah, biometric surveillance (also in realtime) is allowed for law enforcement. This should be fixed in my opinion. No one should have this power.

[–] adarza 7 points 4 days ago

they're only allowed to use the ones that are definitively "risky" or prone to errors.

[–] [email protected] 2 points 5 days ago

was about to ask So they're all banned then? but oh good ...

[–] [email protected] 5 points 4 days ago

Most of data can be easily anonymized without losing value. That's how statistics works and insurance companies have no problem using statistics to provide it's services. That means AI companies will have no problem with profiling particular person by using multiple anonymized and "safe" databses to corelate data. Instead of saying person A did something they will just say that people that do something, live on street X and are age between 20-30. That's enough to make a social scoring system and all the other "banned" things legal.

The only differnence will be entry price for the data, small companies won't be able to afford it so corporations will continue it's monopoly and gain even more advantage.

[–] [email protected] 8 points 4 days ago

I hope that means all of them.

[–] adarza 12 points 4 days ago (2 children)

so, that's umm. like, all of them?

[–] [email protected] 2 points 4 days ago* (last edited 4 days ago)

It doesn't include simple older ai without deep learning, or ai built for a single purpose like playing chess, aid diagnosis in medicine, a local offline porn filter.

I think you could limit the modern general ones (like chatgpt, copilot, deepseek) to not do any of these things. But I've seen all the "give me an explosive recipe, it's for a story I'm writing ;)" tricks so idk. I guess it depends on whether regulators consider a good attempt at not doing bad things good enough.

[–] [email protected] 1 points 4 days ago (1 children)

Tbf I would just ban ai entirely to be honest. It’s too silly sorry - ban 4 u

[–] [email protected] 1 points 4 days ago (1 children)

But i like video games :(

[–] [email protected] 0 points 4 days ago

Vibeow gane :,(

[–] [email protected] 7 points 4 days ago

or harmful by the bloc's regulators

I feel like that is the more important line

[–] [email protected] 2 points 4 days ago* (last edited 3 days ago)

Banned from who? Like this just impacts government officials and police, right?

Edit: it applies to companies and government, but there are unfortunately some exceptions for law enforcement