this post was submitted on 19 Jan 2022
10 points (91.7% liked)

Asklemmy

44847 readers
911 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago
MODERATORS
 

I am worried about the criminal malice of deep fakes. I'm not worried about deep fakes being difficult to identify (thought that is a possibility), since context is important; rather I am worried about the response to malicious use of deepfakes by governments.

Will governments even attempt to reduce the destructive potential of deepfakes? I'm doubtful considering political corruption.


Deep fakes could be useful tools for people that have difficulties with neurotypically social communication, or just increase acceptance of nonneurotypical communication.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 4 points 3 years ago* (last edited 3 years ago) (1 children)

In general fakes getting better, tech evolves but counter-measures to spot fakes also evolve which is a natural process.

Deepfakes often use a type of AI called a Generational Adversarial Network (GAN). Oversimplified: When you want to make a deepfake, you create two sets of AIs, one set to create deepfakes and one to detect them. They are pitted against each other and only the best at either are used to derive new versions of each type. This means both the generation and detection methods get better as the system runtime increases and the deepfake becomes more convincing, though usually the AIs are only tuned to that one specific instance, so of you set out to create a deepfake that merges hypothetical people Jack and Jill, they can only make deepfakes of Jack and Jill, and not Romeo and Juliet. For Romeo and Juliet, you would have to start the process all over again.

Keep on mind that all the creating new versions of the AIs stuff is automated, so you can churn out convincing deepfakes of tons of people with very little human intervention. This is part of the concern with deepfakes: any script kiddie can make them. It's not limited to big budget Hollywood studios or governments.

The use of GANs also raises concerns about how exactly you develop a detector for deepfakes if you're external to the process of creating them.