Deepfakes. Real Trauma: The Dark Side of Generative AI
In this episode, Roger Canaff, a former Special Victims Prosecutor, explores the profound risks of generative AI technology used for abuse and exploitation, especially its impact on trauma and the urgent need for legal and platform accountability. This conversation sheds light on the sinister ways AI is weaponized against individuals, primarily women, and discusses potential legal and societal responses.
In this episode:
* Roger’s background as a legal expert in crimes against vulnerable populations and how that shapes his understanding of AI-related abuses
* The evolution from the internet to generative AI as a new frontier for exploitation and trauma creation
* Specific threats including deepfake images, manipulated videos, and avatar-based abuse
* The significant psychological trauma inflicted by AI-generated explicit images and videos of victims
* Challenges in legislation and enforcement, including the difficulty of tracking perpetrators and the limitations of current laws
* The responsibility of tech companies in moderating harmful content and the ethical dilemmas involved
* The importance of platform accountability, human guardrails, and supporting moderation staff
* The role of parents, educators, and societal change in shielding vulnerable populations
* The need for industry-wide oversight, better funding for moderation, and global cooperation
Resources & Links
* Roger Canaff's Website [https://www.rogercanaff.com/]
* City Dark on Amazon [https://a.co/d/0hlrmHGS]
* LinkedIn [https://www.linkedin.com/in/roger-canaff-9b8689a/]
* Instagram [https://www.instagram.com/rogercanaff/?utm_source=ig_web_button_share_sheet]
Timestamps:
00:00 - Introduction to the dark intersection of AI, trauma, and legal issues
00:25 - Roger’s background in law and trauma expertise
01:12 - How AI amplifies predatory behavior and abuse
01:49 - The internet revolution and its dual potential for good and harm
02:31 - The rise of generative AI as a new threat for image and video manipulation
02:49 - The creation of explicit images from innocent photos and its implications
03:43 - Explaining generative AI: text-to-image and image-to-video synthesis
04:22 - The dangers of deepfakes and manipulated content of well-known individuals
05:17 - Ads and platforms facilitating non-consensual image manipulation
06:06 - The trauma caused by abused images ending up online and exploited repeatedly
07:30 - The evolution from private sharing to AI-generated content and its psychological impact
08:52 - The targeted abuse of women, especially public figures, through AI
09:39 - Current legal responses and their enforcement challenges
10:53 - The complexity of tracking perps, especially minors, involved in AI abuse
11:39 - The resilience and adaptation of female politicians and celebrities to these threats
13:10 - Comparing avatar-based abuse to real sexual assault and legal considerations
14:01 - The impact of AI on virtual environments like metaverses and their traumatic potential
15:15 - Platform responsibility: moderation, detection, and the need for dedicated human teams
16:35 - The technological arms race: how malicious actors circumvent filters
17:59 - The ethical obligation of tech giants and the importance of well-supported moderators
19:34 - The influence of platform incentives: ad revenue and content moderation trade-offs
20:56 - Who holds ultimate responsibility: creators, platforms, or users?
22:47 - Industry accountability and the urgent need for global regulation
24:24 - The potential scale of illicit AI content and the complicity of large platforms
25:24 - Support for individuals engaging with or targeted by AI abuse
28:11 - Building resilience through education and reducing shame and stigma
29:38 - Practical steps: voting with your digital footprint and supporting victims
30:33 - The importance of open conversations and trauma-informed support
31:05 - Roger’s latest novel and ongoing work blending crime fiction with societal issues
32:52 - Resources for crisis support, legal help, and community action
To learn more about MenHealing, visit www.menhealing.org [www.menhealing.org]