- A 16-year-old boy used AI to create and sell explicit deepfake images of schoolmates.
- 38 victims identified; youngest as young as 12.
- Schools criticized for inadequate response to early complaints.
The recent AI deepfake case in Johor, Malaysia, has triggered national outrage and concern. It was revealed that a teenage boy used artificial intelligence tools to generate pornographic images of his schoolmates. He then sold them online for RM2 each.
Deputy Communications Minister Teo Nie Ching emphasized the need for schools to adopt standard operating procedures. These procedures are needed to deal with digital harassment and exploitation.
Failure to Act: Schools Under Fire Amid AI Deepfake Abuse Case
The teen suspect, who has since been expelled, is believed to have sourced the victims’ images from social media. He then used AI tools to create fake nude visuals. His arrest came after 22 police reports were lodged. Furthermore, his remand has been extended as investigations continue.
Schools have been widely criticized for their lack of urgency. In this case, the victim first reported the incident to school authorities, but no timely intervention occurred. This delay potentially allowed more content to be created and shared.
Teo Nie Ching underlined the importance of schools taking digital safety seriously. She stated that previous similar incidents also saw institutions failing to respond effectively. She stressed the need for clear SOPs across all educational institutions, regardless of whether they are public or private.
Beyond school-level failures, the case raises serious questions about broader digital governance. The accessibility of AI tools for malicious purposes underscores the need for regulations addressing technology misuse, especially involving minors.
This case serves as a wake-up call for institutions to urgently address digital vulnerabilities. It is crucial to ensure that every student‘s safety—both offline and online—is prioritized.
“These issues must be taken seriously; schools need to act promptly and with gravity.” – Teo Nie Ching