The Australian government has taken a significant step towards creating a safer online environment by announcing plans to ban apps used for stalking and creating deepfake nudes.
Minister for Communications Anika Wells emphasized the need for a proactive approach to harm prevention, stating that “abusive technologies are widely and easily accessible and are causing real and irreparable damage now.”
These new regulations will hold tech platforms accountable for preventing access to “nudify” and undetectable online stalking tools, ensuring that legitimate and consent-based artificial intelligence (AI) and online tracking services are not adversely affected.
The use of AI to create sexually explicit images of people without their consent has become a growing concern, with platforms capable of producing photo-realistic material at the click of a mouse.
A survey conducted by the United States-based advocacy group Thorn last year revealed that 10% of respondents personally knew someone who had deepfake nude imagery created of them, while 6% reported being direct victims of such abuse.
These statistics underscore the urgent need for measures to prevent the spread of non-consensual explicit content.
Under the new regulations, tech platforms will be responsible for preventing access to “abhorrent technologies” while ensuring that legitimate AI and tracking services are not affected.
Minister Wells noted that “while this move won’t eliminate the problem of abusive technology in one fell swoop, alongside existing laws and our world-leading online safety reforms, it will make a real difference in protecting Australians.”
This approach builds upon Australia’s existing online safety reforms, including the world’s first ban on social media use by minors.
The Australian government’s move is expected to have a significant impact on online safety, particularly for young people.
The ban on social media use by minors, set to take effect by the end of the year, will impose fines of up to 49.5 million Australian dollars ($32 million USD) on social media platforms that fail to take “reasonable steps” to prevent under-16s from creating or maintaining accounts.
This regulatory framework aims to curb online harm and promote a safer online environment for all Australians.
Australia’s decision to ban “nudify” and stalking apps marks a crucial step towards addressing the growing concern of deepfake abuse and online harassment.
By holding tech platforms accountable and promoting a proactive approach to harm prevention, the government aims to create a safer online environment for its citizens.
As the digital landscape continues to evolve, it is essential for governments and tech companies to work together to prevent the misuse of AI and protect individuals from online harm.