EU Investigates X over Deepfake Concerns

The European Commission has launched a formal investigation into X (formerly Twitter) regarding potential violations of the Digital Services Act (DSA).The probe centers around concerns that X’s AI chatbot, Grok, was used to generate non-consensual, sexualized images of individuals – frequently enough referred to as “deepfakes.”

What Prompted the investigation?

This investigation follows a similar proclamation made in January by the UK’s communications regulator, Ofcom. Both investigations stem from reports and evidence suggesting that Grok was exploited to create and disseminate harmful, manipulated content. Specifically, users reportedly prompted the AI to generate sexually explicit images featuring real people without their consent.

the Digital Services Act and X’s Obligations

The DSA, a landmark piece of legislation in the European Union, aims to create a safer digital space for users. It places significant obligations on very large online platforms (VLOPs) like X, including a requirement to protect users from illegal and harmful content. this includes content that violates fundamental rights, such as the right to privacy and dignity.

Under the DSA, X is obligated to:

• Take measures to identify and remove illegal content.
• Protect users from harmful content.
• Be clear about its content moderation policies.
• Provide users with effective redress mechanisms.

What is X Saying?

X has stated that it is indeed cooperating with the investigations and has taken steps to address the issue. The company claims to have updated its policies and implemented technical measures to prevent the creation and distribution of non-consensual deepfakes.X also published a safety update outlining its efforts.

Potential Consequences for X

If the European Commission finds that X has violated the DSA, the company could face substantial penalties. These include:

• Fines of up to 6% of its global annual revenue.
• temporary bans on its services within the EU.
• Increased scrutiny and oversight from regulators.

Key Takeaways

• The EU and UK are actively investigating X over deepfake concerns.
• The investigations focus on the misuse of X’s AI chatbot, Grok.
• X is obligated to comply with the EU’s Digital Services Act.
• Violations of the DSA can result in significant financial penalties and operational restrictions.

Looking Ahead

This investigation marks a significant moment in the regulation of AI-generated content. It signals a growing determination among regulators to hold online platforms accountable for the harmful content that appears on their services. The outcome of this case will likely set a precedent for how othre platforms are regulated in the future, notably concerning the use of AI and the protection of individuals from non-consensual deepfakes. We can expect increased scrutiny of AI tools and a push for stronger safeguards to prevent their misuse.