Privacy

EU member states remain divided on controversial CSAM-scanning plan — but for how long?

Comment

a collection of patterned illustrated eyes in blue and pink on a darker blue background
Image Credits: Jake O'Limb / PhotoMosh / Getty Images

A key body of European Union lawmakers remains stalled over a controversial legislative proposal that could see millions of users of messaging apps forced to agree to their photo and video uploads being scanned by AI to detect child sexual abuse material (CSAM).

Critics of the plan include tech industry messaging giants like WhatsApp; privacy-focused players like Signal and Proton; legal, security and data protection experts; civil society and digital rights groups; and a majority of lawmakers from across the political spectrum in the European Parliament. They warn that the proposal will break encryption, arguing it poses an existential threat to the bloc’s democratic freedoms and fundamental rights like privacy.

Opponents also contend the EU plan will fail at its claimed aim of protecting children, suggesting law enforcement will instead be swamped by millions of false positives as everyday app users’ messages are fed through flawed AI-based CSAM detection systems.

On Thursday, a meeting of ambassadors representing the bloc’s 27 member states’ governments had been expected to reach a position on the file to open negotiations with the European Parliament after the Belgian presidency put the item on an agenda for Thursday’s meeting. However, a spokesperson for Belgium’s permanent representative to the EU confirmed to TechCrunch the item was dropped after it became clear governments were still too divided to achieve a qualified majority on a negotiating mandate.

“We had the intention to reach a mandate at the meeting of the ambassadors today, but it was not clear yet whether we would have the required majority,” said Belgium’s spokesperson. “In the last hours before the meeting it … was clear that the required qualified majority could just not be met today so we decided to remove the item from the agenda and to continue the consultation between the Member States — to continue working on the text.”

This is important, as EU law tends to be a three-way affair, with the Commission proposing legislation and the Parliament and Council debating (and often amending) draft laws until a final compromise can be reached. But these so-called trilogue talks on the CSAM-scanning file can’t start until the Council adopts its position. So if member states remain divided, as they have been for some two years since the Commission introduced the CSAM-scanning proposal, the file will remain parked.

Earlier this week, Signal president Meredith Whittaker dialed up her attacks on the controversial EU proposal. “[M]andating mass scanning of private communications fundamentally undermines encryption. Full stop,” she warned, accusing regional lawmakers of attempting a cynical rebrand of client-side scanning to try to cloak a plan that amounts to mass surveillance of private communications.

Despite loud and growing alarm over the bloc’s apparent hard-pivot to digital surveillance, the European Commission and Council have continued to push for a framework that would require message platforms to bake in scanning of citizens’ private messages — including for end-to-end encrypted (E2EE) platforms like Signal — rather than supporting the more targeted searches and carve out for E2EE platforms proposed by MEPs in the European Parliament last year.

Last month, details of a revised CSAM proposal circulated by the Belgians for Member States’ governments’ consideration emerged via leaks, causing fresh consternation.

Pirate Party MEP Patrick Breyer, who has opposed the Commission’s CSAM-scanning plan from the start, argues that the Council’s revised proposal will require messaging app users in the EU to agree to scanning of all images and videos they sent to others, via a technical scheme the text couches as “upload moderation,” or else lose the ability to send imagery to others. “The leaked Belgian proposal means that the essence of the EU Commission’s extreme and unprecedented initial chat control proposal would be implemented unchanged,” he warned at the time.

Private messaging app makers, including Signal, have also warned they would leave the EU rather than be forced to comply with a mass surveillance law.

In a press email Thursday, Breyer welcomed the failure of enough EU ambassadors to agree on a way forward, but he cautioned that this is likely just a stay of execution, writing: “For now the surveillance extremists among the EU governments and Big Sister [home affairs commissioner] Ylva Johansson have failed to build a qualified majority. But they will not give up and could try again in the next few days. When will they finally learn from the EU Parliament that effective, court-proof and majority-capable child protection needs a new approach?”

Also responding to the Council’s setback in a statement, Proton founder Andy Yen made a similar point about the need to keep up the fight. “We must not rest on our laurels,” he wrote. “Anti-encryption proposals have been defeated before only to be repackaged and brought back into the political arena again and again and again. It’s vital that the defenders of privacy remain vigilant and don’t fall for the spin and window-dressing when the next attack on encryption is launched.”

It certainly looks like any celebration of the Council’s ongoing divisions on the file should be tempered with caution as member states’ governments appear to be a hair’s distance away from reaching the necessary qualified majority to kick off talks with MEPs, in which they would immediately be pressing parliamentarians to agree to legislate for mass scanning of citizens’ devices despite their own opposition. “We are extremely, extremely close to a qualified majority,” Belgium’s spokesperson told TechCrunch. “If just one country changes opinion we have a qualified majority and we have a mandate for the Council.”

The spokesperson also told us that a final Coreper meeting next week, the last before its six-month term ends, already has a full agenda, suggesting that talks to try to agree to the Council’s mandate will therefore fall to Hungary, which takes up the rotating Council presidency for six months starting on July 1.

“As far as we are concerned, as presidency, in the coming days — at the expert level — we continue to work and to see whether the Member States that were not happy or satisfied with the proposal we will continue to discuss how we can fine-tune it to make it viable for everyone,” the spokesperson added. “And then it will be up for the next presidency to discuss.

“As far as we understand, they are keen to continue working on the topic. The Commission is also willing to. And the parliament is waiting for us so we need to.”

More TechCrunch

Simply submitting the request for a takedown doesn’t necessarily mean the content will be removed, however.

YouTube now lets you request removal of AI-generated content that simulates your face or voice

The news highlights that the fallout from the Evolve data breach on third-party companies — and their customers and users —  is still unclear.

Fintech company Wise says some customers affected by Evolve Bank data breach

The Supreme Court on Monday vacated two judicial decisions concerning Republican-backed laws from Florida and Texas aimed at limiting social media companies’ ability to moderate content on their platforms. The…

Supreme Court sends Texas and Florida social media regulation laws back to lower courts

Afloat, a gift delivery app that lets you shop from local stores and have gifts delivered to a loved one on the same day, is now available across the U.S. The…

Gifting on-demand startup Afloat goes nationwide

Exciting news for tech enthusiasts and innovators! TechCrunch Disrupt 2024 is just around the corner, and we have an incredible opportunity for you to elevate your brand’s visibility. How? By…

Drive brand impact with a Side Event at TechCrunch Disrupt

After Meta started tagging photos with a “Made with AI” label in May, photographers complained that the social networking company had been applying labels to real photos where they had…

Meta changes its label from ‘Made with AI’ to ‘AI info’ to indicate use of AI in photos

Investment app Robinhood is adding more AI features for investors with its acquisition of AI-powered research platform Pluto Capital, Inc. Announced on Monday, the company says that Pluto will allow…

Robinhood snaps up Pluto to add AI tools to its investing app

Vaire Computing, based in London and Seattle, is betting that chips that can do reversible computing are going to be the way forward for the world.

Vaire Computing raises $4.5M for ‘reversible computing’ moonshot which could drastically reduce energy needs

The EC has found that Meta’s “pay or consent” offer to Facebook and Instagram users in Europe does not comply with the bloc’s DMA.

Meta’s ‘pay or consent’ model fails EU competition rules, Commission finds

The round was led by KKR and Teachers’ Ventures Growth, an investment arm of Ontario Teachers’ Pension Plan.

Japan’s SmartHR raises $140M Series E as strong demand for HR tech boosts its ARR to $100M

RoboGrocery combines computer vision with a soft robotic gripper to bag a wide range of different items.

MIT’s soft robotic system is designed to pack groceries

This is by no means a complete list, just a few of the most obvious tricks that AI can supercharge.

AI-powered scams and what you can do about them

Identity.vc writes checks that range from €250,000 to €1.5 million into companies from the pre-seed to Series A stages.

Identity.vc is bringing capital and community to Europe’s LGBTQ+ venture ecosystem

Featured Article

Robot cats, dogs and birds are being deployed amid an ‘epidemic of loneliness’

In the early 1990s, a researcher at Japan’s National Institute of Advanced Industrial Science and Technology began work on what would become Paro. More than 30 years after its development, the doe-eyed seal pup remains the best-known example of a therapeutic robot for older adults. In 2011, the robot reached…

1 day ago
Robot cats, dogs and birds are being deployed amid an ‘epidemic of loneliness’

Apple’s AI plans go beyond the previously announced Apple Intelligence launches on the iPhone, iPad and Mac. According to Bloomberg’s Mark Gurman, the company is also working to bring these…

Apple reportedly working to bring AI to the Vision Pro

One of the earlier SaaS adherents to generative AI has been ServiceNow, which has been able to take advantage of the data in its own platform to help build more…

ServiceNow’s generative AI solutions are taking advantage of the data on its own platform

India’s top AI startups include those building LLMs and setting up the stage for AGI as well as bringing AI to cooking and serving farmers.

Here are India’s biggest AI startups based on how much money they’ve raised

We live in a very different world since the Russian invasion of Ukraine in 2022 and Hamas’s October 7 attack on Israel. With global military expenditure reaching $2.4 trillion last…

Defense tech and ‘resilience’ get global funding sources: Here are some top funders

Two separate studies investigated how well Google’s Gemini models and others make sense out of an enormous amount of data.

Gemini’s data-analyzing abilities aren’t as good as Google claims

Featured Article

The biggest data breaches in 2024: 1 billion stolen records and rising

Some of the largest, most damaging breaches of 2024 already account for over a billion stolen records.

2 days ago
The biggest data breaches in 2024: 1 billion stolen records and rising

Welcome back to TechCrunch’s Week in Review — TechCrunch’s newsletter recapping the week’s biggest news. Want it in your inbox every Saturday? Sign up here. This week, Apple finally added…

Apple finally supports RCS in iOS 18 update

Featured Article

SAP, and Oracle, and IBM, oh my! ‘Cloud and AI’ drive legacy software firms to record valuations

There’s something of a trend around legacy software firms and their soaring valuations: Companies founded in dinosaur times are on a tear, evidenced this week with SAP‘s shares topping $200 for the first time. Founded in 1972, SAP’s valuation currently sits at an all-time high of $234 billion. The Germany-based…

2 days ago
SAP, and Oracle, and IBM, oh my! ‘Cloud and AI’ drive legacy software firms to record valuations

Sarah Bitamazire is the chief policy officer at the boutique advisory firm Lumiera.

Women in AI: Sarah Bitamazire helps companies implement responsible AI

Crypto platforms will need to report transactions to the Internal Revenue Service, starting in 2026. However, decentralized platforms that don’t hold assets themselves will be exempt. Those are the main…

IRS finalizes new regulations for crypto tax reporting

As part of a legal settlement, the Detroit Police Department has agreed to new guardrails limiting how it can use facial recognition technology. These new policies prohibit the police from…

Detroit Police Department agrees to new rules around facial recognition tech

Plaid’s expansion into being a multi-product company has led to real traction beyond traditional fintech customers.

Plaid, once aimed at mostly fintechs, is growing its enterprise business and now has over 1,000 customers signed on

He says that the problem is that generative AI is not human or even human-like, and it’s flawed to try and assign human capabilities to it.

MIT robotics pioneer Rodney Brooks thinks people are vastly overestimating generative AI

Matrix is rebranding its India and China affiliates, becoming the latest venture firm to distance its international franchises. The U.S.-headquartered venture capital firm will retain its name, while Matrix Partners…

Matrix venture firm distances from India and China affiliates

Adept, a startup developing AI-powered “agents” to complete various software-based tasks, has agreed to license its tech to Amazon, and the startup’s co-founders and portions of its team have joined…

Amazon hires founders away from AI startup Adept

There are plenty of resources to learn English, but not so many for near-native speakers who still want to improve their fluency. That description applies to Stan Beliaev and Yurii…

YC alum Fluently’s AI-powered English coach attracts $2M seed round
  翻译: