AI

OpenAI, Google, Microsoft and Anthropic form body to oversee safe ‘frontier AI’ development

Comment

ChatGPT, Microsoft Bing Chat and AI chat applications are seen on a mobile device
Image Credits: Jaap Arriens/NurPhoto / Getty Images

Four of the preeminent AI players are coming together to form a new industry body designed to ensure “safe and responsible development” of so-called “frontier AI” models.

In response to growing calls for regulatory oversight, ChatGPT developer OpenAI, Microsoft, Google and Anthropic have announced the Frontier Model Forum, a coalition that draws on the expertise of member companies to develop technical evaluations and benchmarks, and promote best practices and standards.

New frontier

At the core of the forum’s mission is something that OpenAI has previously termed “frontier AI,” which are advanced AI and machine learning models deemed dangerous enough to pose “severe risks to public safety.” They argue that such models pose a unique regulatory challenge, as “dangerous capabilities can arise unexpectedly,” making it difficult to prevent models from being misappropriated.

The self-stated goals for the new forum include:

i) Advancing AI safety research to promote responsible development of frontier models, minimize risks, and enable independent, standardized evaluations of capabilities and safety.
ii) Identifying best practices for the responsible development and deployment of frontier models, helping the public understand the nature, capabilities, limitations, and impact of the technology.
iii) Collaborating with policymakers, academics, civil society and companies to share knowledge about trust and safety risks.
iiii) Supporting efforts to develop applications that can help meet society’s greatest challenges, such as climate change mitigation and adaptation, early cancer detection and prevention, and combating cyber threats.

Although the Frontier Model Forum counts just four members at present, the collective says it’s open to new members. Qualifying organizations should be developing and deploying frontier AI models, and demonstrate a “strong commitment to frontier model safety.”

In the immediate term, the founding members say that the first steps will be to establish an advisory board to steer its strategy, alongside a charter, governance and funding structure.

“We plan to consult with civil society and governments in the coming weeks on the design of the Forum and on meaningful ways to collaborate,” the companies wrote in a joint statement today.

Regulation

While the Frontier Model Forum is designed to demonstrate that the AI industry is taking safety concerns seriously, it also highlights Big Tech’s desires to stave off incoming regulation through voluntary initiatives — and perhaps go some way toward writing its own rules.

Indeed, today’s news comes as Europe pushes ahead with what is set to be the first concrete AI rulebook, designed to enshrine safety, privacy, transparency and anti-discrimination at the heart of companies’ AI development ethos.

And last week, President Biden met with seven AI companies at the White House — including the four founding members of the Frontier Model Forum — to agree to voluntary safeguards against the burgeoning AI revolution, though critics argue that the commitments were somewhat vague.

However, Biden also indicated that regulatory oversight would be on the cards in the future.

“Realizing the promise of AI by managing the risk is going to require some new laws, regulations, and oversight,” Biden said at the time. “In the weeks ahead, I’m going to continue to take executive action to help America lead the way toward responsible innovation. And we’re going to work with both parties to develop appropriate legislation and regulation.”

More TechCrunch

Anthropic is launching a program to fund the development of new types of benchmarks capable of evaluating the performance and impact of AI models, including generative models like its own…

Anthropic looks to fund a new, more comprehensive generation of AI benchmarks

A group of senators has banded together to urge Synapse’s owners and bank and fintech partners to “immediately restore customers’ access to their money.” As part of their demands, the…

Senators urge owners, partners, and VC backers of fintech Synapse to restore customers’ access to their money

Hello and welcome back to TechCrunch Space. I hope everyone has a fantastic July 4 this week. Go eat a hot dog. Read my story from last week on the…

TechCrunch Space: Star spangled

Music, podcasts, audiobooks…emergency alerts? Spotify’s latest test has the streaming app venturing into new territory with a test of an emergency alerts system in its home market of Sweden. According…

Spotify tests emergency alerts in Sweden

Simply submitting the request for a takedown doesn’t necessarily mean the content will be removed, however.

YouTube now lets you request removal of AI-generated content that simulates your face or voice

The news highlights that the fallout from the Evolve data breach on third-party companies — and their customers and users —  is still unclear.

Fintech company Wise says some customers affected by Evolve Bank data breach

The Supreme Court on Monday vacated two judicial decisions concerning Republican-backed laws from Florida and Texas aimed at limiting social media companies’ ability to moderate content on their platforms. The…

Supreme Court sends Texas and Florida social media regulation laws back to lower courts

Afloat, a gift delivery app that lets you shop from local stores and have gifts delivered to a loved one on the same day, is now available across the U.S. The…

Gifting on-demand startup Afloat goes nationwide

Exciting news for tech enthusiasts and innovators! TechCrunch Disrupt 2024 is just around the corner, and we have an incredible opportunity for you to elevate your brand’s visibility. How? By…

Drive brand impact with a Side Event at TechCrunch Disrupt

After Meta started tagging photos with a “Made with AI” label in May, photographers complained that the social networking company had been applying labels to real photos where they had…

Meta changes its label from ‘Made with AI’ to ‘AI info’ to indicate use of AI in photos

Investment app Robinhood is adding more AI features for investors with its acquisition of AI-powered research platform Pluto Capital, Inc. Announced on Monday, the company says that Pluto will allow…

Robinhood snaps up Pluto to add AI tools to its investing app

Vaire Computing, based in London and Seattle, is betting that chips that can do reversible computing are going to be the way forward for the world.

Vaire Computing raises $4.5M for ‘reversible computing’ moonshot which could drastically reduce energy needs

The EC has found that Meta’s “pay or consent” offer to Facebook and Instagram users in Europe does not comply with the bloc’s DMA.

Meta’s ‘pay or consent’ model fails EU competition rules, Commission finds

The round was led by KKR and Teachers’ Ventures Growth, an investment arm of Ontario Teachers’ Pension Plan.

Japan’s SmartHR raises $140M Series E as strong demand for HR tech boosts its ARR to $100M

RoboGrocery combines computer vision with a soft robotic gripper to bag a wide range of different items.

MIT’s soft robotic system is designed to pack groceries

This is by no means a complete list, just a few of the most obvious tricks that AI can supercharge.

AI-powered scams and what you can do about them

Identity.vc writes checks that range from €250,000 to €1.5 million into companies from the pre-seed to Series A stages.

Identity.vc is bringing capital and community to Europe’s LGBTQ+ venture ecosystem

Featured Article

Robot cats, dogs and birds are being deployed amid an ‘epidemic of loneliness’

In the early 1990s, a researcher at Japan’s National Institute of Advanced Industrial Science and Technology began work on what would become Paro. More than 30 years after its development, the doe-eyed seal pup remains the best-known example of a therapeutic robot for older adults. In 2011, the robot reached…

2 days ago
Robot cats, dogs and birds are being deployed amid an ‘epidemic of loneliness’

Apple’s AI plans go beyond the previously announced Apple Intelligence launches on the iPhone, iPad and Mac. According to Bloomberg’s Mark Gurman, the company is also working to bring these…

Apple reportedly working to bring AI to the Vision Pro

One of the earlier SaaS adherents to generative AI has been ServiceNow, which has been able to take advantage of the data in its own platform to help build more…

ServiceNow’s generative AI solutions are taking advantage of the data on its own platform

India’s top AI startups include those building LLMs and setting up the stage for AGI as well as bringing AI to cooking and serving farmers.

Here are India’s biggest AI startups based on how much money they’ve raised

We live in a very different world since the Russian invasion of Ukraine in 2022 and Hamas’s October 7 attack on Israel. With global military expenditure reaching $2.4 trillion last…

Defense tech and ‘resilience’ get global funding sources: Here are some top funders

Two separate studies investigated how well Google’s Gemini models and others make sense out of an enormous amount of data.

Gemini’s data-analyzing abilities aren’t as good as Google claims

Featured Article

The biggest data breaches in 2024: 1 billion stolen records and rising

Some of the largest, most damaging breaches of 2024 already account for over a billion stolen records.

2 days ago
The biggest data breaches in 2024: 1 billion stolen records and rising

Welcome back to TechCrunch’s Week in Review — TechCrunch’s newsletter recapping the week’s biggest news. Want it in your inbox every Saturday? Sign up here. This week, Apple finally added…

Apple finally supports RCS in iOS 18 update

Featured Article

SAP, and Oracle, and IBM, oh my! ‘Cloud and AI’ drive legacy software firms to record valuations

There’s something of a trend around legacy software firms and their soaring valuations: Companies founded in dinosaur times are on a tear, evidenced this week with SAP‘s shares topping $200 for the first time. Founded in 1972, SAP’s valuation currently sits at an all-time high of $234 billion. The Germany-based…

2 days ago
SAP, and Oracle, and IBM, oh my! ‘Cloud and AI’ drive legacy software firms to record valuations

Sarah Bitamazire is the chief policy officer at the boutique advisory firm Lumiera.

Women in AI: Sarah Bitamazire helps companies implement responsible AI

Crypto platforms will need to report transactions to the Internal Revenue Service, starting in 2026. However, decentralized platforms that don’t hold assets themselves will be exempt. Those are the main…

IRS finalizes new regulations for crypto tax reporting

As part of a legal settlement, the Detroit Police Department has agreed to new guardrails limiting how it can use facial recognition technology. These new policies prohibit the police from…

Detroit Police Department agrees to new rules around facial recognition tech

Plaid’s expansion into being a multi-product company has led to real traction beyond traditional fintech customers.

Plaid, once aimed at mostly fintechs, is growing its enterprise business and now has over 1,000 customers signed on
  翻译: