The AI safety debate is tearing Silicon Valley apart
Welcome to Fast Company Daily, our daily newsletter on LinkedIn, featuring a free article selected each day by our editors as well as a roundup of great advice on careers, hiring, innovation, and technology.
Visit fastcompany.com for our top stories and breaking news. First time seeing this? Please subscribe.
Don't miss these top stories:
What's going on with OpenAI?
It's been a big weekend in the world of Artificial Intelligence after the board of OpenAI ousted former CEO Sam Altman. If you missed the news (or simply can't keep up with how fast things are changing), here's where we stand as of midday Monday:
The AI safety debate is tearing Silicon Valley apart
The long-simmering fault lines within OpenAI over questions of safety with regard to the deployment of large language models like GPT, the engine behind OpenAI’s ChatGPT and DALL-E services, came to a head on Friday when the organization’s nonprofit board of directors voted to fire then-CEO Sam Altman. In a brief blog post, the board said that Altman had not been “consistently candid in his communications.” Now rumors are swirling about Altman’s next move—and possible return.
But OpenAI is not the only place in Silicon Valley where skirmishes over AI safety have exploded into all-out war. On Twitter, there are two camps: the safety-first technocrats, led by venture firms like General Catalyst in partnership with the White House; and the self-described “techno-optimists,” led by libertarian-leaning firms like Andreessen Horowitz.
Recommended by LinkedIn
The technocrats are making safety commitments and forming committees and establishing nonprofits. They recognize AI’s power and they believe that the best way to harness it is through cross-disciplinary collaboration.
Hemant Taneja, CEO and managing director of General Catalyst, announced on Tuesday that he had led more than 35 venture capital firms and 15 companies to sign a set of “Responsible AI” commitments authored by Responsible Innovation Labs, a nonprofit he cofounded. The group also published a 15-page Responsible AI Protocol, which Taneja described on X as a “practical how-to playbook.”
Taneja’s tweet was quickly ratioed. Praying for Exits, a Silicon Valley meme account and investor, posted a screenshot of messages between an AI researcher, named Rohan Pandey, and an investor at Insight Partners, which also signed the Responsible AI commitments, in which Pandey canceled their upcoming meeting; Pandey said the commitments would “endanger open-source AI research & contribute to regulatory capture.”
Meanwhile, the techno-optimists (some refer to themselves as “humanists” and their adversaries as “doomers”) are grandstanding via tweet, podcast, and blog post. They recognize AI’s power, and they believe that entrepreneurs—rather than policymakers—are best equipped to make the technology a force for good.
“I want to build an AI agent that I am okay with giving to my children,” AI researcher and cognitive scientist Joscha Bach tweeted on Thursday. “It’s the same AI I want to build for myself. It will talk to me, join me, extend me. It will fit like a glove around my mind, and you will want one, too.”
Venture capitalist Marc Andreessen replied, “100 emoji.”
Notably, the techno-optimists have been up in arms since President Biden issued an executive order on the “Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence” in late October. In Europe, negotiations over an AI Act remain underway, with debate centering around the question of regulating foundation models directly as opposed to regulating consumer harm.
“Make no mistake, policymakers view the AI battle as an opportunity to relitigate tech regulation more broadly,” Andreessen Horowitz general partner Martin Casado tweeted earlier this week. “It is absolutely imperative we don’t let this happen.”
As news broke of Altman’s ouster, and OpenAI board chairman Greg Brockman’s subsequent resignation, techno-optimist Twitter wasted no time in assigning hero and villain labels to the players involved.
“Unsure what the board saw, from the outside looking in, it’s hard to argue there’s a better AI Exec than Sam,” Two Sigma investor Vin Sachidananda tweeted. “Also, given the inherent challenges of developing these technologies seems strange that half the board consists of ‘AI governance’ folks that have never built things.”
As for where Altman stands in the debate, he has done plenty of artificial general intelligence (AGI) fear-mongering, a techno-optimist no-no. But at the same time, he has pushed to deploy and commercialize AI rapidly, taking a technology that was once the purview of the ivory tower into the mainstream—a techno-optimist victory. Plus, he’s now the victim of bureaucracy (albeit one that he himself created).
Regardless of what Altman says or does, as the bellwether of AI, each side will claim him as their own—and the debate will continue.
Instagram Marketing Expert | Organic Growth & Engagement Specialist at Upwork & Fiverr
1yThanks you for sharing!!
Insurance Operations Executive with Proven Success in Client Retention and Growth. Highly motivated leader with 15+ years of insurance industry expertise and driving operational efficiency to exceed client expectations.
1yIt's my opinion these debates are absolutely critical and necessary to establishing the very best possible foundation, steeped in ethical parameters and under guidelines of proper stewardship, so Ai can continue to grow and develop as a tool to enhance our lives instead of becoming a real world version of the movie I, Robot. This is a technology that could easily revolutionize humanity and the way we interact with the world around us. The people who are developing this tech and pushing for it be immersed deeper and deeper into everything we do MUST constantly be vigil and aware of the fact they are literally holding Pandora's box in their hand. We all know Pandora doesn't go BACK IN the box once she's let out. Not even a little. Pandora eats the box, the person who was holding the box, the ground the person holding the box was standing on, and then will pursue the other 8,074,073,854 people who, unfortunately, just so happen to be cohabitating on the same planet when she was released. 😯
Senior Usability Specialist | UX Researcher | Data Analyst | Process Specialist | Business Analyst
1yThank you for