Anthropic Co-founder Calls for AI Brake Mechanism as Technology Advances
Jack Clark, co-founder of the artificial intelligence company Anthropic, has urged the implementation of a mechanism to slow down the progression of AI development. Speaking to BBC’s Newsnight, Clark warned that AI technology is approaching a stage where it could evolve without human input, raising concerns about control and safety.
Why this matters
As AI systems become increasingly autonomous, the ability to regulate and control their development is critical to ensuring they benefit society without causing harm. Clark’s call highlights the urgency of establishing policies and regulations that can manage AI’s rapid growth and potential risks.
AI Development and the Need for Control
Clark described the current state of AI development as having a “gas pedal” but lacking a “brake pedal.” He emphasized the importance of having the option to slow down AI progress through government policy and regulation. Without such controls, AI systems could become too powerful and impact society in unpredictable ways.
Anthropic’s chatbot, Claude, already operates on code that is 80% self-generated by the AI itself. Clark suggested that reaching 100% self-generated code is possible within two years, a milestone that would have significant implications for AI autonomy and oversight.
Regulatory Comparisons and Industry Response
Clark compared the current AI situation to the early 20th-century oil industry, where society responded to rapid industrial growth by creating regulatory frameworks to ensure safety and public confidence. He suggested that a similar approach is needed for AI to manage risks and benefits effectively.
Despite these concerns, Anthropic welcomed a recent executive order on AI from US President Donald Trump, which took a relatively hands-off approach and did not mandate government safety testing for AI companies. Major AI firms, including Anthropic, OpenAI, and Google, have not announced any pauses in their research efforts.
Anthropic’s Growth and Public Position
Founded five years ago, Anthropic has grown rapidly and is preparing for a public stock market debut. Its valuation is estimated by private investors to be nearly $1 trillion (£745 billion), making it one of the most valuable AI firms preparing to go public.
Clark stated that Anthropic’s motivation for publicly discussing AI’s growing capabilities is to inform the public about the technology’s potential and risks rather than to enhance its market reputation. The company has been outspoken about AI risks and has previously raised concerns about the use of AI in mass surveillance and autonomous warfare.
Potential Risks and Social Impact
Clark expressed concern about the societal implications of AI’s continued advancement, including economic disruption. He noted that AI “agents,” or autonomous bots that perform routine tasks, could replace certain jobs, contributing to recent mass layoffs in the tech industry.
However, Clark also suggested that creativity and broad thinking remain valuable human traits that AI has yet to replicate. He encouraged individuals, especially young people, to pursue creative interests and liberal arts education as a way to thrive alongside AI technology.
“People that are creative and can think broadly, people that read a lot, people that have interests are the ones most benefited by this,” Clark said. “Indulge in curiosity and it pays back in how you can use this technology.”
Recommended reading
For more context, see related Peack News coverage and explainers linked below.
