California governor blocks landmark AI safety bill

California governor blocks landmark AI safety bill
By: BBC Tech Posted On: September 30, 2024 View: 47

California governor blocks landmark AI safety bill

California Governor Gavin Newsom standing at a lectern, speaking at a press conference, with one arm slightly raised
Gavin Newsom said the bill could stifle innovation and prompt AI firms to move out of California

The governor of California, Gavin Newsom, has blocked a landmark artificial intelligence (AI) safety bill, which had faced strong opposition from major technology companies.

The proposed legislation would have imposed some of the first regulations on AI in the US.

Mr Newsom said the bill could stifle innovation and prompt AI developers to move out of the state.

Senator Scott Wiener, who authored the bill, said the veto allows companies to continue developing an "extremely powerful technology" without any government oversight.

The bill would have required the most advanced AI models to undergo safety testing.

It would have forced developers to ensure their technology included a so-called "kill switch". This would allow organisations to isolate and effectively switch off an AI system if it became a threat.

It would also have made official oversight compulsory for the development of so-called "Frontier Models" - or the most powerful AI systems.

The bill "does not take into account whether an Al system is deployed in high-risk environments, involves critical decision-making or the use of sensitive data," Mr Newsom said in a statement.

"Instead, the bill applies stringent standards to even the most basic functions - so long as a large system deploys it," he added.

At the same time, Mr Newsom announced plans to protect the public from the risks of AI and asked leading experts to help develop safeguards for the technology.

Over the last few weeks, Mr Newsom has also signed 17 bills, including legislation aimed at cracking down on misinformation and so-called deep fakes, which include images, video, or audio content created using generative AI.

California is home to many of the world's largest and most advanced AI companies, including the ChatGPT maker, OpenAI.

The state's role as a hub for many of the world's largest tech firms means that any bill regulating the sector would have a major national and global impact on the industry.

Mr Wiener said the decision to veto the bill leaves AI companies with "no binding restrictions from US policy makers, particularly given Congress’s continuing paralysis around regulating the tech industry in any meaningful way."

Efforts by Congress to impose safeguards on AI have stalled.

OpenAI, Google and Meta were among several major tech firms that voiced opposition to the the bill and warned it would hinder the development of a crucial technology.

Wei Sun, a senior analyst at Counterpoint Research, said: "AI, as a general-purpose technology, is still in its early stages, so restricting the technology itself, as proposed, is premature.

"Instead, it would be more beneficial to regulate specific application scenarios that may cause harm in the future," she added.

Read this on BBC Tech
This site uses cookies. By continuing to use this site you agree to our use of cookies.
Read more I agree