California lawmakers advanced Senate Bill (SB) 1047, a controversial piece of legislation focused on artificial intelligence (AI) safety. The bill, authored by Democratic Senator Scott Wiener of San Francisco, has passed the State Assembly and now awaits the final decision of Governor Gavin Newsom. Governor Newsom has until September 30 to either sign the bill into law or veto it.
SB 1047 mandates safety testing for advanced AI models, particularly those developed with significant financial investment or computational power. The legislation requires developers to implement a "kill switch" for these models and to undergo safety audits conducted by third-party reviewers. Additionally, {Crypto} the bill would allow the state attorney general to take legal action against developers if these AI models pose ongoing threats.
Despite Wiener’s assertion that the bill is necessary to prevent potential societal harm from unmanageable AI systems, the proposal has faced substantial opposition. Critics argue that SB 1047 could hinder innovation within California's tech industry. Notable figures, including former Speaker Nancy Pelosi, have expressed concerns that the bill could be counterproductive to California’s position as a leader in AI development.
Neil Chilson, head of AI policy at Abundance Institute, has cautioned that while SB 1047 targets high-cost AI models, its broad approach might inadvertently impact smaller companies and less advanced models. Tech giants like OpenAI, Google, and Meta have also voiced objections to the bill, suggesting it could stifle growth and innovation. However, Anthropic, a subsidiary of Amazon, has supported the legislation, suggesting that the benefits may outweigh the drawbacks despite some ambiguities.
The debate over SB 1047 is part of a broader discussion on AI regulation in California. Other proposed bills, such as SB 1220, which bans AI use in welfare and health services call centers, and AB 3211, which mandates watermarks on AI-generated content, are also under consideration. Notably, these discussions reflect varying perspectives on balancing innovation with regulatory oversight.
Elon Musk, developing the AI model Grok, has endorsed broad AI safety regulations, echoing the need for thoughtful regulatory approaches. The outcome of SB 1047 and related legislation will likely shape the future regulatory landscape for AI technology in California and beyond.