Gavin Newsom advocates for an AI shutdown mechanism.

California Governor Gavin Newsom is gearing up to take a proactive stance on AI regulation, highlighted by a new executive order aimed at establishing robust oversight measures. This order calls for the formation of an expert panel tasked with providing recommendations within two months to enhance AI safety protocols within state legislation.

Newsom’s initiative includes proposals for AI companies to integrate independent verification teams for regular audits, ensure their transparency reports and risk assessments meet independent auditing standards, and develop a reliable “kill switch” that is routinely tested. Additionally, companies would be required to report significant safety incidents, such as the recent OpenAI attack on Hugging Face, as critical events. The order also accelerates the implementation of two laws he recently signed, which set up a framework for independent verifiers to evaluate AI safety and establish a state registry of AI auditors.

In the wake of alarming warnings from former Anthropic researcher Jacob Coxon about the potential risks of AI, discussions around legislation have intensified in Congress. However, the likelihood of passing substantial bills is low, especially with the House in recess until November and the midterm elections looming, which complicates legislative progress in the Senate. Meanwhile, former President Donald Trump has expressed that the only necessary oversight for AI comes from a “strong and smart” leadership.

Newsom’s executive order is just the beginning of California’s efforts in this arena. He has hinted at the possibility of convening a special legislative session on AI and is positioning his order as a template for federal action. He urges Congress and Trump to consider adopting California’s framework as a baseline for national regulation, emphasizing the need for comprehensive oversight for the safety of all Americans.

“The federal government’s failure to establish meaningful AI oversight should concern every American, especially as AI leaders call for regulation,” Newsom stated. “We’re not waiting to take action – we’re committed to advancing responsible AI oversight swiftly. The stakes are too high to delay.”