FSF Warns of Risks in Newsom Order to Investigate AI Kill Switches
California Governor Gavin Newsom Issues Executive Order Targeting Artificial Intelligence Platforms
On September 18, 2026, California Governor Gavin Newsom issued an executive order directing the California Government Operations Agency to work with a panel of experts to investigate amending state law to mandate “kill switches” in artificial intelligence models based in the state, with verification handled by an independent organization, fsf.org reported. The order encompasses frontier platforms developed by companies located within California, according to details released by the governor’s office and cited by news.tuxmachines.org.
-
The Tech TL;DR:
- California’s executive order directs state agencies to study mandatory AI kill switches.
- The Free Software Foundation raised concerns regarding who ultimately controls these centralized mechanisms.
- Independent verification methods outlined in the order face skepticism from software freedom advocates.
The Free Software Foundation responded to the governor’s directive by highlighting potential risks to user autonomy and technical control. Greg Farough, campaigns manager at the Free Software Foundation, published a caution on the organization’s website on Sunday, examining the implications of embedding mandatory kill switches into large language models and frontier systems, news.tuxmachines.org noted. While acknowledging that Governor Newsom aims to use independent organizations to verify switch functionality, the foundation argued that centralizing control over computing infrastructure creates a dangerous precedent for users everywhere.
Evaluating the Implications of Centralized Control Over Software Systems
The core debate centers on software freedom and user agency in large-scale computing environments. According to analysis published by fsf.org, control over utilized technology remains a fundamental pillar of computing rights, and artificial intelligence infrastructure should not be treated as an exception. The proposal to mandate kill switches controlled by corporate providers or external oversight bodies raises critical questions about transparency and decentralization.
Although the panel of experts called for in the executive order will be drawn largely from California’s existing technology sector, critics maintain that even well-intentioned verification organizations cannot fully protect individual computing freedom when underlying power remains centralized.
Future Regulatory Actions by the California Government Operations Agency
The California Government Operations Agency is tasked with reviewing the feasibility of these legislative and technical amendments alongside its panel of experts. The outcome of this investigation will determine whether the state formally pursues statutory requirements for model termination mechanisms. Industry participants and software developers await the agency’s formal recommendations to the governor’s office regarding how user dignity and individual software control factor into state-level compliance frameworks.
“Assuming such a kill switch was developed, who would really control it? We hope our readers understand the problems inherent in giving one single or a small number of kill switches to anyone.” — fsf.org
Disclaimer: The technical analyses and security protocols detailed in this article are for informational purposes only. Always consult with certified IT and cybersecurity professionals before altering enterprise networks or handling sensitive data.