AI for Business Institute

US Senator Proposes FDA-Style Federal AI Safety Agency

Senator Jeff Merkley advocates for a new federal agency, similar to the FDA, to establish AI standards and regulations. This initiative aims to address AI safety concerns and ensure responsible development through a centralised oversight body.

What happened

Senator Jeff Merkley has advocated for a new federal agency, modelled on the Food and Drug Administration (FDA), to oversee artificial intelligence safety. This proposed body would be tasked with establishing standards and regulations for AI systems, aiming to mitigate potential risks and ensure responsible development. The call for such an agency highlights growing concerns among policymakers regarding the rapid advancement of AI and its societal implications.

Why it matters

The proposal for an FDA-like AI oversight body signals a significant shift in the regulatory landscape, moving towards a more proactive and centralised approach to AI governance. For business leaders and AI practitioners, this suggests a future where AI development and deployment will likely be subject to stringent federal standards, impacting everything from product design to market entry. The establishment of a dedicated agency could provide much-needed clarity and consistency in regulation, but also presents challenges in navigating new compliance requirements and potential innovation hurdles. From an ethical standpoint, such an agency would aim to embed safety and responsibility into the core of AI development, addressing concerns around bias, transparency, and accountability at a systemic level.

The Institute take

The push for an FDA-style federal agency for AI safety reflects a common, yet potentially misdirected, impulse to apply familiar regulatory frameworks to novel technologies. While the intention to safeguard the public is commendable, simply porting a model designed for physical goods like food and pharmaceuticals to the dynamic, intangible realm of AI overlooks critical distinctions.

The fundamental difference lies in AI's adaptive and often opaque nature, which resists the static, pre-market approval processes common to agencies like the FDA. A more effective approach for responsible AI leadership involves focusing on continuous auditing, explainability, and robust impact assessments throughout the AI lifecycle, rather than solely at a hypothetical point of "certification." Businesses should advocate for agile, adaptive regulatory frameworks that incentivise ongoing responsibility and transparency, rather than rigid, one-time approvals that can quickly become obsolete.

Briefing notes

Questions this story answers

01What is Senator Merkley proposing for AI regulation?

Senator Jeff Merkley is proposing the creation of a new federal agency, modelled on the Food and Drug Administration (FDA), to oversee artificial intelligence safety by establishing standards and regulations for AI systems.

02Why is an FDA-like agency being considered for AI?

An FDA-like agency is being considered for AI to mitigate potential risks, ensure responsible development, and provide a proactive, centralised approach to AI governance amidst rapid technological advancements and societal implications.

03How might this proposal impact businesses and AI practitioners?

This proposal suggests that AI development and deployment will likely face stringent federal standards, affecting product design and market entry, while also potentially offering regulatory clarity but introducing new compliance requirements and innovation hurdles.

04What is the Institute's perspective on an FDA-style AI agency?

The Institute believes that applying an FDA-style model to AI may be misdirected due to AI's adaptive and opaque nature, which differs from physical goods. They advocate for agile, adaptive regulatory frameworks focusing on continuous auditing, explainability, and impact assessments rather than rigid, one-time approvals.

Put the intelligence into practice

Your next move

Turn responsible AI understanding into a recognised standard of capability.
For professionalsGet certified as an individualFor teams and enterprisesAccredit your organisation

Continue the brief

AI Safety

AI Safety: Nvidia CEO Calls for China Collaboration

Nvidia CEO Jensen Huang advocates for international cooperation, specifically with China, on AI safety, emphasising that AI's global nature necessitates joint efforts to ensure responsible development and deployment.

16 October 2026 2 min read