US requiring new AI safeguards for government use, transparency

The White House said on Thursday it is requiring federal agencies using artificial intelligence (AI) to adopt "concrete safeguards" by December 1 to protect Americans’ rights and ensure safety as the government expands AI use in a wide range of applications.

The Office of Management and Budget issued a directive to federal agencies to monitor, assess and test AI’s impacts "on the public, mitigate the risks of algorithmic discrimination, and provide the public with transparency into how the government uses AI". Agencies must also conduct risk assessments and set operational and governance metrics.

The White House said agencies "will be required to implement concrete safeguards when using AI in a way that could impact Americans' rights or safety" including detailed public disclosures so the public knows how and when artificial intelligence is being used by the government.

President Joe Biden signed an executive order in October invoking the Defense Production Act to require developers of AI systems posing risks to US national security, the economy, public health or safety to share the results of safety tests with the US government before being publicly released.

The White House on Thursday said new safeguards will ensure air travellers can opt out from Transportation Security Administration facial recognition use without delay in screening. When AI is used in federal healthcare to support diagnostics decisions, a human must oversee "the process to verify the tools’ results."

Generative AI — which can create text, photos and videos in response to open-ended prompts — has spurred excitement as well as fears it could lead to job losses, upend elections and potentially overpower humans and catastrophic effects.

The White House is requiring government agencies to release inventories of AI use cases, report metrics about AI use and release government-owned AI code, models and data if it does not pose risks.

The Biden administration cited ongoing federal AI uses, including the Federal Emergency Management Agency employing AI to assess structural hurricane damage, while the Centers for Disease Control and Prevention uses AI to predict spread of disease and detect opioid use. The Federal Aviation Administration is using AI to help "deconflict air traffic in major metropolitan areas to improve travel time".

The White House plans to hire 100 AI professionals to promote the safe use of AI and is requiring federal agencies to designate chief AI officers within 60 days.

In January, the Biden administration proposed requiring US cloud companies to determine whether foreign entities are accessing US data centres to train AI models through "know your customer" rules.