Artificial Intelligence: Agencies Have Begun Implementation but Need to Complete Key Requirements
Fast Facts
Artificial intelligence is rapidly changing the world and could improve government operations. For example, federal agencies can use AI to analyze drone photos and large datasets. But safeguards are needed to manage AI risks.
Federal law and guidance have several requirements for agencies implementing AI, but they haven't all been met. For example, there's no government-wide guidance on how agencies should acquire and use AI. Without such guidance, agencies can't consistently manage AI. And until all requirements are met, agencies can't effectively address AI risks and benefits.
Our 35 recommendations address these issues and more.
Highlights
What GAO Found
Twenty of 23 agencies reported about 1,200 current and planned artificial intelligence (AI) use cases—specific challenges or opportunities that AI may solve. Three agencies reported not having uses for AI. Agency reported uses included analyzing data from cameras and radar to identify border activities, analyzing photographs from drones, and targeting of scientific specimens for planetary rovers. The National Aeronautics and Space Administration (NASA) and the Department of Commerce (Commerce) reported the highest number of AI use cases (see figure).
Agency Reported AI Use Cases in Fiscal Year 2022
Most of the reported AI use cases were in the planning phase and not yet in production (i.e., currently used) (see figure). In about 200 instances, agencies reported that they were currently using AI.
Agency Reported Artificial Intelligence (AI) Use Case Lifecycle Stage, as of Fiscal Year 2022
a“Other” includes life cycle stage responses not included in the 2021 Guidance for Creating Agency Inventories of Artificial Intelligence Use Cases, such as “research and design” and “exploratory.”
GAO's analysis of agencies' inventories of use cases identified instances of incomplete and inaccurate data. Specifically, five agencies provided comprehensive information for each of their reported use cases while the other 15 had instances of incomplete and inaccurate data. For example, some inventories did not include required data elements, such as the AI life cycle stage or an indication of whether an AI use case was releasable or not. In addition, two inventories included AI uses that were later determined by the agencies to not be AI. Without accurate inventories, the government's management of its use of AI will be hindered by incomplete and inaccurate data.
Federal agencies have taken initial steps to comply with AI requirements in executive orders and federal law; however, more work remains to fully implement these.
- Commerce and the General Services Administration (GSA) fully implemented selected requirements. Specifically, Commerce created a plan to develop AI technical standards and GSA established the AI Center of Excellence.
- The Offices of Management and Budget (OMB) and Personnel Management (OPM) did not fully implement selected requirements. OMB has not yet developed guidance for the acquisition and use of AI. OPM has not yet established or updated an occupational category for those employees performing AI work.
- The Office of Science and Technology Policy (OSTP) did not communicate its designation of which agencies were expected to fulfill specific AI requirements.
- Ten of 23 agencies implemented all AI requirements specific to their agencies, 12 implemented some but not all, and one was exempt from the requirements. These requirements included preparing an inventory on the use of AI, planning for inventory updates, and planning for AI regulatory authorities.
Addressing these requirements will improve agency identification, development, implementation, and oversight of AI.
Why GAO Did This Study
While there are varying definitions of AI, they generally refer to computing systems that “learn” how to improve their performance. AI has the potential to rapidly change the world and holds substantial promise for improving government operations. However, AI poses risks that can negatively impact individuals, groups, organizations, communities, and society.
The President's fiscal year 2023 budget request included $1.8 billion for nondefense research and development investment in AI. In addition, some agencies are using AI operationally to identify information security threats and facilitate the review of large datasets, among other uses. Given the rapid growth in capabilities and widespread adoption of AI, the federal government should have safeguards to manage AI's complexities, risks, and societal consequences.
In this report, GAO reviewed the implementation of AI at major federal agencies. This report examines (1) federal agency reported current and planned uses of AI, (2) the extent to which federal agencies' AI reporting was comprehensive and accurate, and (3) the extent to which federal agencies have complied with selected federal policy and guidance on AI.
This review focused on agencies with government-wide roles in AI implementation (including OMB and OPM) as well as agencies with individual responsibilities for AI implementation (including 23 of the 24 Chief Financial Officers (CFO) Act of 1990 agencies). The Department of Defense was excluded because GAO had issued recent AI reports on that department.
GAO reviewed the 23 civilian CFO Act agencies' AI inventories and analyzed reported use cases and supporting data. GAO also compared agency reported data to the requirements for developing an AI inventory outlined in federal guidance.
In addition, GAO identified requirements from executive orders, OMB guidance, and a law regarding the implementation of AI. GAO then assessed agencies' implementation of these requirements. GAO also interviewed relevant officials.
Recommendations
GAO is making 35 recommendations to 19 agencies, including OMB, to fully implement federal AI requirements. Specifically, GAO is recommending that:
- Fifteen agencies update their AI use case inventories to include required information and take steps to ensure the data aligns with guidance.
- OMB, OSTP, and OPM implement AI requirements with government-wide implications, such as issuing guidance and establishing or updating an occupational series with AI-related positions.
- Twelve agencies fully implement AI requirements in federal law, policy, and guidance, such as developing a plan for how the agency intends to conduct annual inventory updates; and describing and planning for regulatory authorities on AI.
Of the 19 agencies, ten agencies agreed with their recommendations; three agencies partially agreed with one or more recommendations; four agencies neither agreed nor disagreed; and one agency did not agree with its recommendation. OMB agreed with one recommendation but disagreed with another because it had taken recent action. GAO maintains that the recommendations in the report are warranted.
Recommendations for Executive Action
| Agency Affected | Recommendation | Status |
|---|---|---|
| Office of Management and Budget | 1. The Director of OMB should ensure that the agency issues guidance to federal agencies in accordance with federal law, that is to (a) inform the agencies' policy development related to the acquisition and use of technologies enabled by AI, (b) include identifying responsible AI officials (RAIO), (c) recommend approaches to remove barriers for AI use, (d) identify best practices for addressing discriminatory impact on the basis of any classification protected under federal nondiscrimination laws, and (e) provide a template for agency plans that includes the required contents. (Recommendation 1) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Office of Management and Budget | 2. The Director of OMB should ensure that the agency develops and posts a public roadmap for the agency's policy guidance to better support AI use, and, where appropriate, include a schedule for engaging with the public and timelines for finalizing relevant policy guidance, consistent with EO 13960. (Recommendation 2) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Office of Science and Technology Policy | 3. The Director of the Office of Science and Technology Policy should communicate a list of federal agencies that are required to implement the Regulation of AI Applications memorandum requirements (M-21-06) to inform agencies of their status as implementing agencies with regulatory authorities over AI. (Recommendation 3) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Office of Personnel Management | 4. The Director of OPM should ensure that the agency (a) establishes or updates and improves an existing occupational series with AI-related positions; (b) establishes an estimated number of AI-related positions, by federal agency; and, based on the estimate, (c) prepares a 2-year and 5-year forecast of the number of federal employees in these positions, in accordance with federal law. (Recommendation 4) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Office of Personnel Management | 5. The Director of OPM should ensure that the agency creates an inventory of federal rotational programs and determines how these programs can be used to expand the number of federal employees with AI expertise, consistent with EO 13960. (Recommendation 5) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Office of Personnel Management | 6. The Director of OPM should ensure that the agency issues a report with recommendations for how the programs in the inventory can be used to expand the number of federal employees with AI expertise and shares it with the interagency coordination bodies identified by the Chief Information Officers Council, consistent with EO 13960. (Recommendation 6) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Office of Personnel Management | 7. The Director of OPM should ensure that the agency develops a plan to either achieve consistency with EO 13960 section 5 for each AI application or retires AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 7) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Agriculture | 8. The Secretary of Agriculture should ensure that the department (a) reviews the department's authorities related to applications of AI, and (b) develops and submits to OMB plans to achieve consistency with the Regulation of AI Applications memorandum (M-21-06). (Recommendation 8) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Agriculture | 9. The Secretary of Agriculture should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 9) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Commerce | 10. The Secretary of Commerce should ensure that the department develops a plan to either achieve consistency with EO 13960 section 5 for each AI application or retires AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 10) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Commerce | 11. The Secretary of Commerce should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 11) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Education | 12. The Secretary of Education should ensure that the department develops a plan to either achieve consistency with EO 13960 section 5 for each AI application or retires AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 12) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Energy | 13. The Secretary of Energy should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 13) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Health and Human Services | 14. The Secretary of Health and Human Services should ensure that the department develops a plan to either achieve consistency with EO 13960 section 5 for each AI application or retires AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 14) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Health and Human Services | 15. The Secretary of Health and Human Services should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 15) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Homeland Security | 16. The Secretary of Homeland Security should ensure that the department develops a plan to either achieve consistency with EO 13960 section 5 for each AI application or retires AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 16) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Homeland Security | 17. The Secretary of Homeland Security should ensure that the department (a) reviews the department's authorities related to applications of AI and (b) develops and submits to OMB plans to achieve consistency with the Regulation of AI Applications memorandum (M-21-06). (Recommendation 17) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Homeland Security | 18. The Secretary of Homeland Security should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 18) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of the Interior | 19. The Secretary of the Interior should ensure that the department develops a plan to either achieve consistency with EO 13960 section 5 for each AI application or retires AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 19) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of the Interior | 20. The Secretary of the Interior should ensure that the department (a) reviews the agency's authorities related to applications of AI and (b) develops and submits to OMB plans to achieve consistency with the Regulation of AI Applications memorandum (M-21-06). (Recommendation 20) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of the Interior | 21. The Secretary of the Interior should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 21) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Labor | 22. The Secretary of Labor should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 22) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of State | 23. The Secretary of State should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 23) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Transportation | 24. The Secretary of Transportation should ensure that the department (a) reviews the department's authorities related to applications of AI and (b) develops and submits to OMB plans to achieve consistency with the Regulation of AI Applications memorandum (M-21-06). (Recommendation 24) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Transportation | 25. The Secretary of Transportation should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 25) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of the Treasury | 26. The Secretary of the Treasury should ensure that the department develops a plan to either achieve consistency with EO 13960 section 5 for each AI application or retires AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 26) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of the Treasury | 27. The Secretary of the Treasury should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 27) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Department of Veterans Affairs | 28. The Secretary of Veterans Affairs should ensure that the department updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 28) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Environmental Protection Agency | 29. The Administrator of the Environmental Protection Agency should ensure that the agency fully completes and approves its plan to either achieve consistency with EO 13960 section 5 for each AI application or retires AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 29) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| Environmental Protection Agency | 30. The Administrator of the Environmental Protection Agency should ensure that the agency updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 30) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| General Services Administration | 31. The Administrator of General Services should ensure that the agency develops a plan to either achieve consistency with EO 13960 section 5 for each AI application or retires AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 31) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| General Services Administration | 32. The Administrator of General Services should ensure that the agency updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 32) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| National Aeronautics and Space Administration | 33. The Administrator of the National Aeronautics and Space Administration should ensure that the agency updates and approves the agency's plan to achieve consistency with EO 13960 section 5 for each AI application, to include retiring AI applications found to be developed or used in a manner that is not consistent with the order. (Recommendation 33) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| National Aeronautics and Space Administration | 34. The Administrator of the National Aeronautics and Space Administration should ensure that the agency updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 34) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|
| U.S. Agency for International Development | 35. The Administrator of the U.S. Agency for International Development should ensure that the agency updates its AI use case inventory to include all the required information, at minimum, and takes steps to ensure that the data in the inventory aligns with provided instructions. (Recommendation 35) |
When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
|