Evidence-Based Policymaking: Survey Data Identify Opportunities to Strengthen Capacity across Federal Agencies
Fast Facts
Federal decision makers need evidence—such as data and the results of studies—to determine if programs are working as intended and identify potential improvements.
We surveyed about 4,000 federal managers in 2020, and nearly all respondents said they had at least one type of evidence available for their programs. However, many fewer reported that their agencies had sufficient capacity (e.g., staff with skills) to develop and use evidence, or were taking actions to enhance it (e.g., providing training).
We recommended that the Office of Management and Budget work with key partners to use the results of our survey to improve agencies' capacity.
Highlights
What GAO Found
The Foundations for Evidence-Based Policymaking Act of 2018 (Evidence Act) recognizes that federal decision makers need evidence about whether federal programs achieve intended results. According to the Office of Management and Budget (OMB), evidence can include performance information, program evaluations, and other types of data, research, and analysis.
Results from GAO's 2020 survey of federal managers showed that nearly all managers (an estimated 95 percent) reported having at least one type of evidence for their programs. When they had evidence, generally about half to two-thirds reported using it in different decision-making activities, such as when allocating resources.
However, on most questions related to evidence-building capacity, only about one-third to half of managers across the federal government reported that different aspects of capacity (e.g., having staff with relevant skills) were present to a “great” or “very great” extent. Further, when GAO disaggregated these results, it found that reported aspects of capacity varied widely across federal agencies and types of evidence, as illustrated below.
Federal Managers Reporting Presence of Selected Aspects of Evidence-Building Capacity, with the Range of Agencies' Responses
Estimated Percentages Reporting to a “Great” or “Very Great” Extent
OMB, the Office of Personnel Management (OPM), and various interagency councils, such as the Chief Data Officers Council, have taken some actions intended to strengthen federal evidence-building capacity. These include collecting and assessing information from various sources to identify (1) issues to address, and (2) best practices for enhancing capacity to share across agencies.
GAO's survey results could help inform these efforts. For example, survey results could reinforce existing knowledge, or provide new insights, on cross-cutting and agency-specific capacity issues to address. Results could also inform efforts to identify and share promising practices.
Why GAO Did This Study
The Evidence Act created a framework for enhancing the federal government's capacity to build and use evidence in decision-making.
The Evidence Act includes provisions for GAO to review its implementation. This report (1) describes federal managers' reported availability and use of evidence in decision-making activities, and (2) assesses federal managers' reported views on their agencies' capacity for evidence-building activities.
To conduct its work, GAO analyzed results from a survey it administered from July to December 2020 to a stratified random sample of about 4,000 managers at 24 major federal agencies. The survey had a 56 percent response rate. Results can be generalized to the population of managers government-wide and at each agency. GAO also reviewed documents from OMB, OPM, and relevant interagency councils, and interviewed federal officials.
Recommendations
GAO recommends that OMB work with OPM and relevant interagency councils to leverage GAO's survey results as an additional source of information to inform their efforts to enhance federal evidence-building capacity. OMB neither agreed nor disagreed with the recommendation. Two of the surveyed agencies—the Agency for International Development and Small Business Administration—also provided comments related to GAO's survey and evidence-building capacity. The remaining agencies did not comment on the report.
Recommendations for Executive Action
| Agency Affected | Recommendation | Status |
|---|---|---|
| Office of Management and Budget | The Director of the Office of Management and Budget should work with the Office of Personnel Management and relevant interagency councils to leverage our survey results as an additional source of information to inform efforts to enhance evidence-building capacity across the federal government and at individual agencies, as appropriate. This could include using our survey results to help identify promising practices at certain agencies and address challenges at others. Results could also be used to help identify cross-cutting capacity issues affecting multiple agencies, and prioritize actions to address them. (Recommendation 1) |
The Office of Management and Budget (OMB), Office of Personnel Management, the Evaluation Officer Council, and agencies have taken actions that addressed this recommendation. In December 2023, OMB staff told us about actions they and a relevant interagency council had taken. For example, the federal Evaluation Officers Council held meetings in August and September 2021 at which OMB staff and agency Evaluation Officers discussed results from our 2020 survey of federal managers. According to OMB staff, those discussions and other sources of evidence informed subsequent OMB actions aimed at enhancing federal evidence-building capacity. At the September 2021 meeting, officials from several agencies shared how they had leveraged the survey results to help assess their evidence-building activities and capacity. Subsequently, six agencies, including the Office of Personnel Management, cited the survey results in assessments of their own evidence-building capacity published in March and April 2022.
|