The federal government is currently investing hundreds of billions of dollars to help regional economies rebuild in the wake of the COVID-19 pandemic. In addition to the American Rescue Plan Act’s $350 billion in flexible funds for cities, counties, states, and tribal governments, the Infrastructure Investment and Jobs Act and CHIPS and Science Act add another $80 billion in place-based industrial competitiveness programs. And all this public funding will leverage even greater sums of private capital investment.

This is welcome news for communities in need of investments, jobs, and income growth to address long-standing economic and racial inequities. Yet as government, business, and nonprofit leaders form regional coalitions to implement federally financed recovery strategies or compete for competitive federal grants, they must address several questions. How can these leaders develop a shared and specific definition of their biggest economic challenges and inequities? How can they address those challenges using this infusion of resources to make their region more prosperous and equitable? And how can they define a realistic expectation of impact so they can measure progress and shift strategy if needed?

Regional economic dashboards have become a ubiquitous tool to try to answer these questions. Many economic development organizations, community groups, philanthropies, civic organizations, and higher education institutions work together to compile key economic performance indicators to better understand their region’s economic trajectory—often operationalizing those indicators through online dashboards. These are time-consuming projects that involve extensive discussion and debate about which indicators to include and how to organize them. Some leaders dedicate their time to this work because they see metrics as a way to bring strategy and accountability to the messy, nonlinear, multisystem work that happens under the heading of “economic development.” Others do so because dashboards can help cement a region’s commitment to equity by formally elevating measures of economic inclusion to a position alongside more typical measures of economic growth.

Whatever their motivation, leaders believe this time is well spent because they expect metrics to not only serve as a statement of values, but as a tool that helps organizations and regions act and invest differently. They believe that—equipped with a set of metrics that articulate the region’s goals—the many individual organizations that make up a regional economic development system can make hard, strategic choices about which problems to focus on, coordinate on implementation, and fluidly adapt as the dashboard reveals changing conditions.

The reality, however, is that dashboards typically fail to fulfill this function. This report argues that regional leaders—especially in an era of new investment into their communities—need a more robust economic performance management system to not only monitor the right economic trends, but also to make strategic decisions about where and how to invest. We draw on a recent collaboration with the McKnight Foundation to illustrate how dashboards could evolve to be more robust strategy development and performance management tools. We conclude that modernized systems should be developed based on: 1) a shared theory of what drives inclusive growth; 2) the selection of good data with the right context; and 3) a set of principles that guide strategic decisions once key gaps have been identified.

WHY DASHBOARDS FAIL AS STRATEGY TOOLS

Dashboards are valuable tools in that they can organize stakeholders around a shared vision for what matters to a thriving, inclusive local economy. These stakeholders can then monitor progress over time, setting the stage for ongoing discussions about how regional strategy needs to respond to changing conditions. Yet most dashboards ultimately fail to meaningfully shape strategic decisions because they are not designed to help organizations navigate the area where most strategy happens: what the McKnight Foundation’s Director of Learning Neeraj Mehta calls the “messy middle” between high-level goals and day-to-day tactics. (Disclosure: The McKnight Foundation funded a collaboration with Brookings Metro that generated this analysis.)

Some of the shortcomings of dashboards reflect the fact that there is no data available to measure many of the trends that are fundamental to inclusive growth strategies. As we describe later, it is not possible to directly measure key outcomes such as the racial wealth gap at the local level. And in all but the very largest metro areas, it is not possible to reliably measure trends in key areas of strategic focus, such as business ownership by sector and race. But we also believe that as strategy-setting tools, most dashboards fall short due to three design flaws that regional leaders can address:

1. It is not made clear which indicators within a dashboard represent desired ultimate outcomes and which are intermediate outcomes. Desired ultimate outcomes are almost always chosen because they are complex and can only be achieved if many systems change how they operate in fundamental ways. For example, the racial wealth gap is increasingly central to many regional initiatives not only because wealth inequities lie at the heart of many economic challenges that households of color face, but also because wealth is a much more multifaceted indicator than income. Generating wealth requires sustained increases in income over many years, relatively low increases in cost of living, and opportunities to acquire valuable assets such as real estate or businesses. These complex indicators that require sustained improvements across many systems are valuable in that they keep leaders focused on long-term, population-level outcomes. They prevent complacency that can sometimes set in after leaders see short-term improvements based on the economic cycle or small programmatic outcomes. But by the same token, such metrics create challenges in that they are unlikely to change quickly in response to a regional initiative, therefore making it difficult to track whether a strategy is working or focused on the right levers. (And, as we discuss later, the wealth gap in particular is not as easily measurable as is often assumed.)

Intermediate outcomes, on the other hand, are less complex and comprehensive—they merely indicate whether the conditions for progress on the desired ultimate outcome are improving. But by virtue of their relative simplicity, they are more sensitive to changes in policy and practice, therefore helping regional leaders understand whether strategies are beginning to work. College degree attainment is an example: It is clearly an important factor in wealth creation and more sensitive in the medium term to changes in public policy or nonprofit investments, but cannot alone be treated as a reliable sign that the racial wealth gap is closing. In many regions, fewer than one in three Black workers with a two-year degree earn a family-sustaining wage, so clearly, increases in educational attainment cannot be assumed to translate directly to a shrinking wealth gap.

Often, regions organize their metrics by theme (growth, talent, innovation, etc.), but rarely are metrics organized along this “ultimate” versus “intermediate” axis. This design flaw can hinder strategy in two ways. One way is that organizations unintentionally focus too much on improving what should just be considered an intermediate indicator, without questioning whether this is translating to progress toward the ultimate outcome. Conversely, organizations can also go astray by focusing too much on an ultimate outcome indicator not responding to interventions, and then prematurely abandon promising strategies.

2. The intermediate indicators within a dashboard do not map to the systems that determine whether regions reach the ultimate outcome. A “system” is a group of organizations or policies that seek to affect the economy in a similar way (the economic development system, workforce development system, etc.). For indicators to inform strategy, they can’t just point to where the economy is worsening (which only increases urgency without providing direction) or even point to a specific bundle of problems that are worsening (which leaves people to draw different conclusions about the cause). Indicators need to help people pinpoint which part of a system is breaking down and therefore where investment would be most impactful.

For example, imagine a dashboard that identifies higher median incomes for the Black population as an ultimate outcome. For that identification to inform strategy, the dashboard then needs to help organizations assess the performance of the systems that contribute to higher incomes. If that topline number is stagnant or declining in a given year, organizations need to be able to ask: Are incomes stagnating because 1) there are not enough jobs; 2) there are not enough jobs that provide family-sustaining wages in particular; 3) Black educational attainment rates are low, so good jobs are inaccessible; or 4) employer hiring practices are biased, perpetuating inequities even when plenty of good jobs are available and educational attainment is not a factor. As described later, each of these outcomes is the focus of a somewhat distinct system.

While this is a simple diagnostic process, it is a valuable starting point for strategy development. But most dashboards do not enable this type of systems thinking because—to use the example above—they may contain three overlapping indicators related to the third point, one related to the first point, and none related to the second or fourth points.

3. For either ultimate or intermediate outcomes, dashboards do not clarify what amount of progress is achievable. Most dashboards present a single number for each indicator that will hopefully improve over the following year. But to make strategic decisions and refine them over time, leaders need much more information than whether there was some improvement (absolute or relative) in the previous period. They need to know how far the region is from some realistic, medium-term benchmark. Take unemployment, for example: It is generally accepted that when unemployment rates are around 3%, an economy is at full employment and therefore attention should be turned toward inclusive growth challenges other than a lack of jobs (such as improving job quality or employer practices). But most regional leaders do not have a similar intuition for where the benchmark should be or what constitutes meaningful progress on other indicators. Three main strategic problems arise in the absence of this data.

• • Imprecise strategy: People might identify the wrong problems as the most urgent—for example, how should users know if a 1 percentage point increase educational attainment from the previous year is meaningful progress or a flashing red light? It could be meaningful progress if the region is already among the highest-performing nationally and incremental gains will naturally be increasingly difficult. On the other hand, a 1 percentage point increase could be interpreted as a failure if the region is far from the frontier and could be making big leaps by doing the basics right. Some dashboards provide context by including peer comparisons, but that is different from defining what the equivalent of “full employment” is for any given indicator. Without that benchmark, it is difficult to identify where investments can have the biggest impact.
  • Tension between organizations: The failure to illustrate what is achievable in the medium term on indicators can erode trust between partners that share a goal but have different assumptions about what constitutes meaningful progress. If one organization believes that unemployment rates can and should be close to 0%, it may question the commitment of an organization that appears satisfied with incremental improvements. And vice versa: An organization that believes that 3% unemployment is the ceiling for any region will celebrate a drop from 3.3% to 3.1%, and come to distrust organizations that are too idealistic to recognize this as meaningful progress.
  • • • Erratic strategy: A room full of leaders can agree that a given indicator is important to improve, but half may expect to see the gap closed in five years while the other half may hope just to not let the status quo worsen (possibly because they believe that there are major structural headwinds at play or macroeconomic conditions are likely to deteriorate). This can lead to strategies being abandoned early—not because they aren’t effective, but because leaders do not understand how much any strategy can be expected to improve the situation in five to 10 years. Strategy requires knowing not just where gaps are biggest, but where the most progress is possible.

    Brookings Metro has previously explored regional economic metrics and dashboards (including identifying some of these gaps), but we had not yet tried to design a solution to these challenges until we partnered with the McKnight Foundation’s Vibrant and Equitable Communities team. The team wanted to evolve what was already a sound Data Index into a tool to navigate strategic tradeoffs and choices. Importantly, given the limitations of available data, this quantitative tool is just one component of the team’s strategic learning work. It will complement other approaches, including learning directly with and from the experiences of their grantees, partners, and communities where they work.

  • Below, we explain how we worked with the team to transform a bundle of indicators into a tool for strategy creation and refinement, and how we think the team will apply it in their work. Though we developed this model with and for one team within one organization, that team serves as a microcosm of a regional coalition, in that it works on issues ranging from job quality to housing to democratic participation. Therefore, we believe this model is just as useful as a tool for multiorganization strategy development.

    HOW THE DATA INDEX WAS CONSTRUCTED

    The raw material for the Data Index was a set of indicators drawn from a variety of resources—including the Center for Economic Inclusion’s Indicators for an Inclusive Regional Economy and Minnesota Compass—that the McKnight team had determined were generally aligned with their ultimate goal (closing the racial wealth gap) and change-making pathways (the set of systems that the team sought to influence in service of that goal: economic mobility, fair and just housing, democratic participation, and community wealth). In other words, we began with the same raw material that many regions have in the form of existing dashboards. Here is how we recommend transforming this raw material into a strategy tool.

  • Distinguish ultimate goals from intermediate outcomes

    The McKnight team’s ultimate goal was closing Minnesota’s racial wealth gap. But the wealth gap is not directly measurable by race at the local level. This is because wealth is an accumulation of many things: income from wages, homeownership, and ownership of other assets such as businesses, stocks, and inheritances. Wealth could even be measured more abstractly in the context of mental and physical health; these are all contributors to the overall wealth of people. There is no single, comprehensive measure of wealth to elevate as the key indicator for the ultimate goal of closing the racial wealth gap.

    Therefore, we had to decide which set of indirect indicators could—taken together—best capture progress toward closing the racial wealth gap. We chose three: the median household income gap (which includes income from sources such as rental properties and trusts along with wages and salaries), the business ownership gap, and the homeownership gap. These are imperfect proxies, and only focused on monetary wealth—but they are tracked with regularity and granularity (by race and geography), have relatively low margins of error, and reflect the main ways that people accumulate wealth.

    These three indicators were placed in a distinct category within the Data Index, making clear that they were in the team’s “sphere of impact” (population-level changes that might be expected to change over a 10-year period) but not its “sphere of influence” (systems that the team can influence with meaningful changes expected to emerge in five years or less). By distinguishing these three indicators as representing the ultimate outcome, the group not only further solidified their shared purpose but also clarified (for internal and external audiences) that these indicators are especially complex and shouldn’t be expected to respond to the team’s actions in the same way that other indicators might.

  • Identify and organize sets of key intermediate outcomes that relate to systems that need to change

    Here is where “theory” is the driver of strategy as much as data. As discussed above, intermediate indicators need to map to the specific systems that contribute to improvement on the ultimate outcome. The McKnight team’s theory is that it can shrink the racial wealth gap by working through four pathways: accelerating economic mobility, providing fair and just housing, building community wealth, and enabling democratic participation. Each pathway implicates multiple systems, which are somewhat discrete groups of organizations working toward a broadly shared goal (systems also include the policies related to the work of these organizations).

  • Please continue to read the entire article :
  • Link :https://www.brookings.edu/research/how-local-leaders-can-upgrade-their-regional-economic-dashboards-for-a-new-era-of-place-based-policymaking/