Why Simple Scorecards Don’t Work
When politicians trumpet the success of a new trade agreement, they typically reach for straightforward metrics: job creation numbers, export growth percentages, or GDP bumps. The problem is that international trade operates within a complex web of variables that make clean attribution nearly impossible. A surge in exports might coincide with a trade deal’s implementation, but it could equally result from currency fluctuations, domestic policy changes, or shifts in global demand that have nothing to do with tariff reductions.
Consider NAFTA, which has been simultaneously credited with creating millions of jobs and blamed for devastating manufacturing communities. Both claims contain elements of truth, but neither captures the full picture. NAFTA’s impact varied dramatically by sector, region, and time period. Agricultural exports from the United States to Mexico increased substantially, benefiting farmers in certain states. Meanwhile, manufacturing jobs migrated to Mexico, particularly affecting communities in the Midwest. The net effect depends entirely on how you weight these different outcomes and over what timeframe you measure them.
This complexity explains why economists often arrive at vastly different conclusions when evaluating the same trade agreement. The methodology matters enormously. Do you measure gross job creation or net job displacement? Do you account for jobs that would have been lost to automation regardless of trade policy? Do you factor in lower consumer prices as a benefit that partially offsets job losses? Each choice shapes the analysis in ways that can flip the overall assessment from positive to negative.
The Employment Attribution Problem
Trade agreements create winners and losers, but determining which jobs were actually gained or lost because of specific trade provisions requires sophisticated economic modeling that most public debates ignore entirely. When a factory closes and moves production overseas, the trade deal often gets blamed. When a new export facility opens, the trade deal gets credit. Yet both events might have occurred regardless of trade policy due to broader economic forces.
The USMCA provides a useful case study in this attribution challenge. Supporters point to increased agricultural exports and automotive investment as evidence of success. Critics highlight continued manufacturing job losses and wage stagnation in certain sectors. Both sides marshal statistics that appear convincing in isolation but tell incomplete stories when examined more carefully.
Labor economists have developed increasingly sophisticated tools to isolate trade effects from other variables, but these analyses typically take years to complete and often yield modest, nuanced conclusions that resist easy political packaging. A comprehensive study might find that a trade deal increased employment in certain industries by 2-3% while decreasing it in others by a similar margin, with significant regional variation. Such findings rarely generate headlines, but they provide a more accurate foundation for policy evaluation.
Beyond Jobs: The Broader Economic Picture
Employment effects represent only one dimension of trade agreement impact. These deals reshape entire economic structures in ways that defy simple measurement. Trade agreements can accelerate technological adoption, alter supply chain configurations, and shift the competitive dynamics within industries. A trade deal might eliminate jobs in one sector while spurring innovation and productivity gains that create different types of employment elsewhere in the economy.
The TPP, despite never being ratified by the United States, illustrates how trade agreements can influence economic behavior even before implementation. Companies began restructuring their operations and supply chains in anticipation of the agreement’s provisions. When the United States withdrew, these decisions had to be reconsidered, creating costs and disruptions that don’t appear in traditional impact assessments.
Consumer welfare effects add another layer of complexity. Trade agreements typically reduce prices for imported goods, providing benefits to consumers that may outweigh job losses in import-competing industries when measured in aggregate. However, these benefits are diffuse and often invisible, while job losses are concentrated and highly visible. This asymmetry creates political dynamics that don’t necessarily align with overall economic welfare calculations.
Currency effects further complicate the picture. Trade agreements can influence exchange rates, which affect the competitiveness of all traded goods regardless of tariff levels. A trade deal that succeeds in boosting exports might simultaneously make imports more attractive by strengthening the domestic currency, offsetting some of the intended benefits for domestic producers.
The Time Horizon Challenge
Trade agreements produce effects that unfold over different timeframes, making evaluation timing important to any assessment. Short-term disruptions might give way to long-term benefits, or initial gains might prove temporary as competitors adapt to new market conditions. The Canada-United States Free Trade Agreement, implemented in 1989, initially generated significant controversy and measurable job losses in certain Canadian industries. Decades later, most economists view it as beneficial for both countries, but this positive assessment required years of adjustment and economic restructuring.
Political pressure for quick results often conflicts with the longer timeframes required for meaningful trade agreement evaluation. Politicians need to demonstrate success within electoral cycles, while economic adjustments to new trade rules can take a generation to fully materialize. This mismatch creates incentives to cherry-pick short-term data points rather than waiting for comprehensive long-term analysis.
Dynamic effects compound this timing challenge. Trade agreements don’t just change existing trade flows — they can stimulate entirely new types of economic activity that weren’t anticipated when the deals were negotiated. The internet and digital services trade, for example, have created new categories of international commerce that older trade agreements never contemplated but nonetheless affect through their general provisions and dispute resolution mechanisms.
Evidence-Based Evaluation Standards
Rigorous trade agreement assessment requires acknowledging uncertainty and embracing analytical humility. The most credible evaluations employ multiple methodologies, examine various timeframes, and explicitly address their limitations. They distinguish between correlation and causation, account for counterfactual scenarios, and acknowledge that different stakeholders may reasonably reach different conclusions based on how they weight various outcomes.
Professional economic analysis increasingly emphasizes distributional effects alongside aggregate welfare measures. A trade agreement might generate net economic benefits while imposing concentrated costs on specific communities or demographic groups. Understanding these distributional consequences is essential for comprehensive policy evaluation and for designing complementary policies to address negative effects.
The most honest assessment of any trade agreement’s success acknowledges that the answer depends fundamentally on the criteria used for evaluation and the values placed on different outcomes. There’s no neutral, objective way to weigh job losses in one sector against consumer benefits or export gains in another. These are ultimately political choices that require democratic deliberation rather than technocratic calculation.
What specific aspects of trade agreement evaluation do you find most challenging to assess? The relationship between economic analysis and political reality in this area offers rich territory for further exploration, particularly as new agreements grapple with digital trade, environmental standards, and labor protections that weren’t central to earlier trade negotiations.