The standard debate about policy relevance in academic political science is now familiar. There are, broadly, three sides.
- We should be doing more to engage policymakers with the work that we do.
- We should do our work differently in order to better engage with policymakers.
- It is not our job to care if policymakers engage with our work (and as a result, a lack of policy relevance is not reason to change how we work).
I tend to believe that it’s perfectly reasonable to care that our work is relevant to policy, which leaves the debate (for me) between (1) and (2). The terms of that debate, alas, look depressingly like every other disciplinary disagreement. Are we too quantitative, too theoretical, too abstract, too driven by disciplinary or subdisciplinary incentives to be policy relevant? Replace “be policy relevant” with “train graduate students” or “understand current events” and you’ve just described 95% of our disciplinary debates. The profile of political scientist/former Ambassador to Russia Michael McFaul in the New Yorker is a perfect example.
There does, though, seem to be something of an unstated agreement of how to measure policy relevance: breadth of influence, usually of big ideas. Impressionistic accounts abound about how few Congressional staffers read the APSR. Most systematic data collection efforts look to see if some major theoretical perspectives have been taken up by lots of policymakers (the TRIP Policymaker Survey is one example). The basic presumption is that research is relevant if lots of policymakers know about a Big Theory or a Grand Paradigm. Another version of this, one freed from theories and paradigms, is to see if there is One Important Scholar known by lots of these policymakers.
But what if this is exactly wrong? What if it’s the murky, quirky, small-bore, nuanced analytical work—that does not have Broad Disciplinary Implications, and is not designed to Shape Basic Thinking about Our World—that policymakers want? What if this is the stuff that actually influences how they make decisions?
If that’s the case, you wouldn’t expect to find evidence of policy relevance by searching for awareness of a small number of broad ideas across a large number policymakers. Instead, you might need to find analyst-level policymakers, those doing the basic research that provides the background for major policy choices. These analysis will have narrow ambits, and will focus tightly on specific problems and issue areas. They need not care about whether civilizations are clashing generally, they need to learn if we have evidence that (say) Putin can be dissuaded from invading Ukraine. Lots of middle range theories may matter here, as can basic analysis of current events or survey data using the latest techniques.
It could be the case, in other words, that political science research already is very relevant, we just aren’t measuring it. Indeed, we probably cannot measure this type of policy relevance, not systematically, because we cannot identify with any precision the population being influenced, or the concrete features of that influence. If my own (non-systematic) observations from my own (probably not unique) engagement with the policy world are any indication, academic political science already is very influential, just not in a Big Thinker/Big Idea kind of way, and only for the select few individuals with focused, narrow policy briefs. But this is actual influence, not just awareness of academic debates.
I should note, incidentally, that the TRIP Policymaker Survey already shows that policymakers claim to value area studies. I suspect that the marriage of good area studies with good social science is at the heart of some of the most influential and policy-relevant “small-bore” analytical work. (An example.)
One interesting observation follows. Some readers will remember that I argued recently that we “should not want” to produce superficial (what Dan Murphy called “sweeping, likely wrong“) research that can be taken up on short soundbites. Part of the reason why I think this is because I have a normative belief that policymakers should prioritize valid data, detailed history, and careful causal inference over big paradigms or grand theories. In other words, a world in which just one or two policymakers know exactly why there are internal splits within the People’s Bank of China and how to interpret them may actually be preferable to one in which 85% of policymakers can confirm their awareness of a Realist Theory of the Rise of China. And I bet that is actually how policymakers value things too.
