The Methodological and Institutional Biases in Economics: Sins of Omission and the Curse of the Top Five Journals
Summary
The podcast critically examines the hierarchical nature and methodological limitations within the field of economics, arguing that these factors lead to significant "sins of omission" in research. The speakers contend that economics' prevalent definition of scientific method, which emphasizes simple models and statistical analysis akin to physics, inadvertently steers attention towards easily quantifiable problems while neglecting complex, difficult-to-model issues. This narrow focus, characterized by a priori assumptions and a restricted view of human motivation, is highlighted as a primary reason for the field's failure to predict major events like the 2008 financial crisis, which involved intricate, multi-faceted interactions beyond single-deviation analyses.
A key distinction is drawn between the standard economic view of motivation (utility/profit maximization) and a broader sociological perspective that incorporates the "stories" people tell themselves, often uncovered through ethnographic research. The discussion also delves into the "core and periphery" model of macroeconomics, where DSGE models form the core, and peripheral research, while exploring deviations, does so in isolation, thus failing to capture the systemic interactions crucial to understanding financial instability. The concept of "Sippies"—strategically positioned financial intermediaries taking on hidden tail risks—is introduced as an example of forensic information that falls outside the permissible range of traditional economic research.
The podcast further exposes the "curse of the top five" journals (American Economic Review, Econometrica, Journal of Political Economy, Quarterly Journal of Economics, Review of Economic Studies), arguing that their disproportionate influence on tenure and promotion decisions creates a powerful incentive for conformity. This system, driven by citation counts and a desire for specialization, leads to a bottleneck in publication, discourages creative or unconventional research, and fosters an "old boys network" where editors may favor colleagues or former students. The speakers present empirical evidence demonstrating that many highly cited and influential works, including those by Nobel laureates, are published outside these top-tier journals, revealing an internal inconsistency in the profession's own metrics.
Ultimately, the discussion calls for a fundamental re-evaluation of economic research methodology and academic incentive structures. It advocates for expanding the domain of permissible economic inquiry, embracing a more forensic view of evidence, and valuing diverse approaches beyond the current narrow confines. The implications are profound, suggesting that the existing system stifles innovation, perpetuates biases, and hinders the profession's ability to effectively address complex global challenges, such as understanding non-Western economies or predicting future financial crises, by discouraging research on vital but methodologically challenging topics.
Key Quotes
"in 2008 this process that was supposed to certify things as scientifically sound... completely failed are nearly so"
"economists have an almost universal view that simple modeling and statistical analysis are the full domain of economic research"
"what motivates people are the stories they're the stories that people are telling themselves at the time they are making their decisions"
"the financial crisis involved interactions that would not be one at a time deviations so a model that incorporated such deviations was therefore outside the range of permissible research"
"managers who take on tail risks and they do so for four reasons first to artificially increase their current reported profits to gamble for resurrection after an adverse shock because they have made miscalculations and because they're too optimistic"
"scientists desire for conformity will result in specialization of scientific belief"
"the rigidity of belief regarding what constitutes research in economics as articulated in the mul Itasca model is predicted strongly it's the equilibrium outcome it's the equilibrium outcome of the system of promotion and publication in the econ in the academic profession"
"the danger is that when a publication is evaluated by the citation factor it's not really evaluating the article itself but it's company the company it keeps"
"what we're doing is letting specialists who themselves primarily published in field journals are deferring to generalist journals to screen the quality of their colleagues"
"many scholars working outside the United States want to publish in American journals they see American topics so I'll get frequently the topic I can't work on China even though people are fascinated with us going on in China because I can't get a q je a JP e and a e ER"
Concepts
Themes
- Critique of economic methodology
- Institutional biases in academia
- Incentives and disincentives in research
- The role of "stories" vs. models in understanding human behavior
- Predictive failure of economic models
- Conformity vs. creativity in scientific progress
- The impact of publication metrics on career progression
- Centralization of power in academic publishing
Related to:
Economics Insights
Market Implications
- Failure to predict financial crises, misallocation of capital due to unaddressed tail risks, distorted research priorities leading to suboptimal policy advice.
Key Concepts Discussed
- Sins of omission
- Curse of the top five journals
- DSGE models
- Sippies
- Multitasking problem
- Conformity bias in science
- Gatekeeping in academia
Data Cited Or Analyzed
- Citation counts (RePEc), tenure decisions and time to tenure at American universities, distribution of log citations for articles, publication rates by author affiliation, journal submission/acceptance rates.
Practical Recommendations Implied
- Expand the domain of economic research, re-evaluate academic promotion and publication criteria, encourage broader methodologies and interdisciplinary work, reduce reliance on journal rankings for tenure, support alternative research institutions like INET.
Risks To Profession
- Stifling of creativity, perpetuation of biases, inefficient gatekeeping, 'incestuous' publication patterns, neglect of important research topics (e.g., non-Western data), inability to address complex real-world problems.
Key Figures Mentioned
- Raghu Rajan
- Ricardo Caballero
- Reinhart
- Rogoff
- Brock
- Durlauf
- Pascal Messiah
- David Card
- Della Vigna
- Richard Thaler
- Al Roth
- Spence
- Fogel
- Vernon Smith
- An Swindler
- Mankiw
Institutions Mentioned
- LSE
- University of Chicago
- Harvard
- MIT
- INET
Similar Episodes
The Genesis and Evolution of the Scientific Revolution: From Dante's Vision to Newton's Laws
Challenging Scientific Paradigms: A Vibrational Theory of Reality and the Nature of Consciousness
Margaret Heffernan on Embracing Uncertainty and Preparedness in an Uncharted Future