BarbeloPodcast Library
psychacks
psychacks·June 17, 2023

The Limitations of Science: Deconstructing Objectivity and the Value of Know-How

Watch on YouTube

Summary

This episode critically examines the limitations of scientific research, particularly in psychology, arguing that the empirical literature often presents a skewed or manipulated view of reality. The host, Dr. Orion Taraban, explains that most people lack the necessary understanding of statistics, research design, and model biases to properly evaluate studies. He asserts that researchers, influenced by funding interests and publication biases (which favor statistically significant findings), can easily manipulate protocols and models to produce desired outcomes, making the evidence a "show" rather than an objective pursuit of truth.

A central distinction is drawn between what is "factually accurate" and what is "meaningfully true." The episode introduces the concept of "scientism" as a belief system held by those with superficial scientific knowledge, who often mistake descriptions for explanations and blindly trust randomized controlled trials or arguments of authority. In contrast, Dr. Taraban champions "science as know-how" – the practical ability to achieve desired outcomes, even without a formal explanation. He posits that this practical, lived understanding is a higher form of science, exemplified by the difference between understanding aerodynamics and actually building a flying airplane.

From a practical standpoint, the host encourages listeners to adopt an open mind and test claims for themselves, rather than relying solely on published literature or expert authority. He emphasizes that his own advice, shared on the channel and with clients, stems from personal experience and professional expertise gained from "building thousands of airplanes" – observing and guiding people to achieve their desired outcomes. This approach prioritizes what works in practice over what is merely theoretically or statistically validated.

The broader implications suggest a need for greater critical thinking regarding scientific claims and a re-evaluation of what constitutes legitimate scientific knowledge. The episode challenges the uncritical acceptance of empirical data and highlights how practical wisdom, even from unschooled individuals, can offer profound insights into living harmoniously and attending to human necessities – which are presented as the true goals of science. It advocates for a balanced perspective that values both rigorous inquiry and the tangible results of applied knowledge.

Key Quotes

as Mark Twain once said there are three types of Lies there are lies damned lies and statistics
the vast majority of people do not understand how to interpret statistics they do not understand how statistical models function and they do not understand how to evaluate research design
if you understand how to conduct research you can more or less make the evidence come out the way that you want it to
a non-significant finding which might be meaningful and important from the perspective of Truth or the progression of pure science is almost certainly not going to be published in a respectable Journal
a statistically significant difference might not be a meaningful difference to anyone with a head on their shoulders
most of this is taken on faith faith in a scholarship and objectivity that I'm afraid may not be warranted
I'm much less interested in what is factually accurate than what is meaningfully true
the cult of scientism which with which we are all duly familiar at this point this belief system is usually practiced by people who have enough knowledge to know that they know some things but not enough knowledge to know that they know very little
if you can explain it but you can't do it then you have a scientistic understanding if you can do it but you can't explain it then you have a know-how understanding both are forms of science but know-how is higher
the empirical literature is what we call a show
if the plane flies maybe I do have a science to what I'm talking about but hey don't take my word for it try it out for yourself and see whether it works

Concepts

Themes

  • Critique of scientific methodology
  • The nature of truth and knowledge
  • The role of practical experience vs. theoretical understanding
  • Media literacy and critical thinking
  • Bias in research and publication
  • Redefining the purpose of science
  • The limitations of empirical evidence

Related to:

Science Insights

Research Critiques

  • statistical misinterpretation
  • research design flaws
  • funding bias
  • publication bias for significant findings
  • lack of critical evaluation by readers

Mechanisms Explained

  • how researchers can manipulate findings
  • the difference between statistical and meaningful significance
  • the distinction between scientism and know-how

Actionable Advice

  • try it out for yourself
  • keep an open mind
  • look for answers where you haven't already looked

Conceptual Distinctions

  • factually accurate vs. meaningfully true
  • scientism vs. know-how
  • explaining vs. doing

Academic Environment Insights

  • grad students gloss over methods/results
  • difficulty of interpreting methods/results sections
  • incentives for significant findings

Similar Episodes