Information Nutrition: What Is Epistemic Hygiene?
Your "epistemic state" is the sum total of beliefs, concepts, and assumptions you hold about reality. Just as eating unwholesome junk food degrades your physical health, consuming unverified claims, rage-bait headlines, and unchecked AI outputs degrades your epistemic health—your capacity to perceive reality accurately and make sound decisions.
Epistemic hygiene means treating the information you allow into your mind with the same care and scrutiny you apply to the food you put into your body:
- Information Pollution: Unchecked algorithmic feeds flood your nervous system with sensationalized claims designed to trigger anger or confirmation bias.
- AI Hallucinations: Large Language Models (LLMs) do not "know" facts the way humans do; they are statistical prediction engines optimized to generate plausible-sounding text. When an AI generates a fake citation, a made-up historical date, or a non-existent legal case, it is committing an AI hallucination.
- Harry Frankfurt's Definition of Bullshit: In his classic philosophical essay On Bullshit (first published in 1986, as a short book in 2005), Princeton philosopher Harry Frankfurt drew a crucial distinction:
- A Liar knows the truth and deliberately tries to hide it.
- A Bullshitter does not care whether what they are saying is true or false; they care only about generating an impression or persuading the audience.
- Some philosophers (Michael Townsen Hicks, James Humphries and Joe Slater, in a 2024 paper titled "ChatGPT is bullshit") argue that AI text models fit Frankfurt's definition: they generate plausible-sounding language with no built-in concern for whether it is true.
AI models do not optimize for factual truth; they optimize for statistical plausibility. Verifying primary facts remains a uniquely human responsibility.
The Fact-Checker's Protocol: Lateral Reading
How do professional fact-checkers verify claims quickly when evaluating unknown websites or AI-generated text?
Stanford University researchers (Sam Wineburg and Sarah McGrew, 2017) watched 10 professional fact-checkers, 10 PhD historians and 25 Stanford undergraduates evaluate unfamiliar websites. The students and historians mostly engaged in Vertical Reading—reading down the page, examining the website's "About Us" page, and judging the site by its design and the text itself. They were often fooled by easily faked signals such as an official-looking logo, a polished design or a respectable-sounding domain name.
Professional fact-checkers engaged in Lateral Reading:
1. After only a quick scan of an unfamiliar site or claim, they left the site.
2. They opened multiple new browser tabs to search for independent, authoritative sources about the author or organization making the claim.
3. They asked: "Who is behind this claim? What are their funding sources, credentials, and conflicts of interest?"
Two ways to check a source:
| Vertical reading | Lateral reading | |
|---|---|---|
| Verdict | easily fooled | the fact-checker rule |
| First move | stay on the page | leave the site after a quick scan |
| Next | read 'About Us' | open new tabs |
| Judge by | the design | research on the author |
Carl Sagan's Baloney Detection Kit
In his 1995 book The Demon-Haunted World, astronomer Carl Sagan set out a nine-point "baloney detection kit" for critical thinking. Six of its tools:
- Demand Independent Confirmation: Wherever possible, seek independent verification of facts across multiple distinct sources.
- Encourage Substantive Debate: Welcome knowledgeable proponents of all points of view to debate the evidence openly.
- Beware Arguments from Authority: Authorities make mistakes. "Because Professor X or Politician Y said so" is not proof; evidence is proof.
- Quantify Whenever Possible: Look for specific, measurable numbers and data rather than vague qualitative adjectives ("many people say" or "a massive increase").
- Occam's Razor: When presented with two competing explanations for a phenomenon, choose the explanation that requires the fewest unproven assumptions.
- Falsifiability: Ask if a hypothesis can, at least in principle, be tested and proven wrong. As Sagan put it, propositions that are untestable and unfalsifiable "are not worth much."
Steel-Manning Opposing Views
The ultimate test of critical thinking is whether you can Steel-Man an argument you disagree with.
Straw-Manning is building a weak, cartoonish version of an opponent's argument so you can easily knock it down. Steel-Manning is constructing the strongest, most intelligent, and most compelling version of an opponent's argument.
Before you critique an idea, force yourself to state the opposing argument so accurately and fairly that your opponent would thank you for it. The philosopher Daniel Dennett, drawing on the game theorist Anatol Rapoport, put the test this way: re-express your target's position "so clearly, vividly, and fairly that your target says, 'Thanks, I wish I'd thought of putting it that way.'" Only then have you earned the right to critique it.
Takeaways
In the AI era, information is infinite, but truth and verification are scarce. Epistemic hygiene involves treating information intake with care, recognizing that AI text models optimize for plausible tone rather than factual truth. Professional fact-checking requires "Lateral Reading"—leaving claims immediately to research the source across independent tabs. By applying Sagan's Baloney Detection Kit and steel-manning opposing views, you protect your mind from algorithmic manipulation.
Action step: Pick one surprising claim or news headline you encountered today, open two new browser tabs, and practice "Lateral Reading" by researching who made the claim and whether independent primary sources verify it.
Sources & Further Reading
Sources
- Harry G. Frankfurt's On Bullshit (Princeton University Press, 2005). Carl Sagan's The Demon-Haunted World: Science as a Candle in the Dark (1995). Sam Wineburg and Sarah McGrew, Lateral Reading: Reading Less and Learning More When Evaluating Digital Information (Stanford History Education Group Working Paper 2017-A1). Michael Townsen Hicks, James Humphries and Joe Slater, "ChatGPT is bullshit" (Ethics and Information Technology, 2024). Daniel C. Dennett, Intuition Pumps and Other Tools for Thinking (2013), for Rapoport's rules.
Go Deeper
- 📘 On Bullshit — Harry G. Frankfurt (a brilliant, 60-page philosophical masterpiece on the nature of ungrounded speech)
- 📘 The Demon-Haunted World — Carl Sagan (the classic manifesto for scientific skepticism and critical thinking)
- 🌐 Stanford History Education Group — Civic Online Reasoning
- 🌐 Related piece in this library: The Biases That Fool Everyone
For Your Vocabulary
Epistemic Hygiene (the practice of carefully scrutinizing and filtering information sources to maintain an accurate understanding of reality) · Lateral Reading (verifying claims by leaving the original page immediately to research sources across independent tabs) · AI Hallucination (when a Large Language Model generates false facts, quotes, or citations while maintaining a confident tone) · On Bullshit (Harry Frankfurt's definition of speech generated without regard for truth) · Steel-Manning (constructing the strongest, most intelligent version of an opponent's argument before critiquing it) · Straw-Manning (creating a weak or distorted caricature of an opponent's argument to knock it down easily) · Occam's Razor (the problem-solving principle that the simplest explanation with the fewest assumptions is usually preferred) · Falsifiability (the capacity of a statement or hypothesis to be proven wrong through observation or experiment)