Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

The best defense against the influence of crappy science

Roy Benaroch, MD
Physician
March 30, 2016
Share
Tweet
Share

Science, to use the term correctly, isn’t a body of knowledge or a bunch of facts written up on a whiteboard by a crazy-haired professor. It’s a method, or way of figuring out things. Thinking and reading and learning from experts are all important, sure. But real science relies on experimentation.

First, make an educated guess about how something works. Then design an experiment to test your guess. (I’m oversimplifying here. Designing the correct experiment takes genius and inspiration.) Collect your data carefully, and see if you were right. Then do it again, and again.

Ideally, your experiments and conclusions are written up and published in what are called “peer-reviewed journals,” where fair-minded and educated people review your work to make sure it’s up to par. Then it’s published, and other scientists can see what you’ve done. Your experiments can be repeated and tweaked, maybe confirmed or refuted. In time, the body of what’s become known as “accepted scientific knowledge” grows. And voilà, we’ve landed a man on the moon, unlocked the secrets of the atom, or turned HIV into a treatable infection.

Lather, rinse, repeat. Science isn’t fast, and there are a lot of details that have to be done right. Some experiments, just from bad luck, will lead to dead ends or false conclusions. But it’s clear from the pace of modern progress that the scientific method is the best way to figure out how the natural world works.

Still, it’s far from perfect. And a few troubling trends are contributing to a sense that scientists might not always get it right.

These days, anyone can publish anything, either online or in print. I’ve got a few self-published books out there (i.e., I paid to print them), along with books that were professionally edited by a genuine publisher (i.e., they paid me. Suckers!) Most readers would have a hard time telling the difference. Likewise, blogs and websites: Who knows who’s behind most of what’s linked out there? In the past, the quality of scientific publication was guaranteed by a process called “peer-review”, where a new paper was read by several independent experts.

A December 2015 editorial in the New England Journal of Medicine reviews a growing problem with peer-review: hacking. The authors of a new paper often suggest their own peer reviewers, who sometimes turn out to be fake people with fake emails — the “peer review” is actually being done by the authors themselves. Hundreds of articles have been retracted, now that editors know to look for peer review hacking, but it’s likely that thousands more studies already out there are similarly tainted by poor or fraudulent vetting.

But what about the journals themselves? Another huge problem is the proliferation of for-profit, “predatory” journals. They make their money by publishing anything that’s submitted, with zero-to-no editorial review or peer-review. You pay, you play. Some of these are respected journals that have been bought out by shady profiteers. Some are new journals, just made up, that exist only in cyberspace – they have essentially no operating expenses, and publish only online for a fee. Just because you read that something was “published,” doesn’t mean that it’s anything worth reading or paying attention to. Experiments are either entirely faked or done so poorly that they’re worthless — but they’re still published, and unfortunately still reported in the media.

The best defense against the influence of crappy science is for audiences to maintain their skepticism. Something published in a barely-known or predatory journal (yes, there are established lists of these) shouldn’t be turned into headlines or Facebook clickbait. Though everyone is an expert who’s told to “do their own research,” there’s still a place for genuine science journalists and genuine experts to help guide the rest of us through the confusing maze of new information. Don’t believe everything you read, even if it’s couched in sciency-looking terms and looks like it’s been published in a sciency-looking journal.

Science is slow, and far from perfect. But it’s still the best method we’ve got.

Roy Benaroch is a pediatrician who blogs at the Pediatric Insider. He is also the author of A Guide to Getting the Best Health Care for Your Child and the creator of The Great Courses’ Medical School for Everyone: Grand Rounds Cases.

Image credit: Shutterstock.com

Prev

Medical school has killed my soul. What can I do?

March 30, 2016 Kevin 131
…
Next

Talk to your doctor about health costs. It can save you money.

March 30, 2016 Kevin 7
…

ADVERTISEMENT

Tagged as: Primary Care

Post navigation

< Previous Post
Medical school has killed my soul. What can I do?
Next Post >
Talk to your doctor about health costs. It can save you money.

ADVERTISEMENT

More by Roy Benaroch, MD

  • Goodbye, Benadryl: It is time for you to retire

    Roy Benaroch, MD
  • Telemedicine overprescribes antibiotics: Are you really receiving the best care over the phone?

    Roy Benaroch, MD
  • No, phones don’t cause horns to grow on skulls

    Roy Benaroch, MD

Related Posts

  • Is social media a friend or foe of science?

    Michael Joyce, MD
  • Why medical school is like playing defense

    Jamie Katuna
  • Take politics out of science and medicine

    Anonymous
  • Fight gun violence with science

    Jamie Coleman, MD
  • Quality measures have gotten ahead of the science of quality measurement

    Peter Ubel, MD
  • How the science of learning salvaged my college career

    Elijah Hamm

More in Physician

  • Demedicalize dying: Why end-of-life care needs a spiritual reset

    Kevin Haselhorst, MD
  • Physician due process: Surviving the court of public opinion

    Muhamad Aly Rifai, MD
  • Spaced repetition in medicine: Why current apps fail clinicians

    Dr. Sunakshi Bhatia
  • When diagnosis becomes closure: the harm of stopping too soon

    Ann Lebeck, MD
  • From flight surgeon to investor: a doctor’s guide to financial freedom

    David B. Mandell, JD, MBA
  • The surgical safety checklist: Why silence is the real enemy

    Brooke Buckley, MD, MBA
  • Most Popular

  • Past Week

    • Health care as a human right vs. commodity: Resolving the paradox

      Timothy Lesaca, MD | Physician
    • My wife’s story: How DEA and CDC guidelines destroyed our golden years

      Monty Goddard & Richard A. Lawhern, PhD | Conditions
    • The gastroenterologist shortage: Why supply is falling behind demand

      Brian Hudes, MD | Physician
    • Why voicemail in outpatient care is failing patients and staff

      Dan Ouellet | Tech
    • Alex Pretti’s death: Why politics belongs in emergency medicine

      Marilyn McCullum, RN | Conditions
    • U.S. opioid policy history: How politics replaced science in pain care

      Richard A. Lawhern, PhD & Stephen E. Nadeau, MD | Meds
  • Past 6 Months

    • How environmental justice and health disparities connect to climate change

      Kaitlynn Esemaya, Alexis Thompson, Annique McLune, and Anamaria Ancheta | Policy
    • Will AI replace primary care physicians?

      P. Dileep Kumar, MD, MBA | Tech
    • A physician father on the Dobbs decision and reproductive rights

      Travis Walker, MD, MPH | Physician
    • What is the minority tax in medicine?

      Tharini Nagarkar and Maranda C. Ward, EdD, MPH | Education
    • Why the U.S. health care system is failing patients and physicians

      John C. Hagan III, MD | Policy
    • Alex Pretti: a physician’s open letter defending his legacy

      Mousson Berrouet, DO | Physician
  • Recent Posts

    • AI censorship threatens the lifeline of caregiver support [PODCAST]

      The Podcast by KevinMD | Podcast
    • Demedicalize dying: Why end-of-life care needs a spiritual reset

      Kevin Haselhorst, MD | Physician
    • Physician due process: Surviving the court of public opinion

      Muhamad Aly Rifai, MD | Physician
    • Spaced repetition in medicine: Why current apps fail clinicians

      Dr. Sunakshi Bhatia | Physician
    • When the doctor becomes the patient: a breast cancer diagnosis

      Sue Hwang, MD | Conditions
    • My journey with fibroids and hysterectomy: a patient’s perspective

      Sonya Linda Bynum | Conditions

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 1 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Health care as a human right vs. commodity: Resolving the paradox

      Timothy Lesaca, MD | Physician
    • My wife’s story: How DEA and CDC guidelines destroyed our golden years

      Monty Goddard & Richard A. Lawhern, PhD | Conditions
    • The gastroenterologist shortage: Why supply is falling behind demand

      Brian Hudes, MD | Physician
    • Why voicemail in outpatient care is failing patients and staff

      Dan Ouellet | Tech
    • Alex Pretti’s death: Why politics belongs in emergency medicine

      Marilyn McCullum, RN | Conditions
    • U.S. opioid policy history: How politics replaced science in pain care

      Richard A. Lawhern, PhD & Stephen E. Nadeau, MD | Meds
  • Past 6 Months

    • How environmental justice and health disparities connect to climate change

      Kaitlynn Esemaya, Alexis Thompson, Annique McLune, and Anamaria Ancheta | Policy
    • Will AI replace primary care physicians?

      P. Dileep Kumar, MD, MBA | Tech
    • A physician father on the Dobbs decision and reproductive rights

      Travis Walker, MD, MPH | Physician
    • What is the minority tax in medicine?

      Tharini Nagarkar and Maranda C. Ward, EdD, MPH | Education
    • Why the U.S. health care system is failing patients and physicians

      John C. Hagan III, MD | Policy
    • Alex Pretti: a physician’s open letter defending his legacy

      Mousson Berrouet, DO | Physician
  • Recent Posts

    • AI censorship threatens the lifeline of caregiver support [PODCAST]

      The Podcast by KevinMD | Podcast
    • Demedicalize dying: Why end-of-life care needs a spiritual reset

      Kevin Haselhorst, MD | Physician
    • Physician due process: Surviving the court of public opinion

      Muhamad Aly Rifai, MD | Physician
    • Spaced repetition in medicine: Why current apps fail clinicians

      Dr. Sunakshi Bhatia | Physician
    • When the doctor becomes the patient: a breast cancer diagnosis

      Sue Hwang, MD | Conditions
    • My journey with fibroids and hysterectomy: a patient’s perspective

      Sonya Linda Bynum | Conditions

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

The best defense against the influence of crappy science
1 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...