Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

The risks of publically reported surgical outcomes

Skeptical Scalpel, MD
Conditions
June 27, 2018
6 Shares
Share
Tweet
Share

“Some data is better than no data at all.” Do you believe that?

I heard it frequently when the infamous ProPublica’s Surgeon Scorecard first appeared three years ago. Back then I blogged about it saying “To me, bad data is worse than no data at all.”

A recent study in BJU International confirmed my thoughts about this type of publicly posted data and identified a previously unreported issue. The paper attempted to determine whether the public was able to accurately interpret statistics used in the Surgeon Scorecard. It turns out they were not very good at it.

Investigators from the department of urology at the University of Minnesota surveyed 343 people who attended the Minnesota State Fair in 2016. Those who took the survey had a median age of 48, were 60% female, 80% white, and 60% college educated. Their median annual income was $26,550 with an interquartile range of $22,882 to $32,587.

The authors showed individuals the figure below on a tablet computer with the accompanying statement “This graph shows the individual surgeons’ complication rates after 28-35 cases. Surgeons A, B and C raw complication rates are A = 1/35 or 2.9%, B = 1/34 or 3.8% and C = 1/28 or 3.6%.”

In case you aren’t sure, understand the complication rates for these three surgeons are not significantly different due to the small numbers of cases and complications.

The most surprising finding of the study was although the surgeons’ complication rates were clearly stated above the figure, just 15.2% of the participants could correctly identify surgeon C’s complication rate. The participants thought the average complication rate for surgeon C was 25% (range 3.6% to 50%). Regarding surgeon B, they were better at estimating the complication rate, but still only 34.9% got it right.

The subjects were asked multiple-choice questions related to the surgeons’ complication rates. When asked to choose a surgeon for a hypothetical procedure, 192 (56%) picked surgeon A, 30 (8.7%) picked B, and 19 (5.5%) selected C; 102 (29.7%) said they didn’t have enough information to decide.

Here’s the new wrinkle on the potential harm of misinterpreting data. The subjects were then told that their insurance would only pay if they used surgeon C, and if they wanted to use one of the other surgeons, they would have to pay out of their own pockets. Almost two-thirds said they would pay an average of $5,754 in order to have their surgery done by surgeon A or B.

Those willing to switch were significantly poorer, had a significantly higher incidence of a history of cancer, and misinterpreted the complication rates significantly more often.

What this means is that the people who could least afford to switch surgeons were the most likely to do so.

Bottom line: People may misinterpret published data on surgical complication rates which could result in financial harm to them.

“Skeptical Scalpel” is a surgeon who blogs at his self-titled site, Skeptical Scalpel.  

Image credit: Shutterstock.com

Prev

When does a condition become a medical issue?

June 27, 2018 Kevin 10
…
Next

Restricting opioid prescribing: Some error has to be tolerated

June 27, 2018 Kevin 9
…

Tagged as: Public Health & Policy, Surgery

Post navigation

< Previous Post
When does a condition become a medical issue?
Next Post >
Restricting opioid prescribing: Some error has to be tolerated

More by Skeptical Scalpel, MD

  • The hospital CEO who made a surgical incision. What happened?

    Skeptical Scalpel, MD
  • Medical error is not the third leading cause of death

    Skeptical Scalpel, MD
  • Should speed-eating contests be banned?

    Skeptical Scalpel, MD

Related Posts

  • CMS risks ACO success by forcing move to another track

    Manish Naik, MD
  • The promise of in silico drug development to improve patient outcomes

    Tanja Dowe
  • Have you been reported under the Sunshine Act?

    Another Second Opinion, MD
  • Many medical marijuana program websites are silent about possible risks

    Erik Messamore, MD, PhD
  • Adapting medical safety standards to enhance police outcomes

    Richard Plotzker, MD
  • Ownership of outcomes: Reuniting power and responsibility

    Amelia L. Bueche, DO

More in Conditions

  • Why patients write: stress relief, self-care, and sharing experiences

    R. Lynn Barnett
  • Misinformed claims and the offensiveness of discrediting COVID-19 vaccine development

    Angel Garcia Otano, MD
  • Family support is pivotal in the treatment of schizophrenia

    Frank Chen, MD
  • Exploring disfigurement and self-worth

    Kathleen Watt
  • Are we doing enough to help chronic pain sufferers?

    Adam Strohl, MD
  • Lessons taught by Bell’s palsy

    Alexander Rakowsky, MD
  • Most Popular

  • Past Week

    • I’m a doctor, and I almost died during childbirth

      Bayo Curry-Winchell, MD | Physician
    • Reigniting after burnout: 3 physician stories

      Kim Downey, PT | Physician
    • Motorcycle helmet laws: Balancing freedom and financial impact

      Stephen Cohn, MD | Conditions
    • Balancing efficiency and compassion [PODCAST]

      The Podcast by KevinMD | Podcast
    • The link between orofacial myofunctional disorders and dental health

      Stephanie Jeret | Conditions
    • How compassionate leadership saved this physician [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Medical gaslighting: a growing challenge in today’s medical landscape

      Tami Burdick | Conditions
    • Balancing opioid medication in chronic pain

      L. Joseph Parker, MD | Conditions
    • I want to be a doctor who can provide care for women: What states must I rule out for my medical education?

      Nandini Erodula | Education
    • Navigating the broken medical system: challenges faced by foreign medical graduates

      Anonymous | Physician
    • Mourning the silent epidemic: the physician suicide crisis and suggestions for change

      Amna Shabbir, MD | Physician
    • The essence of medicine: genuine connections in practice

      Jennifer Tillman, MD | Physician
  • Recent Posts

    • Balancing efficiency and compassion [PODCAST]

      The Podcast by KevinMD | Podcast
    • Reigniting after burnout: 3 physician stories

      Kim Downey, PT | Physician
    • Why patients write: stress relief, self-care, and sharing experiences

      R. Lynn Barnett | Conditions
    • Inside the grueling life of a surgery intern

      Randall S. Fong, MD | Physician
    • Misinformed claims and the offensiveness of discrediting COVID-19 vaccine development

      Angel Garcia Otano, MD | Conditions
    • Bitcoin’s role in diversified portfolios [PODCAST]

      The Podcast by KevinMD | Podcast

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 7 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

CME Spotlights

From MedPage Today

Latest News

  • Did Gabapentin Improve Post-COVID Olfaction?
  • Fentanyl Death Trends; Food Additives and Heart Disease
  • What If the Doctor Is Out?
  • Reduced Mortality Seen in Cancer Survivors Who Meet Exercise Guidelines
  • CDC Advisors Endorse Maternal RSV Vax to Protect Newborns

Meeting Coverage

  • Loneliness Needs to Be Treated Like Any Other Health Condition, Researcher Suggests
  • Stopping Medical Misinformation Requires Early Detection
  • AI Has an Image Problem in Healthcare, Expert Says
  • Want Better Health Outcomes? Check Out What Other Countries Do
  • ERS Roundup: Cell Transplant Boosts Lung Function in COPD Patients
  • Most Popular

  • Past Week

    • I’m a doctor, and I almost died during childbirth

      Bayo Curry-Winchell, MD | Physician
    • Reigniting after burnout: 3 physician stories

      Kim Downey, PT | Physician
    • Motorcycle helmet laws: Balancing freedom and financial impact

      Stephen Cohn, MD | Conditions
    • Balancing efficiency and compassion [PODCAST]

      The Podcast by KevinMD | Podcast
    • The link between orofacial myofunctional disorders and dental health

      Stephanie Jeret | Conditions
    • How compassionate leadership saved this physician [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Medical gaslighting: a growing challenge in today’s medical landscape

      Tami Burdick | Conditions
    • Balancing opioid medication in chronic pain

      L. Joseph Parker, MD | Conditions
    • I want to be a doctor who can provide care for women: What states must I rule out for my medical education?

      Nandini Erodula | Education
    • Navigating the broken medical system: challenges faced by foreign medical graduates

      Anonymous | Physician
    • Mourning the silent epidemic: the physician suicide crisis and suggestions for change

      Amna Shabbir, MD | Physician
    • The essence of medicine: genuine connections in practice

      Jennifer Tillman, MD | Physician
  • Recent Posts

    • Balancing efficiency and compassion [PODCAST]

      The Podcast by KevinMD | Podcast
    • Reigniting after burnout: 3 physician stories

      Kim Downey, PT | Physician
    • Why patients write: stress relief, self-care, and sharing experiences

      R. Lynn Barnett | Conditions
    • Inside the grueling life of a surgery intern

      Randall S. Fong, MD | Physician
    • Misinformed claims and the offensiveness of discrediting COVID-19 vaccine development

      Angel Garcia Otano, MD | Conditions
    • Bitcoin’s role in diversified portfolios [PODCAST]

      The Podcast by KevinMD | Podcast

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

The risks of publically reported surgical outcomes
7 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...