Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Why patient satisfaction surveys are riddled with problems

Christopher Johnson, MD
Physician
June 23, 2014
146 Shares
Share
Tweet
Share

Nearly all physicians are now subject to patient satisfaction ratings. In my case, and many thousands of my colleagues across the country, it is via the survey tool sold to health care facilities by the Press Ganey Company. There are also many, many online sources that rate physicians.

The idea is a good one: Physicians should be subject to feedback from patients about patient perceptions of how good a job the doctors do. If nothing else, how are we otherwise to change our behavior if we don’t find out where our problems are? The surveys don’t measure medical competence, but they could be a good metric of another aspect of how good we are as physicians. But, as currently used, patient satisfaction surveys are riddled with problems. They don’t measure what they’re supposed to measure, and they can easily drive physician behavior the wrong way.

I’ve read the Press Ganey survey forms, and the questions they ask are all very reasonable. I’d like to see the results if all the parents of my patients would fill one out. But that’s the problem. It is a fundamental principle of statistics that the sample (those who fill out the survey) you use to analyze the whole data set (which would be all the patients) is representative of the entire group. This doesn’t happen. Although the forms are sent out to a random sample of patients, a very nonrandom distribution of them are returned. Perhaps only the patients who are happy, or those who are unhappy, send them back. This is in fact likely. For the analysis to have any validity at all the patients who do not return the forms must also be randomly distributed among all those sent forms. But a valid survey, one in which efforts are made to get a very high return rate using such things as follow-up calls or contacts, is much more expensive to do.

There is another problem. Patient satisfaction and good medical care do not entirely overlap. It is certainly true that an experienced and skilled physician can and should deliver bad news to patients in a way in which the patient feels understood and accepting. But not infrequently doctors have to tell a patient that what the patient wants is not good medical care. This might be something as simple as not prescribing antibiotics for a viral illness, even though the patient may want that, to not prescribing narcotics to a drug-seeking patient in the emergency department. Both of these scenarios are common, and so can be the result: a dissatisfied patient. This issue would also be solved by a getting surveys from a truly random sample of patients, since the dissatisfied antibiotic or drug-seeking ones would be washed out by all the others. But now the mad ones fill out the forms — many others toss them in the trash.

This is not a trivial issue. Recent research has strongly suggested that the most satisfied patients often don’t get the best care; they are more likely to be admitted to the hospital (an often dangerous place), and they may even have a higher death rate. The best doctors can easily have the worst patient satisfaction scores.

I don’t want you to think I am against holding physicians accountable for what we do — I’m not. Patient satisfaction is a key component of how to do that. But we must have better tools, especially since we are now tying a doctor’s income to the satisfaction score. What we do now can easily result in statistical nonsense. Any scientist will tell you that bad data are worse than no data.

For what it’s worth, I looked for my own scores on several of the big physician rating sites. Good news! I got 4 stars (excellent)! The number of reviews I could find, out of the thousands of patients I’ve seen over 35 years of practice? One: a single review. So thanks to whoever the reviewer was, but one out of many thousands doesn’t seem to be a very representative sample.

Christopher Johnson is a pediatric intensive care physician and author of Keeping Your Kids Out of the Emergency Room: A Guide to Childhood Injuries and Illnesses, Your Critically Ill Child: Life and Death Choices Parents Must Face, How to Talk to Your Child’s Doctor: A Handbook for Parents, and How Your Child Heals: An Inside Look At Common Childhood Ailments.  He blogs at his self-titled site, Christopher Johnson, MD.

Prev

How entitlement undermines patient engagement

June 23, 2014 Kevin 44
…
Next

Momentum for telehealth is accelerating

June 24, 2014 Kevin 0
…

Tagged as: Primary Care

Post navigation

< Previous Post
How entitlement undermines patient engagement
Next Post >
Momentum for telehealth is accelerating

More by Christopher Johnson, MD

  • The success of Australian firearms regulation: What it could mean for children

    Christopher Johnson, MD
  • Do protocols and pathways improve care?

    Christopher Johnson, MD
  • Why are so many community hospitals transferring children to larger facilities?

    Christopher Johnson, MD

More in Physician

  • How excessively regulating doctors can harm patients

    Richard Gunderman, MD, PhD and James Lynch, MD
  • The alarming epidemic of physician burnout and how we can combat it

    Tomi Mitchell, MD
  • A retired physician’s battle with moral injury

    Hayward Zwerling, MD
  • Unveiling the secrets to effective resuscitation and overcoming obstacles

    Deepak Gupta, MD
  • A tense family drama unfolds as a young daughter pursues unconventional career path

    Osmund Agbo, MD
  • Decoding the brain’s decision-making: insights for medical professions and strategies for success

    Harvey Castro, MD, MBA
  • Most Popular

  • Past Week

    • A physician’s typical day, as envisioned by a non-clinician health care MBA: a satire

      Jennifer Lycette, MD | Physician
    • The rising threat of lung cancer in Asian American female nonsmokers

      Alice S. Y. Lee, MD | Conditions
    • Revealing America’s expansion: the dark truth of Native American suffering and unjustified abuses

      Anonymous | Physician
    • Georgia’s new law promoting truth and transparency in health care credentials

      Carmen Kavali, MD | Policy
    • The tragic story of Mr. G: a painful journey towards understanding suicide

      William Lynes, MD | Physician
    • Decoding name displays in health care: Privacy, identification, and compliance unveiled

      Deepak Gupta, MD | Physician
  • Past 6 Months

    • “Is your surgeon really skilled? The hidden threat to public safety in medicine.

      Gene Uzawa Dorio, MD | Physician
    • A physician’s typical day, as envisioned by a non-clinician health care MBA: a satire

      Jennifer Lycette, MD | Physician
    • Unveiling the hidden damage: the secretive world of medical boards

      Alan Lindemann, MD | Physician
    • Proactive risk management: a game-changer in preventing physician burnout

      Howard Smith, MD | Physician
    • An inspiring tribute to an exceptional radiologist who made a lasting impact

      Kim Downey, PT | Conditions
    • The hidden factor in physician burnout: How the climate crisis is contributing to the erosion of well-being

      Elizabeth Cerceo, MD | Physician
  • Recent Posts

    • How healthy eating can protect us from extreme weather

      R. Jason Newsom, MD, MPH | Policy
    • Unfilled residency spots and the future of emergency medicine [PODCAST]

      The Podcast by KevinMD | Podcast
    • How excessively regulating doctors can harm patients

      Richard Gunderman, MD, PhD and James Lynch, MD | Physician
    • AI-driven solutions for burnout, patient empathy, and worker shortage

      Harry Severance, MD | Tech
    • How modern lifestyle changes are disrupting our immune systems

      Kara Wada, MD | Conditions
    • Empathy and awareness: Unveiling the hidden dangers of food allergies [PODCAST]

      The Podcast by KevinMD | Podcast

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 5 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

CME Spotlights

From MedPage Today

Latest News

  • Hooray! A Clearer Estimate of Your Risk for Death Is Around the Corner
  • Transapical Transcatheter Mitral Valve Replacement Trial Raises Questions
  • Americans With Heart Disease Less Likely to Use Wearable Devices
  • Residents, Fellows at Mass General Brigham Vote to Unionize
  • Alzheimer's Drug Clears Major Hurdle Toward Full Approval

Meeting Coverage

  • Transapical Transcatheter Mitral Valve Replacement Trial Raises Questions
  • MitraClip Shines in Real-World, Core-Lab Data
  • Risankizumab Safe in Older Crohn's Disease Patients
  • How to Better Identify HER2-Low Breast Cancer
  • Higher Fetal Cortisol Levels Linked to Sleep Onset Delays
  • Most Popular

  • Past Week

    • A physician’s typical day, as envisioned by a non-clinician health care MBA: a satire

      Jennifer Lycette, MD | Physician
    • The rising threat of lung cancer in Asian American female nonsmokers

      Alice S. Y. Lee, MD | Conditions
    • Revealing America’s expansion: the dark truth of Native American suffering and unjustified abuses

      Anonymous | Physician
    • Georgia’s new law promoting truth and transparency in health care credentials

      Carmen Kavali, MD | Policy
    • The tragic story of Mr. G: a painful journey towards understanding suicide

      William Lynes, MD | Physician
    • Decoding name displays in health care: Privacy, identification, and compliance unveiled

      Deepak Gupta, MD | Physician
  • Past 6 Months

    • “Is your surgeon really skilled? The hidden threat to public safety in medicine.

      Gene Uzawa Dorio, MD | Physician
    • A physician’s typical day, as envisioned by a non-clinician health care MBA: a satire

      Jennifer Lycette, MD | Physician
    • Unveiling the hidden damage: the secretive world of medical boards

      Alan Lindemann, MD | Physician
    • Proactive risk management: a game-changer in preventing physician burnout

      Howard Smith, MD | Physician
    • An inspiring tribute to an exceptional radiologist who made a lasting impact

      Kim Downey, PT | Conditions
    • The hidden factor in physician burnout: How the climate crisis is contributing to the erosion of well-being

      Elizabeth Cerceo, MD | Physician
  • Recent Posts

    • How healthy eating can protect us from extreme weather

      R. Jason Newsom, MD, MPH | Policy
    • Unfilled residency spots and the future of emergency medicine [PODCAST]

      The Podcast by KevinMD | Podcast
    • How excessively regulating doctors can harm patients

      Richard Gunderman, MD, PhD and James Lynch, MD | Physician
    • AI-driven solutions for burnout, patient empathy, and worker shortage

      Harry Severance, MD | Tech
    • How modern lifestyle changes are disrupting our immune systems

      Kara Wada, MD | Conditions
    • Empathy and awareness: Unveiling the hidden dangers of food allergies [PODCAST]

      The Podcast by KevinMD | Podcast

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Why patient satisfaction surveys are riddled with problems
5 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...