Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Quality measures have gotten ahead of the science of quality measurement

Peter Ubel, MD
Policy
August 15, 2020
15 Shares
Share
Tweet
Share

Physician reimbursement increasingly depends upon measures of health care quality. Physicians who fall short on quality measures now face financial penalties. But it might be quality measures, themselves, that are falling short, according to a study conducted by the American College of Physicians.

The study involved a panel of people with expertise in evidence-based medicine. Panelists were asked to evaluate the validity of quality measures being used by either Medicare, the National Committee for Quality Assurance, or the National Quality Forum. It is typically measured from these three groups that are used to determine physician quality report cards, and Medicare plans to use its measures to influence reimbursement for individual clinicians.

The panel evaluated the validity of these measures using a modified version of a RAND/UCLA method that has been widely accepted as the best way to assess the strength of evidence for health care interventions. That method, developed in the 1980s, combines literature review and synthesis, multiple rounds of expert panel ratings, and retrospective comparison of evidence with clinical records, when feasible. The method isn’t perfect. But its the best we’ve got by a long shot.

How do quality measures from these three groups stack up? The experts reviewed each measure and determined whether it was valid, uncertain, or invalid. They looked at 86 quality measures that Medicare will use as part of its MIPS program (an acronym for Merit-based Incentive Payment System). Barely more than a third of these measures were valid. The measures from NCQA and NQF came out better, with 60% and half being judged valid, respectively. But that still leaves a huge number of quality measures that are either uncertain or out and out invalid. In fact here is a bar graph I’ve put together of the results:

Validity of 50 quality measures from Medicare, NCQA and NCQF (adapted from NEJM study noted above)

Validity of 50 quality measures from Medicare, NCQA and NCQF (adapted from NEJM study noted above)

This is just one group’s take on the quality of quality measures. But it is a very credible and rigorous group. And many members of the group have been strong advocates for measuring the quality of clinical care. These aren’t a bunch of “leave these doctors alone” advocates.

Their results strongly suggest that the use of quality measures, by payers and accrediting organizations, has gotten ahead of the science of quality measurement.

Peter Ubel is a physician and behavioral scientist who blogs at his self-titled site, Peter Ubel, and can be reached on Twitter @PeterUbel. He is the author of Critical Decisions: How You and Your Doctor Can Make the Right Medical Choices Together. This article originally appeared in Forbes.

Image credit: Shutterstock.com

Prev

Medical education and engaging children in wearing masks [PODCAST]

August 14, 2020 Kevin 0
…
Next

What happens if you are both too rich and too poor for health insurance?

August 15, 2020 Kevin 1
…

Tagged as: Public Health & Policy

Post navigation

< Previous Post
Medical education and engaging children in wearing masks [PODCAST]
Next Post >
What happens if you are both too rich and too poor for health insurance?

More by Peter Ubel, MD

  • Clinicians shouldn’t be punished for taking care of needy populations

    Peter Ubel, MD
  • Patients alone cannot combat high health care prices

    Peter Ubel, MD
  • Is the FDA too slow to handle the pandemic?

    Peter Ubel, MD

Related Posts

  • When quality measures interfere with good care

    Michael McCutchen, MD, MBA
  • Should doctors take more responsibility for quality metrics?

    Sarah Gebauer, MD
  • Redefining quality through a patient-centered approach

    Anne Zink, MD
  • Race to the bottom: The myth of low-quality care in America

    Eric W. Toth, DO
  • Why quality reports for hospitals and doctors are interesting but flawed

    Mark Kelley, MD
  • Why immunization rates should not be used as a quality indicator

    Niran S. Al-Agba, MD

More in Policy

  • The realities of immigrant health care served hot from America’s melting pot

    Stella Cho
  • Healing the damaged nurse-physician dynamic

    Angel J. Mena, MD and Ali Morin, MSN, RN
  • Deaths of despair: an urgent call for a collective response to the crisis in U.S. life expectancy

    Mohammed Umer Waris, MD
  • Breaking down the barriers to effective bar-code medication administration

    Amy Dang Craft
  • The locums industry has a beef problem

    Aaron Morgenstein, MD
  • Canada’s health workers are sounding the alarm. We must act, now.

    Ivy Lynn Bourgeault, PhD
  • Most Popular

  • Past Week

    • The real cause of America’s opioid crisis: Doctors are not to blame

      Richard A. Lawhern, PhD | Meds
    • Healing the damaged nurse-physician dynamic

      Angel J. Mena, MD and Ali Morin, MSN, RN | Policy
    • The struggle to fill emergency medicine residency spots: Exploring the factors behind the unfilled match

      Katrina Gipson, MD, MPH | Physician
    • Breaking the stigma: Addressing the struggles of physicians

      Jean Antonucci, MD | Physician
    • Beyond the disease: the power of empathy in health care

      Nana Dadzie Ghansah, MD | Physician
    • Deaths of despair: an urgent call for a collective response to the crisis in U.S. life expectancy

      Mohammed Umer Waris, MD | Policy
  • Past 6 Months

    • The hidden dangers of the Nebraska Heartbeat Act

      Meghan Sheehan, MD | Policy
    • The real cause of America’s opioid crisis: Doctors are not to blame

      Richard A. Lawhern, PhD | Meds
    • Nobody wants this job. Should physicians stick around?

      Katie Klingberg, MD | Physician
    • The fight for reproductive health: Why medication abortion matters

      Catherine Hennessey, MD | Physician
    • The vital importance of climate change education in medical schools

      Helen Kim, MD | Policy
    • Resetting the doctor-patient relationship: Navigating the challenges of modern primary care

      Jeffrey H. Millstein, MD | Physician
  • Recent Posts

    • Dr. Glaucomflecken for president!

      Aaron Morgenstein, MD & Amy Bissada, MD & Corinne Sundar Rao, MD | Physician
    • What is driving physicians to the edge of despair?

      Edward T. Creagan, MD | Physician
    • Do residents deserve the title of physician?

      Anonymous | Physician
    • A new era of collaboration between AI and health care professionals

      Harvey Castro, MD, MBA | Tech
    • When an MBA degree meets medicine: an eye-opening experience

      Arthur Lazarus, MD, MBA | Physician
    • Why it’s time to question medical traditions [PODCAST]

      The Podcast by KevinMD | Podcast

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

CME Spotlights

From MedPage Today

Latest News

  • Coffee and Heart Function; Ionizing Radiation and CVD
  • Health Inequity Should Be Labeled as a 'Never Event'
  • Healing the Damaged Nurse-Physician Dynamic
  • Doc Moms, Mind the Gap -- $3M Earning Difference by Sex
  • Clinical Note Writing App Powered by GPT-4 Set to Debut This Year

Meeting Coverage

  • Switch to IL-23 Blocker Yields Deep Responses in Recalcitrant Plaque Psoriasis
  • Biomarkers of Response With Enfortumab Vedotin in Advanced Urothelial Cancer
  • At-Home Topical Therapy for Molluscum Contagiosum Gets High Marks
  • Outlook for Itchy Prurigo Nodularis Continues to Improve With IL-31 Antagonist
  • AAAAI President Shares Highlights From the 2023 Meeting
  • Most Popular

  • Past Week

    • The real cause of America’s opioid crisis: Doctors are not to blame

      Richard A. Lawhern, PhD | Meds
    • Healing the damaged nurse-physician dynamic

      Angel J. Mena, MD and Ali Morin, MSN, RN | Policy
    • The struggle to fill emergency medicine residency spots: Exploring the factors behind the unfilled match

      Katrina Gipson, MD, MPH | Physician
    • Breaking the stigma: Addressing the struggles of physicians

      Jean Antonucci, MD | Physician
    • Beyond the disease: the power of empathy in health care

      Nana Dadzie Ghansah, MD | Physician
    • Deaths of despair: an urgent call for a collective response to the crisis in U.S. life expectancy

      Mohammed Umer Waris, MD | Policy
  • Past 6 Months

    • The hidden dangers of the Nebraska Heartbeat Act

      Meghan Sheehan, MD | Policy
    • The real cause of America’s opioid crisis: Doctors are not to blame

      Richard A. Lawhern, PhD | Meds
    • Nobody wants this job. Should physicians stick around?

      Katie Klingberg, MD | Physician
    • The fight for reproductive health: Why medication abortion matters

      Catherine Hennessey, MD | Physician
    • The vital importance of climate change education in medical schools

      Helen Kim, MD | Policy
    • Resetting the doctor-patient relationship: Navigating the challenges of modern primary care

      Jeffrey H. Millstein, MD | Physician
  • Recent Posts

    • Dr. Glaucomflecken for president!

      Aaron Morgenstein, MD & Amy Bissada, MD & Corinne Sundar Rao, MD | Physician
    • What is driving physicians to the edge of despair?

      Edward T. Creagan, MD | Physician
    • Do residents deserve the title of physician?

      Anonymous | Physician
    • A new era of collaboration between AI and health care professionals

      Harvey Castro, MD, MBA | Tech
    • When an MBA degree meets medicine: an eye-opening experience

      Arthur Lazarus, MD, MBA | Physician
    • Why it’s time to question medical traditions [PODCAST]

      The Podcast by KevinMD | Podcast

MedPage Today Professional

An Everyday Health Property Medpage Today iMedicalApps
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...