Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Tests in medicine and public schools: What do they really measure?

Shirie Leng, MD
Physician
May 10, 2015
331 Shares
Share
Tweet
Share

Humans are social creatures who naturally evaluate where they stand in relation to those around them. I have no idea how this evaluation process evolved, but at some point we noticed that some cavemen brought more food to the cave than others. The idea was born that some people are better hunters than others. We’ve been trying to decide who is “better” ever since.

The origin of the word “test” comes from Middle English, and referred to a vessel in which metals were assayed. That is, the test determined what kind of metal was present in the vessel. So a test functioned as an identifier, similar to the way certain medical tests identify specific bacteria. Today most people, when they hear they are being tested, don’t think about the test as just a source of information. People think of testing in terms of evaluation or comparison, a judgement about some aspect of their knowledge or abilities. Someone is better, and someone else is worse.

Here is how Merriam-Webster defines test:

  1. A critical examination, observation, or evaluation.
  2. The procedure of submitting a statement to such conditions or operations as will lead to its proof or disproof or to its acceptance or rejection.
  3. A basis for evaluation.
  4. An ordeal or oath required as proof of conformity with a set of beliefs.
  5. A procedure, reaction, or reagent used to identify or characterize a substance or constituent.
  6. Something (as a series of questions or exercises) for measuring the skill, knowledge, intelligence, capacities, or aptitudes of an individual or group.

Notice the terms “critical,” “ordeal,” “measuring,” “evaluation.”

We have tests for everything. And people are getting sick of tests. Observe the growing backlash against public school testing in New York. Observe the questions arising about medical testing. Observe the pushback from physicians over maintenance of certification exams.

Some tests are good, right? A blood test to identify HIV is good. Quizzing yourself after reading a difficult passage in a textbook is a good test. Covering up the multiplication tables and seeing how much you can do by memory is a good test. Testing the gem in your engagement ring to make sure it’s diamond and not cubic zirconium is a good test. What makes a good test? The Center for Public Education says that test should be “valid, reliable, and free of cultural bias.” Essentially, a good test reliably measures what you want to measure, and, presumably, doesn’t measure what you don’t want to measure.

Let’s take an example. The PSA test evaluates the blood for a prostate-specific antigen that, in high amounts, can be an indicator of prostate cancer. So it measures PSA. That’s all it does. It does not measure how much time a man has left, or mortality rate, or rate of prostate cancer growth, or what the man will eventually die of. In short, it gives you a number that you can’t use. People think a PSA will tell you if you will die of prostate cancer. For that, you’d need a good test. Like a crystal ball.

Here’s another example. Common Core tests kids as early as third grade. The problem with these tests is not that you don’t get useful information. It is that the information you get is not what you want to measure. The test is supposed to measure knowledge but instead tests memorization. It is supposed to measure learning but measures test-taking ability. And actually it isn’t supposed to measure knowledge or learning, but teacher quality. But the test is not administered to teachers, so the test not only doesn’t measure what you want it to but tests the wrong subjects. The result is that students and parents think the test measures the intellect and worth of the student, and school districts think the test measures the intellect and worth of the teacher.

The same problems exist for the maintenance of certification (MOC) exams in anesthesia and other specialties. The tests are time-consuming and expensive and measure memorization and test-taking skills that have nothing to do with quality care.

By some unbelievable miracle, the American Board of Anesthesiology has just announced that they are getting rid of the MOC tests, largely in response to vocal backlash by physicians. Hopefully, a similar outcry from a growing number of parents can effect a similar change in the public schools. It would take a miracle.

Shirie Leng, a former nurse, is an anesthesiologist who blogs at medicine for real.

Prev

Grandparents who spend their old age raising their grandchildren

May 10, 2015 Kevin 0
…
Next

Why should doctors use Twitter?

May 10, 2015 Kevin 1
…

Tagged as: Primary Care, Surgery

Post navigation

< Previous Post
Grandparents who spend their old age raising their grandchildren
Next Post >
Why should doctors use Twitter?

More by Shirie Leng, MD

  • The choice between medicine and nursing

    Shirie Leng, MD
  • New technology might help us become more empathetic to others’ suffering

    Shirie Leng, MD
  • Does practice really make perfect?

    Shirie Leng, MD

More in Physician

  • Revealing America’s expansion: the dark truth of Native American suffering and unjustified abuses

    Anonymous
  • From journalism to medicine: Unveiling the untold stories of patients’ medical conditions

    Veronica Bonales, MD
  • A mentor’s legacy in medicine, leadership, and embracing evidence-based care

    Arthur Lazarus, MD, MBA
  • Breaking free from restrictive covenants to combat burnout

    Raya E. Kheirbek, MD
  • From medical student to intern: Discovering a deeper connection with patients

    Johnathan Yao, MD, MPH
  • A physician’s typical day, as envisioned by a non-clinician health care MBA: a satire

    Jennifer Lycette, MD
  • Most Popular

  • Past Week

    • Boxing legends Tyson and Foreman: powerful lessons for a resilient and evolving health care future

      Harvey Castro, MD, MBA | Physician
    • We need a new Hippocratic Oath that puts patient autonomy first

      Jeffrey A. Singer, MD | Physician
    • Is chaos in health care leading us towards socialized medicine? How physician burnout is a catalyst.

      Howard Smith, MD | Physician
    • A physician’s typical day, as envisioned by a non-clinician health care MBA: a satire

      Jennifer Lycette, MD | Physician
    • Decoding name displays in health care: Privacy, identification, and compliance unveiled

      Deepak Gupta, MD | Physician
    • The rising threat of lung cancer in Asian American female nonsmokers

      Alice S. Y. Lee, MD | Conditions
  • Past 6 Months

    • It’s time to replace the 0 to 10 pain intensity scale with a better measure

      Mark Sullivan, MD and Jane Ballantyne, MD | Conditions
    • “Is your surgeon really skilled? The hidden threat to public safety in medicine.

      Gene Uzawa Dorio, MD | Physician
    • Unveiling the hidden damage: the secretive world of medical boards

      Alan Lindemann, MD | Physician
    • Breaking the cycle of racism in health care: a call for anti-racist action

      Tomi Mitchell, MD | Policy
    • Revolutionize your practice: the value-based care model that reduces physician burnout

      Chandravadan Patel, MD | Physician
    • An inspiring tribute to an exceptional radiologist who made a lasting impact

      Kim Downey, PT | Conditions
  • Recent Posts

    • Revealing America’s expansion: the dark truth of Native American suffering and unjustified abuses

      Anonymous | Physician
    • Unlock financial freedom: The physician’s guide to lucrative multifamily syndications and wealth accumulation

      Pranay Parikh, MD | Finance
    • From Moscow Mule to the opioid crisis: Unveiling the tragic legacy and urgent solutions

      Osmund Agbo, MD | Meds
    • From journalism to medicine: Unveiling the untold stories of patients’ medical conditions

      Veronica Bonales, MD | Physician
    • Unlocking resilience: a powerful journey from trauma to transformation [PODCAST]

      The Podcast by KevinMD | Podcast
    • Overcoming the lies of depression: Senator John Fetterman’s struggle with mental health

      Harvey Max Chochinov, MD, PhD | Conditions

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

CME Spotlights

From MedPage Today

Latest News

  • Schools Aren't Prepared to Treat Asthma Attacks
  • Closing the Diversity Gaps in Urologic Oncology Leadership
  • Certain NSCLC Patients May Be Able to Stop Immunotherapy at 2 Years
  • No Survival Benefit With Immune Checkpoint Inhibitor Rechallenge in Metastatic RCC
  • Happy Sleep, Happy Couple?

Meeting Coverage

  • Closing the Diversity Gaps in Urologic Oncology Leadership
  • Certain NSCLC Patients May Be Able to Stop Immunotherapy at 2 Years
  • No Survival Benefit With Immune Checkpoint Inhibitor Rechallenge in Metastatic RCC
  • Happy Sleep, Happy Couple?
  • Once-Nightly Narcolepsy Drug Preferred by Patients Over Twice-Nightly Dose
  • Most Popular

  • Past Week

    • Boxing legends Tyson and Foreman: powerful lessons for a resilient and evolving health care future

      Harvey Castro, MD, MBA | Physician
    • We need a new Hippocratic Oath that puts patient autonomy first

      Jeffrey A. Singer, MD | Physician
    • Is chaos in health care leading us towards socialized medicine? How physician burnout is a catalyst.

      Howard Smith, MD | Physician
    • A physician’s typical day, as envisioned by a non-clinician health care MBA: a satire

      Jennifer Lycette, MD | Physician
    • Decoding name displays in health care: Privacy, identification, and compliance unveiled

      Deepak Gupta, MD | Physician
    • The rising threat of lung cancer in Asian American female nonsmokers

      Alice S. Y. Lee, MD | Conditions
  • Past 6 Months

    • It’s time to replace the 0 to 10 pain intensity scale with a better measure

      Mark Sullivan, MD and Jane Ballantyne, MD | Conditions
    • “Is your surgeon really skilled? The hidden threat to public safety in medicine.

      Gene Uzawa Dorio, MD | Physician
    • Unveiling the hidden damage: the secretive world of medical boards

      Alan Lindemann, MD | Physician
    • Breaking the cycle of racism in health care: a call for anti-racist action

      Tomi Mitchell, MD | Policy
    • Revolutionize your practice: the value-based care model that reduces physician burnout

      Chandravadan Patel, MD | Physician
    • An inspiring tribute to an exceptional radiologist who made a lasting impact

      Kim Downey, PT | Conditions
  • Recent Posts

    • Revealing America’s expansion: the dark truth of Native American suffering and unjustified abuses

      Anonymous | Physician
    • Unlock financial freedom: The physician’s guide to lucrative multifamily syndications and wealth accumulation

      Pranay Parikh, MD | Finance
    • From Moscow Mule to the opioid crisis: Unveiling the tragic legacy and urgent solutions

      Osmund Agbo, MD | Meds
    • From journalism to medicine: Unveiling the untold stories of patients’ medical conditions

      Veronica Bonales, MD | Physician
    • Unlocking resilience: a powerful journey from trauma to transformation [PODCAST]

      The Podcast by KevinMD | Podcast
    • Overcoming the lies of depression: Senator John Fetterman’s struggle with mental health

      Harvey Max Chochinov, MD, PhD | Conditions

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...