Stories help the public make sense of evidence

Recently, I presented Family Medicine Grand Rounds at Georgetown University School of Medicine on resolving conflicts between screening guidelines. During the question and answer session, Department Chair James Welsh, MD asked how evidence from carefully conducted clinical trials can possibly overcome powerful emotional stories of “saved lives.”

I answered that evidence-based medicine’s supporters must fight anecdotes with anecdotes. For every person who believes his or her life was extended by a PSA test or a mammogram, statistics show that many more are temporarily or permanently injured as a result – and their stories matter too. As Kevin Pho, MD wrote about the USPSTF’s recent prostate cancer guideline, “Task Force advocates will need to put a human face on the complications stemming from prostate cancer screening” in order to convince physicians and patients that it’s okay to stop.

Indeed, news stories about PSA test-related complications such as this one by Associated Press writer Marilynn Marchione will go a long way in balancing the scales.

An insightful commentary published in JAMA last month took this point one step further by asserting that narratives deployed to support evidence-based guidelines should include not only patients’ stories, but the story of the guideline developers themselves:

Typically, experts present a “clean” version of their findings without any narrative about how they made sense of the data. This fulfills the scientific virtues of objectivity, coherence, and synthesis. When the USPSTF released its report on screening mammography to much controversy, it included no narrative about the process. Only later was the story of the task force deliberations revealed. This narrative, with multiple characters operating within the context of historical precedents, timing mandates, and a messy political milieu, created a substantially more compelling perspective. But the account came too late to engage a confused and angry public with the task force’s conclusions.

Guideline developers could include as part of their reports the narrative of their internal workings: We started with what we knew, we looked at the evidence, we revisited our hypotheses, we argued about the findings, and ultimately we acted here and now because it was prudent, but there are more data to come, and here is what we plan to do as we learn more. Such stories could increase trust and therefore improve the translation of evidence for individual use and public policies.

I attended both of the Task Force’s 2008 meetings when screening mammography was debated, and the difference between them spoke volumes. During the first meeting, the panel deadlocked multiple times over whether to recommend for (“B”) or recommend against routinely (“C”) mammograms for women in their 40s. Both sides made impassioned arguments in favor of their points of view, and after running hours beyond the time allotted for discussion, they finally admitted that they were unable to reach a consensus. In contrast, at the second meeting when the results of a new decision analysis were presented, there was – to everyone’s great relief – near-unanimity that the benefits and harms of screening were closely balanced in this age group. (Incidentally, the Canadian Task Force on Preventive Health Care recently concurred with the USPSTF’s 2009 recommendations.)

Given the potential for narratives to humanize guidelines for the public, it was disappointing that the USPSTF’s first Report to Congress offered a thoroughly sanitized description of the lengthy and challenging process by which it identified and prioritized research gaps in clinical preventive services. This process, which I participated in as a medical officer, consisted of a series of spirited debates over more than two years about thorny questions such as: 1) Is there an objective, defensible way to prioritize certain preventive services more than others? 2) Is it more important to support research on services with insufficient evidence that are already in widespread practice (e.g., PSA tests), or less commonly provided services with potentially large benefits (e.g., CT scans for lung cancer)? Unfortunately, the Report doesn’t even begin to hint at how we grappled with these and other contentious issues, much less the multiple impasses that were reached and eventually overcome.

Consequently, I couldn’t agree more with the elegantly stated conclusion of JAMA commentators Drs. Zachary Meisel and Jason Karlawish:

Stories help the public make sense of population-based evidence. Guideline developers and regulatory scientists must recognize, adapt, and deploy narrative to explain the science of guidelines to patients and families, health care professionals, and policy makers to promote their optimal understanding, uptake, and use.

Kenneth Lin is a family physician who blogs at Common Sense Family Doctor.

Submit a guest post and be heard on social media’s leading physician voice.

email

  • Michal Haran

    So true, 
    “ Typically, experts present a “clean” version of their findings without any narrative about how they made sense of the data. This fulfills the scientific virtues of objectivity, coherence, and synthesis. ” 

    Evidence based medicine is supposed to be objective and bias-free, but it’s not and never will be. The people who develop the guidelines are like all people influenced by their preconceptions, emotions, hopes, fears and the expectations of the society they live in among many more factors that are not pure science. Even pure science is influenced by such factors to some extent. 
    Medicine can not be emotion-free. Emotions are the driving force in what we do as physicians, the clinical encounter with our patients and even the passion we have for our research. 
    Reducing the clinical process to what is objective and evidence based, turns medicine into a technocratic Procrustean bed, unfit for people-physician and patients alike. 
    Physics is one of the most pure and obejective sciences.The founder of the Tata institute of science, in Mumbai, a world renown physicist  wrote- ”I know quite clearly what I want out of life. Life and my
    emotions are the only thing I am conscious about. I love the consciousness of
    life and I want as much of it as I can get. But the span of one’s life is
    limited. What comes after death no one knows, nor do I care. Since, therefore I
    can’t increase the content of life by increasing its duration; I will increase
    it by increasing its intensity. Art, music, poetry and everything else that I
    do all have this one purpose-increasing the intensity of my consciousness of
    life.

     Homi Bhabba.

    If a physicist feels that way, we as physicians, who have a daily encounter with people, definitely should.

  • http://twitter.com/PatientCommando Patient Commando

    Every patient has a story. The very act of telling that story makes one feel good. When the story is compelling or funny, when it comes from a place of honesty and is well told, it has the power to change lives.

    Authenticity is the critical factor. The narrative of a patient’s lived illness experience enriches the understanding and appreciation of what it means to cope with a life limiting condition. And you’ll obviously find the power of the personal story being used by fund raisers, pharmaceuticals, equipment manufacturers, charities etc. But its important to be mindful of the difference between a “testimonial” and a story.

    The patient story must be honoured by those using and those listening, watching or reading. Many people will be able to see through slick adaptations with hidden agendas. And to think that you need to “fight anecdotes with anecdotes” misses the point.  Reasonable discourse about such difficult subjects isn’t going to happen on a battlefield, but must take place in a respectful environment.

    I know I might be accused of shameless self-promotion, but I invite you to visit my website http://www.patientcommando.com where you can browse through the most diverse collection of patient stories. Non-aligned platforms such as these are where the authentic stories are appearing, where patients can feel safe to share their most intimate emotions.

    I would welcome guideline developers and any healthcare professional to share their own stories, to encourage their patients to share their stories on our platform, free from political hyperbole and bias. If you want to encourage better understanding of “evidence” then you should take it off a battlefield and use tools such as  culture and literary expression as a bridge between all the stakeholders.

    Bottom line, yes, patients need to have a better appreciation for your experience. And they’ll listen provided the story is meaningful and honest.

    Zal Press
    http://www.patientcommando.com

Trending