The fallacy of doctor rating websites

April 18, 2008

John Grohol: “People who rate their doctors are likely to fall into one of two categories — they either had a horrible experience with them and want others to know, or they had a wonderful experience with them and want others to know. But most people who fall in between these two extremes and have run-of-the-mill experiences with the doctor will likely never rate, because they have little incentive to do so.”

Similar Posts:


KevinMD.com on Facebook


{ 4 comments }

1 Dr. R April 18, 2008 at 8:58 am

I find doctor ratings sites very useful. It allowed me to discover that my medical diploma from McGill University in Montreal came from “une boite de cracker jack.” I now have a site called IrateMds.com about scifi doctors. I worry that I may be an evil Cylon or a Sith lord.

2 Anonymous April 18, 2008 at 9:30 am

I would imagine this is equally true for
hospital-rating systems such as Press-Gainey. While their sample size is much greater than doctor-rating websites, the methodology suffers from the same selection bias. Yet Press-Gainey insists that the methodology is rigorously tested and scientifically valid. Intuitively, I can’t imagine how random phone surveys would generate equivalent data as self-directed mail-in or web-based responses for the reasons stated in the above post. As my knowledge of statistics is sorely lacking, I would welcome any scientific defense of the Press-Gainey methodology – until then, I still feel their variable survey methodology is inherently biased in favor of hospitals using random phone surveys.

3 TheHospitalPharmacist April 18, 2008 at 3:17 pm

I think this is true for any voluntary rating system.

4 Anonymous April 18, 2008 at 4:34 pm

True, though Press Gainey claims to be statistically valid and unbiased unlike the doctor survey websites which make no such claims.

Comments on this entry are closed.

Previous post: My take: PCP influence, stroke, ECGs/MIs, doctor shortage

Next post: Skin in the game for electronic records

Site Meter