International Journal for Quality in Health Care 15:251-259 (2003)
© 2003 International Society for Quality in Health Care
Paper |
Using standardized patients to measure professional performance of physicians
1Department of Family Medicine, Université de Montréal
2Unité de Recherche Évaluative, Centre de Recherche du Centre Hospitalier de l’Université de Montréal
3Department of Social and Preventive Medicine and Groupe de Recherche Interdisciplinaire en Santé (GRIS), Université de Montréal, Québec
4Équipe de Recherche en Médecine Familiale, Cité de la Santé, Laval, Québec
5Department of Family Medicine, Université Laval, Sainte-Foy, Québec Canada
6Aventis Pharma, Laval, Québec, Canada
Objective. To determine the nature of inaccuracies likely to occur when standardized patients (SPs) are used to measure physician behaviour and to evaluate the potential impact of these inaccuracies on estimates of physician performance.
Design. Secondary analysis from a randomized controlled trial.
Setting. Family physicians’ offices.
Study participants. Eighteen individuals, each portraying one of two patient scenarios, made a total of 179 visits to 92 family physicians who were participating in a separate randomized controlled trial to evaluate the impact of an educational workshop on implementation of preventive guidelines.
Main outcome measures. Accuracy of SPs’ portrayal of the assigned scenarios and accuracy of their coding of physician performance, determined on the basis of audiotapes of the visits and correlated with indicators of physicians’ preventive practices.
Results. Accuracy of portrayal of the patient scenario was 84.8% for the male SPs and 93.5% for the female SPs. Inaccuracies in portrayal had no impact on physician performance scores. Accuracy of coding of physician performance was 90.5% for the female SPs (kappa = 0.66) and 90.1% for the male SPs (kappa = 0.68). Coding inaccuracies occurred most frequently for assessment of alcohol consumption and advice against smoking.
Conclusion. SPs can provide valid information about physicians’ professional performance. However, standardization of their activities must not be taken for granted. It may be more difficult to obtain standardized coding for counselling activities, an aspect of physician visits for which SPs are particularly appropriate.
Keywords: outcome measures, physician performance, quality of care, standardized patients
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  P. Giesen, R. Ferwerda, R. Tijssen, H. Mokkink, R. Drijver, W. van den Bosch, and R. Grol Safety of telephone triage in general practitioner cooperatives: do triage nurses correctly estimate urgency? Qual. Saf. Health Care, June 1, 2007; 16(3): 181 - 184. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R J Lilford, M A Mohammed, D Braunholtz, and T P Hofer The measurement of active errors: methodological issues Qual. Saf. Health Care, December 1, 2003; 12(90002): ii8 - 12. [Abstract] [Full Text] [PDF]
|
|