International Journal for Quality in Health Care 16:65-72 (2004)
© International Society for Quality in Health Care and Oxford University Press 2004; all rights reserved
Which data source in clinical performance assessment? A pilot study comparing self-recording with patient records and observation
Center for Quality of Care Research and
1 Department of Medical Informatics, University of Nijmegen, The Netherlands
Objective. A pilot study aimed to determine the extent to which each of three data sources could provide complete and reliable data for valid assessment of clinical performance.
Design. Clinical decisions taken in 168 consultations by seven family physicians were reviewed against guidelines for 15 clinical conditions. In total, 206 criteria were reviewed using three sources: medical records, observation in surgery, and structured self-recording by the physicians.
Setting and participants. Seven family practices in the Netherlands.
Main measures. Scores (%) of data recorded/total were obtained for each method. Kappa scores for the agreement between the three data sources were also obtained.
Results. Medical record examination provided 40%, observation 72%, and physician self-recording 95% of the data required for the review against guidelines. Nine per cent of the clinical decisions could be reviewed when using medical records, 46% when using observation data, and 69% when using data from prospective self-recording. In particular, decisions in the area of patient education and diagnostic examinations could not be reviewed validly using medical records only. Kappa agreements between the data available from the three sources as well as between the review results appeared to be 0.79.
Conclusions. Medical records alone only supply sufficient information for the review of a very limited set of clinical decisions. Physician self-recording has significantly more potential for valid review of a broad range of clinical decisions. Furthermore, self-recording seems a reliable data collection method that deserves further research.
Keywords: clinical decision making, clinical practice guidelines, data collection methods, performance assessment
Accepted for publication September 4, 2003.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  P. Tsasis and S. M Owen Using the balanced scorecard in the development of community partnerships Health Serv Manage Res, February 1, 2009; 22(1): 33 - 38. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Tsasis and B. Harber Using the balanced scorecard to mobilize human resources in organizational transformation Health Serv Manage Res, May 1, 2008; 21(2): 71 - 80. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Giesen, M. Willekens, H. Mokkink, J. Braspenning, W. Van Den Bosch, and R. Grol Out-of-hours primary care: development of indicators for prescribing and referring Int. J. Qual. Health Care, October 1, 2007; 19(5): 289 - 295. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Y. Rowe, M. A. Olewe, D. G. Kleinbaum, J. E. McGowan Jr, D. A. McFarland, R. Rochat, and M. S. Deming The influence of observation and setting on community health workers' practices Int. J. Qual. Health Care, August 1, 2006; 18(4): 299 - 305. [Abstract] [Full Text] [PDF]
|
|