International Journal for Quality in Health Care 16:309-315 (2004)
International Journal for Quality in Health Care vol. 16 no. 4 © International Society for Quality in Health Care and Oxford University Press 2004; all rights reserved
A randomized controlled trial of league tables and control charts as aids to health service decision-making
Public Health and Epidemiology, University of Birmingham, Birmingham, UK
Objectives. Health service managers and other decision-makers are required to act on the basis of data. Little attention has been paid to the effects of data presentation on the decisions taken. This study uses a randomized controlled trial design to investigate the effects of two forms of data presentation—league tables and control charts—on health service decision-makers.
Methods. Directors of public health in 122 health authorities in the UK were mailed three case studies and a questionnaire. The case studies showed data on variations in mortality by health service provider. The questionnaire asked them to indicate whether they would take action as a result of the data and to identify the health service providers on whom they would take action. Participants were randomly allocated to receive the same data in the form of ranked histograms (league tables) or control charts.
Main outcome measure. The percentage of participants who would take action on health service providers.
Results. Fifty-seven questionnaires were returned. For each case study, respondents receiving data as league tables stated they would take action on significantly more health service providers than those receiving data as control charts: for the first case study, the percentages were 3.3% versus 1.8% (P < 0.001) for league tables and control charts, respectively; for the second case study, 15.9% versus 6.7% (P = 0.029), respectively; and for the third, 5.9% versus 0.7% (P = 0.002), respectively. Respondents receiving data as league tables were significantly more likely to request further information on case mix.
Conclusions. Compared with league tables, health service decision-makers identify fewer outliers for further action when performance data are presented as control charts. They also reduce the tendency to request further information. Using control charts rather than league tables for the routine presentation of comparative data would reduce over-investigation of unusual performance.
Keywords: decision-making, performance monitoring, statistical process control
Address reprint requests to Tom Marshall, Public Health and Epidemiology, University of Birmingham, Birmingham, UK. E-mail: t.p.marshall{at}bham.ac.uk
Accepted for publication March 25, 2004.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  A.M.E. Lintsen, D.D.M. Braat, J.D.F. Habbema, J.A.M. Kremer, and M.J.C. Eijkemans Can differences in IVF success rates between centres be explained by patient characteristics and sample size? Hum. Reprod., October 16, 2009; (2009) dep358v1. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G R Henderson, G E Mead, M L van Dijke, S Ramsay, M A McDowall, and M Dennis Use of statistical process control charts in stroke medicine to determine if clinical evidence and changes in service delivery were associated with improvements in the quality of care Qual. Saf. Health Care, August 1, 2008; 17(4): 301 - 306. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. A. Castilla, J. Hernandez, Y. Cabello, A. Lafuente, N. Pajuelo, J. Marqueta, B. Coroleu, and (Assisted Reproductive Technology Register of the Defining poor and optimum performance in an IVF programme Hum. Reprod., January 1, 2008; 23(1): 85 - 90. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. D Moloney, K. Bennett, and B. Silke Effect of an acute medical admission unit on key quality indicators assessed by funnel plots Postgrad. Med. J., October 1, 2007; 83(984): 659 - 663. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 T. Perneger Ten reasons to conduct a randomized study in quality improvement Int. J. Qual. Health Care, December 1, 2006; 18(6): 395 - 396. [Full Text] [PDF]
|
|
|
|
|
|
B Guthrie, T Love, T Fahey, A Morris, and F Sullivan Control, compare and communicate: designing control charts to summarise efficiently data from multiple quality indicators Qual. Saf. Health Care, December 1, 2005; 14(6): 450 - 454. [Abstract] [Full Text] [PDF]
|
|