International Journal for Quality in Health Care 16:i37-i43 (2004)
International Journal for Quality in Health Care vol. 16 Supplement 1 © International Society for Quality in Health Care and Oxford University Press 2004; all rights reserved
Using indicators to quantify the potential to improve the quality of health care
1 Health Services Research Group, Faculty of Health, University of Newcastle, Shortland, NSW,
2 School of Mathematical and Physical Sciences/Statistics, University of Newcastle, Callaghan, NSW,
3 The Australian Council On Healthcare Standards, Ultimo, NSW, Australia
Purpose. Although clinical indicators allow individual providers to monitor and improve their own performance and quality of care, another important role for the indicators is to provide comparative information across all providers. We show that the ‘league table’ approach is ineffective, and provide an alternative method that uses the comparative rates to quantify the potential for improvement at both the provider and the national level.
Data sources. The methods are applied to English and Australian hospital clinical indicators.
Methods. The key is to regard clinical indicators as screening tools that measure performance in one or more dimensions. All screening processes require explicit tests to determine whether the result should be classified as either positive (requires further investigation) or negative (requires continued monitoring). A clinical indicator will be defined as positive if any of the three following criteria are met: (1) large variation between all areas or hospitals, as defined by the 20th centile gains: requires improvement in the health care system; (2) large variation between strata (rural/urban, teaching/non-teaching, public/private, State): requires action in the relevant stratum; (3) outlier hospitals: requires quality improvement in the individual hospitals. Two techniques are used to determine whether any of the three criteria are positive: (1) empirical Bayesian estimation to calculate ‘shrunken’ rates; and (2) use of the 20th centile to quantify the potential gains or improvement.
Results. For 185 Australian indicators, 55 clinical indicators had system gains involving better outcomes for at least 1000 patients per indicator. Using a set of criteria and subjective judgement, we identified some key areas for quality improvement in Australia.
Conclusion. Ranking of hospitals does not quantify the potential gains that could be achieved. Indicators that measure health care processes should be reported by quantifying the potential gains, thus encouraging action. Estimating the gains across many indicators allows priorities to be established, such as identifying the areas with the greatest potential for improvement. The main tasks are to then provide the tools and resources to tackle those areas with the most gains.
Keywords: clinical indicators, empirical Bayesian shrinkage estimators, hierarchical models, league tables
Address reprint requests to R. W. Gibberd, Health Services Research Group, Faculty of Health, University of Newcastle, Shortland, NSW 2308, Australia. E-mail: robert.gibberd{at}newcastle.edu.au
Accepted for publication November 6, 2003.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  M. Coory and I. Scott Analysing low-risk patient populations allows better discrimination between high-performing and low-performing hospitals: a case study using inhospital mortality from acute myocardial infarction Qual. Saf. Health Care, October 1, 2007; 16(5): 324 - 328. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. H. Pham, J. Coughlan, and A. S. O'Malley The Impact Of Quality-Reporting Programs On Hospital Operations Health Aff., September 1, 2006; 25(5): 1412 - 1422. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R Sund and A Liski Quality effects of operative delay on mortality in hip fracture treatment Qual. Saf. Health Care, October 1, 2005; 14(5): 371 - 377. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. C. Williams, S. P. Schmaltz, D. J. Morton, R. G. Koss, and J. M. Loeb Quality of Care in U.S. Hospitals as Reflected by Standardized Measures, 2002-2004 N. Engl. J. Med., July 21, 2005; 353(3): 255 - 264. [Abstract] [Full Text] [PDF]
|
|