International Journal for Quality in Health Care 11:21-28 (1999)
© 1999 International Society for Quality in Health Care
Development and application of a generic methodology to assess the quality of clinical guidelines
0 Health Care Evaluation Unit, St George's Hospital Medical School, London, UK
1 Health Services Research Unit, University of Aberdeen, UK
2 Department of General Practice and Primary Care, St Bartholomew's and the Royal London School of Medicine and Dentistry, London, UK
Correspondence to: F Cluzeau, Health Care Evaluation Unit, St George's Hospital Medical School, Cranmer Terrace, London SW17 0RE, UK
e-mail: F.Cluzeau@SGHMS.ac.uk
Background. Despite clinical guidelines penetrating every aspect of clinical practice and health policy, doubts persist over their ability to improve patient care. We have designed and tested a generic critical appraisal instrument, that assesses whether developers have minimized the biases inherent in creating guidelines, and addressed the requirements for effective implementation.
Design. Thirty-seven items describing suggested predictors of guideline quality were grouped into three dimensions covering the rigour of development, clarity of presentation (including the context and content) and implementation issues. The ease of use, reliability and validity of the instrument was tested on a national sample of guidelines for the management of asthma, breast cancer, depression and coronary heart disease, with 120 appraisers. A numerical score was derived to allow comparison of guidelines within and between diseases.
Results. The instrument has acceptable reliability (Cronbach's 
coefficient, 0.68-0.84; intra-class correlation coefficient, 0.82-0.90). The results provided some evidence of validity (Pearson's correlation coefficient between appraiser's dimension scores and their global assessment was 0.49 for dimension one, 0.63 for dimension two and 0.40 for dimension three). The instrument could differentiate between national and local guidelines and was easy to apply. There was variation in the performance of guidelines with most not achieving a majority of criteria in each dimension.
Conclusions.Use of this instrument should encourage developers to create guidelines that reflect relevant research evidence more accurately. Potential users or groups adapting guidelines for local use could apply the instrument to help decide which one to follow. The National Health Service Executive is using the instrument to assist in deciding which guidelines to recommend to the UK National Health Service. This methodology forms the basis of a common approach to assessing guideline quality in Europe.
Keywords:appraisal, clinical guidelines, instrument, quality, reliability, validity
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  D. Warwick, O. E. Dahl, and W. D. Fisher Orthopaedic thromboprophylaxis: LIMITATIONS OF CURRENT GUIDELINES J Bone Joint Surg Br, February 1, 2008; 90-B(2): 127 - 132. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. S. Pignotti and G. Donzelli Perinatal Care at the Threshold of Viability: An International Comparison of Practical Guidelines for the Treatment of Extremely Preterm Births Pediatrics, January 1, 2008; 121(1): e193 - e198. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H.-T. Yu, M. L. Dylan, J. Lin, and R. W. Dubois Hospitals' compliance with prophylaxis guidelines for venous thromboembolism Am. J. Health Syst. Pharm., January 1, 2007; 64(1): 69 - 76. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. Uhlig, E. M. Balk, J. Lau, and A. S. Levey Clinical Practice Guidelines in nephrology--for worse or for better Nephrol. Dial. Transplant., May 1, 2006; 21(5): 1145 - 1153. [Full Text] [PDF]
|
|
|
|
 |
|
 C. Burton, L. Pennington, H. Roddam, I. Russell, D. Russell, K. Krawczyk, and H. A Smith Assessing adherence to the evidence base in the management of poststroke dysphagia Clinical Rehabilitation, January 1, 2006; 20(1): 46 - 51. [Abstract] [PDF]
|
|
|
|
 |
|
 Ottawa Panel Members, Ottawa Methods Group, L. Brosseau, G. A Wells, P. Tugwell, M. Egan, C.-J. Dubouloz, L. Casimiro, V. A Robinson, L. Pelland, et al. Ottawa Panel Evidence-Based Clinical Practice Guidelines for Therapeutic Exercises and Manual Therapy in the Management of Osteoarthritis Physical Therapy, September 1, 2005; 85(9): 907 - 971. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. M. Boyd, J. Darer, C. Boult, L. P. Fried, L. Boult, and A. W. Wu Clinical Practice Guidelines and Quality of Care for Older Patients With Multiple Comorbid Diseases: Implications for Pay for Performance JAMA, August 10, 2005; 294(6): 716 - 724. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A Hutchings, R Raine, C Sanderson, and N Black An experimental study of determinants of the extent of disagreement within clinical guideline development groups Qual. Saf. Health Care, August 1, 2005; 14(4): 240 - 245. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Lindberg, M. Lind, S. Petersson, and S. Wilhelmsson The use of clinical guidelines for asthma, diabetes, and hypertension in primary health care Int. J. Qual. Health Care, June 1, 2005; 17(3): 217 - 220. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Vlayen, B. Aertgeerts, K. Hannes, W. Sermeus, and D. Ramaekers A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit Int. J. Qual. Health Care, June 1, 2005; 17(3): 235 - 242. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N. Boluyt, C. R. Lincke, and M. Offringa Quality of Evidence-Based Pediatric Guidelines Pediatrics, May 1, 2005; 115(5): 1378 - 1391. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. Pennington, H. Roddam, C. Burton, I. Russell, and D. Russell Promoting research use in speech and language therapy: a cluster randomized controlled trial to compare the clinical effectiveness and costs of two training strategies Clinical Rehabilitation, April 1, 2005; 19(4): 387 - 397. [Abstract] [PDF]
|
|
|
|
|
|
B. Fervers, J. S. Burgers, M. C. Haugh, M. Brouwers, G. Browman, F. Cluzeau, and T. Philip Predictors of high quality clinical practice guidelines: examples in oncology Int. J. Qual. Health Care, April 1, 2005; 17(2): 123 - 132. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R Thomson Challenges for an international guidelines collaboration Qual. Saf. Health Care, December 1, 2004; 13(6): 409 - 410. [Full Text] [PDF]
|
|
|
|
 |
|
 P. Dodek, S. Keenan, D. Cook, D. Heyland, M. Jacka, L. Hand, J. Muscedere, D. Foster, N. Mehta, R. Hall, et al. Evidence-Based Clinical Practice Guideline for the Prevention of Ventilator-Associated Pneumonia Ann Intern Med, August 17, 2004; 141(4): 305 - 313. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J.S. Burgers, B. Fervers, M. Haugh, M. Brouwers, G. Browman, T. Philip, and F.A. Cluzeau International Assessment of the Quality of Clinical Practice Guidelines in Oncology Using the Appraisal of Guidelines and Research and Evaluation Instrument J. Clin. Oncol., May 15, 2004; 22(10): 2000 - 2007. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R Hasenfeld and P G Shekelle Is the methodological quality of guidelines declining in the US? Comparison of the quality of US Agency for Health Care Policy and Research (AHCPR) guidelines with those published subsequently Qual. Saf. Health Care, December 1, 2003; 12(6): 428 - 434. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Barkun, M. Bardou, J. K. Marshall, and for the Nonvariceal Upper GI Bleeding Consensus Co Consensus Recommendations for Managing Patients with Nonvariceal Upper Gastrointestinal Bleeding Ann Intern Med, November 18, 2003; 139(10): 843 - 857. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. N. Shiffman, P. Shekelle, J M. Overhage, J. Slutsky, J. Grimshaw, and A. M. Deshpande Standardized Reporting of Clinical Practice Guidelines: A Proposal from the Conference on Guideline Standardization Ann Intern Med, September 16, 2003; 139(6): 493 - 498. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R Foy and P Warner About time: diagnostic guidelines that help clinicians Qual. Saf. Health Care, June 1, 2003; 12(3): 205 - 209. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W. W Rosser Nutritional advice in Canadian family practice Am. J. Clinical Nutrition, April 1, 2003; 77(4): 1011S - 1015. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. S. BURGERS, R. GROL, N. S. KLAZINGA, M. MAKELA, and J. ZAAT Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs Int. J. Qual. Health Care, February 1, 2003; 15(1): 31 - 45. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. H. Harpole, M. J. Kelley, G. Schreiber, E. M. Toloza, J. Kolimaga, and D. C. McCrory Assessment of the Scope and Quality of Clinical Practice Guidelines in Lung Cancer Chest, January 1, 2003; 123(1_suppl): 7S - 20S. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 I. D. Graham, S. Beardall, A. O. Carter, J. Glennie, P. C. Hebert, J. M. Tetroe, F. A. McAlister, S. Visentin, and G. M. Anderson What is the quality of drug therapy clinical practice guidelines in Canada? Can. Med. Assoc. J., July 1, 2001; 165(2): 157 - 163. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W. W. Rosser, D. Davis, and E. Gilbart Promoting effective guideline use in Ontario Can. Med. Assoc. J., July 1, 2001; 165(2): 181 - 182. [Full Text] [PDF]
|
|
|
|
 |
|
 Y. Lacasse, I. Ferreira, D. Brooks, T. Newman, and R. S. Goldstein Critical Appraisal of Clinical Practice Guidelines Targeting Chronic Obstructive Pulmonary Disease Arch Intern Med, January 8, 2001; 161(1): 69 - 74. [Abstract] [Full Text] [PDF]
|
|