Skip Navigation


International Journal for Quality in Health Care Advance Access originally published online on March 30, 2008
International Journal for Quality in Health Care 2008 20(3):155-161; doi:10.1093/intqhc/mzn010
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
20/3/155    most recent
mzn010v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Groene, O.
Right arrow Articles by Bartels, P.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Groene, O.
Right arrow Articles by Bartels, P.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© The Author 2008. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved

The World Health Organization Performance Assessment Tool for Quality Improvement in Hospitals (PATH): An Analysis of the Pilot Implementation in 37 Hospitals

Oliver Groene1,2,3, Niek Klazinga4,5, Vahé Kazandjian6,7, Pierre Lombrail8,9 and Paul Bartels10

1 Quality of Health Systems and Services, WHO Regional Office for Europe, Copenhagen, Denmark
2 Avedis Donabedian Research Institute, Autonomous University of Barcelona, Spain
3 CIBER Epidemiology and Public Health (CIBERESP), Spain
4 Department of Social Medicine, University of Amsterdam, The Netherlands
5 OECD Quality Indicator Project, Paris, France
6 Johns Hopkins University, Baltimore, MD, USA
7 Center for Performance Sciences, Elkridge, MD, USA
8 Department of Public Health, University of Nantes, Nantes, France
9 Medical Information, Evaluation and Public Health Unit, Teaching Hospital of Nantes, France
10 Unit for Clinical Quality and Patient Safety, Central Jutland Region, Danish National Indicator Project, Aarhus, Denmark

Address reprint requests to: Oliver Groene, Avedis Donabedian Research Institute, Autonomous University of Barcelona, Spain and CIBER Epidemiology and Public Health (CIBERESP). Tel: +34-93-207-66-08; Fax: +34-93-459-38-64; E-mail: ogroene{at}fadq.org


    Abstract
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
Objective. To evaluate the pilot implementation of the World Health Organization Performance Assessment Tool for Quality Improvement in hospitals (PATH).

Design. Semi-structured interviews with regional/country coordinators and Internet-based survey distributed to hospital coordinators.

Setting. A total of 37 hospitals in six regions/countries (Belgium, Ontario (Canada), Denmark, France, Slovakia, KwaZulu Natal (South Africa)).

Participants. Six PATH regional/country coordinators and 37 PATH hospital coordinators.

Intervention. Implementation of a hospital performance assessment pilot project.

Outcome measure. Experience of regional/country coordinators (structured interviews) and experience of hospital coordinators (survey) with the pilot implementation.

Results. The main achievement has been the collection and analysis of data on a set of indicators for comprehensive performance assessment in hospitals in regions and countries with different cultures and resource availability. Both regional/country coordinators and hospital coordinators required seed funding and technical support during data collection for implementation. Based on the user evaluation, we identified the following research and development tasks: further standardization and improved validity of indicators, increased use of routine data, more timely feedback with a stronger focus on international benchmarking and further support on interpretation of results.

Conclusions. Key to successful implementation was the embedding of PATH in existing performance measurement initiatives while acknowledging the core objective of the project as a self-improvement tool. The pilot test raised a number of organizational and methodological challenges in the design and implementation of international research on hospital performance assessment. Moreover, the process of evaluating PATH resulted in interesting learning points for other existing and newly emerging quality indicator projects.

Keywords: evaluation, hospitals, indicators, performance assessment, World Health Organization



    Introduction
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
Throughout Europe and worldwide, hospital performance assessment is becoming a common topic [1, 2] and is one of the main issues addressed in the upcoming World Health Organizations' (WHO) Regional Office for Europe Health Systems Conference in June 2008 [3]. Motivated by concerns such as supporting professionals in quality management, improving accountability of hospital boards to purchasers or informing the public, many governments have initiated projects on hospital performance assessment. In addition to the governmental sector, non-governmental institutions and the private sector are engaging in hospital performance assessment and a wide range of strategies, mechanisms for participation and feedback mechanisms is being applied in the projects presented in the international literature [4]. While the Organisation for Economic Cooperation and Development (OECD) is coordinating an international project to compare health system performance of its member states (the Health Care Quality Indicator (HCQI) Project) [5], few initiatives exist to compare hospital performance internationally [6].

In 2003, the WHO Regional Office for Europe initiated a project to provide Member States with a practical tool to monitor and improve the quality of hospitals (PATH) [7, 8]. PATH was designed as an internal tool for quality improvement in hospitals to support hospitals in collecting data on their performance, identifying how they are doing in comparison to their peer group and initiating quality improvement activities [9]. The PATH conceptual model, which is based on six dimensions (clinical effectiveness, efficiency, staff orientation, responsive governance, safety and patient centeredness) and 18 performance indicators, was pilot tested between February 2004 and August 2005, with data collection taking place between May 2004 and February 2005. Regions and countries participating in the pilot were selected on a convenience basis; all had contributed to the PATH development and were able to comply with the requirements. Regional and country coordinators were responsible for the selection of piloting hospitals based on previously defined criteria such as considering geographical and institutional diversity (university and community hospitals). Out of the 66 hospitals from eight regions/countries initially registered for participation in the pilot, 51 hospitals from six regions/countries completed the self-assessment and reported data through their country coordinator. Participating regions/countries were: Belgium, Ontario (Canada), Denmark, France, Slovakia and KwaZulu Natal (South Africa). Data was reported back to hospitals between November 2005 and March 2006. Hospitals were compared to peer-groups, which were derived from an assessment of hospitals structural characteristics, and a performance report was prepared for each participating hospital, including an analysis for each indicator, an analysis of each performance dimension and an overall table indicating the number of indicators below, on average or above the performance in the peer-group [10].

In view of the diverse experience in implementing the project at regional/national and hospitals level and considering the recent initiatives in European health systems to engage in external hospital performance assessment, we decided to carry out a systematic evaluation of the PATH pilot test. The objective was to identify factors facilitating or obstructing implementation and to involve users at hospital level in the revision of indicator descriptions, data collection and reporting procedures.


    Methods
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
The evaluation addressed two levels: PATH coordinators at regional/country level and PATH coordinators at hospital level. The experience of regional/country coordinators was captured by a semi-structured interview carried out between April and May 2006, addressing the context (project organization and links to existing quality initiatives), process (reporting of results, difficulties and adaptations of indicators) and perceived benefits and future plans (resources required, selling points and limiting factors). Interview transcripts were reviewed for emerging themes, which were then summarized and compared for each region/country.

The experience of hospital coordinators was captured by a standardized questionnaire, which was filled in online in June 2006. The questionnaire consisted of three parts. The first part consisted of 10 items using a five-point Likert-type scale ranging from a score of 1 for ‘strongly agree’ to 5 for ‘strongly disagree’. These 10 items address the overall experience with the pilot test, such as testing underlying assumptions of PATH, assessing reporting methods and assessing intentions for future use. In the second section of the questionnaire, each of the indicators was assessed in terms of data availability, clarity of descriptive sheets, burden of data collection and indications on the need for revision, using a dichotomous scale. For these criteria, we searched for major agreement (>80% of the respondents) or disagreement (<50%) between the respondents in order to set priorities for the development of the project. Due to the fact that Belgian hospitals contributed with a much higher number of hospitals to the pilot test and to the evaluation, a sensitivity analysis was carried out and data were analysed separately for the whole data base (all hospitals) and without the Belgian hospitals. Since this analysis did not reveal major differences, we report in this paper only the data for the whole data base. Additional tests for statistical significance were not carried due to the small sample size. Finally, the hospital questionnaire included three textboxes for comments on difficulties in data collection, the use of the results and recommendations for improving PATH.


    Results
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
In Table 1, we indicate the number of hospitals participating from each region/country in the PATH pilot test and the PATH evaluation. All regional and country coordinators (6 out of 6) participated in the semi-structured interviews for the evaluation and 37 (73%) out of the 51 hospitals that participated in the pilot test filled in the electronic evaluation questionnaire.


View this table:
[in this window]
[in a new window]

 
Table 1 Regions/countries and hospitals participating in the pilot test and the evaluation

 
Evaluation at regional/national level
Results of the semi-structured interviews with regional/country coordinators were summarized by main theme (context, process of implementation and benefits and future development) based on the conceptual outline of the interview guideline.


    Context
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
A coordinator was appointed for each region/country to facilitate contacts with hospitals and act as an interface between WHO and the participating institutions. In four of the six regions/countries (Belgium, France, Slovakia and KwaZulu Natal (South Africa)), the PATH coordinator had a strong link to governmental activities/structures. Hospitals were selected by different means, usually by open calls (Belgium, France, Slovak Republic) or by directly establishing a contact with hospital managers (Ontario (Canada), KwaZulu Natal (South Africa)). While resource requirements differed, seed funding to kick start the project, convene meetings and workshops, distribute and translate working material were considered indispensable in all countries.

In all regions/countries, PATH was linked to some extent to existing initiatives, in some of which this yielded benefits, in others the project suffered from competition. For example, in France, parallel to piloting PATH, another performance indicator project (COMPAQ) was introduced, which caused some competition. In Ontario (Canada) and Denmark, well-established systems for hospital performance assessment were already in place, and it was more difficult to find a niche for the PATH project. In the Slovak Republic, the ministerial agenda on quality improvement and performance assessment provided a good environment and opportunities to improve visibility of PATH and involvement of hospitals.


    Process of implementation
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
A general difficulty reported by the regional/country coordinators was the lack of personnel, expertise and time for participating hospitals to collect data. Furthermore, competing priorities and reorganizations in hospitals endangered the project, in particular, if participation was not solely on a voluntary basis. In some cases (Ontario (Canada) and Denmark), some of the PATH indicators were already collected with slightly different definitions in existing initiatives, which caused major problems and led either to a revision or exclusion of the indicator.

The second general issue was that the International Statistical Classification of Diseases and Related Health Problems (ICD, 10th edition) codes and the Canadian Classification for Health Interventions (CCI) codes for the selected tracer conditions/procedures were not provided timely and sufficiently standardized enough resulting in local adaptations of the indicators. Certain issues addressed by the indicators were felt to be too vague and difficult to operationalize (i.e. definition of health promotion activities that promote healthy behaviour).

Feedback to hospitals was organized in different ways (such as electronic or print distribution, teleconferences or workshops), depending on the resources available in different regions/countries. Regional/country coordinators mentioned that not all aspects of the performance reports were fully understood by the hospital coordinators, particularly those parts attempting to address the assessing of performance dimensions or overall performance.


    Benefits and future development
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
One of the benefits of participating in PATH stated by regional/country coordinators was that the PATH conceptual framework facilitated integrating different quality assessment activities (such as quality improvement activities in different departments or initiated by different professional groups) and led to improved knowledge on data systems available in the hospital (e.g. by integrating data from clinical databases, human resources databases and databases used for billing of services rendered in the hospital).

In some regions/countries (Belgium, Slovakia), PATH was a stepping stone for further developing quality indicator projects. In other countries (Denmark, France, KwaZulu Natal (South Africa)), it was not very clear yet whether the project can be continued in the future, due to competing and overlapping projects. In Ontario (Canada) and in Denmark, due to the well-established system in place, participation in PATH seems only feasible if it focuses much stronger on international comparisons and improved validity. Different stages of development of existing systems, resource availability and cultural differences between regions and countries may slow down further implementation of PATH. For example, at hospital level PATH may require a research assistant and specialized data capturers and not all institutions may be able to release resources to provide these human resources. In addition, in some regions/countries hospitals will expect some sort of remuneration to continue in the project, whereas in others hospitals would be expected to contribute from their own budget.

Evaluation of hospital experience
Of the 51 hospitals participating in the PATH pilot test, 37 (73%) filled in the electronic questionnaire.


    Hospitals' general experience with pilot implementation
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
Table 2 shows the hospitals' responses to 10 Likert-scaled questions reflecting the general experience with the pilot test.


View this table:
[in this window]
[in a new window]

 
Table 2 General experience with the PATH pilot test in 37 hospitals

 
Question 1 to 4 addressed the main orientations of the PATH conceptual model (for details on these orientations, see reference 9): There was high agreement among hospital coordinators that PATH is a useful tool to (i) raise awareness on different quality dimensions, (ii) address interrelations between indicators and (iii) integrate different databases in the hospital. However, there was less agreement on the appropriateness of the burden of data collection.

Questions 5 to 7 addressed the tools to report results to users (indicator-specific comparison, relative performance index, overall performance index): While in general users assessed the way of reporting of results rather positive, a number of observations can be made. The perceived usefulness decreases from the indicator-specific comparisons (mean 2.65 (1.36 SD)), over the relative performance index (2.89 (1.51)) to the overall performance index (2.97 (1.59)). Secondly, some of the qualitative remarks in the questionnaire suggest that the relative performance index and overall performance index were not fully understood.

Questions 8 to 10 addressed the context of implementing PATH in the pilot phase and in the future. ‘Competitiveness of the tool’ receives the second lowest evaluation (3.24 (1.44)); however, this does not seem to be strongly associated with the wish to participate in the next round of data collection (2.78 (1.8)) or the recommendations to other hospitals to use the tool (2.76 (1.66)).


    Hospitals' assessment of PATH indicators
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
PATH hospital coordinators assessed each of the indicators according to four criteria: whether data was collected in their hospital, whether the descriptive sheets were clear, whether the burden of data collection was high and whether the indicator should be reconsidered (Table 3). We were interested in identifying major agreement (>80%) and disagreement (<50%) between hospital responses to these criteria in order to set priorities for the development of the project.


View this table:
[in this window]
[in a new window]

 
Table 3 Assessment of the PATH indicators by 37 hospitals

 
None of the hospitals reported on all of the 18 indicators in the PATH set; however, hospitals did collect indicators reflecting the overall PATH conceptual model and not, for example, only those indicators related to clinical effectiveness. Indicators collected by most (>80%) of the hospitals were the following: caesarean section rate, mortality rate for selected tracers, length of stay for selected tracers, inventory on stock, surgical theatre use, training expenditure and absenteeism rate.

In terms of the descriptive sheets provided to the indicators, many hospitals judged the definitions to be not sufficiently specific for their operational purpose. Only for one indicator (mortality), more than 80% of the hospitals agreed that the descriptive sheet was clear. There were major disagreements regarding the definitions for three indicators: training expenditure, health promotion budget and patient-centeredness.

Regarding the burden of data collection, there was major agreement that for four indicators, the burden of data collection was too high: prophylactic antibiotic use, surgical theatre use, training expenditure and absenteeism.

In terms of the need to reconsider some of the PATH indicators for future application, respondents did not fully agree in identifying indicators. However, a high proportion of users suggested reconsidering the following indicators: readmission, surgical theatre use, training expenditure, health promotion budget and patient-centeredness.

We also observe that for the four least frequently collected indicators (day surgery, admission after day surgery, needle-injuries and work-related injuries), the descriptive sheets were considered relatively clear and the burden of data collection not very high. Decisions to collect indicators may thus be more motivated by local practices and organizational priorities rather than data collection issues.


    Discussion
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
We evaluated the experience with pilot implementing the PATH project at regional/national and hospital level and identified many contextual factors that possibly hinder or facilitate the implementation of a hospital performance assessment project. We also gathered useful data that helped us in the design of the strategic directions and operational processes for the project. A limitation of the evaluation is the time lag from data collection in hospitals to carrying out the evaluation, which was due to the delay in analysing the data and reporting on performance to individual hospitals. Furthermore, while the general response rate to both interviews and questionnaire study was good, the high participation of Belgian hospitals participating in the evaluation needs to be considered in the interpretation of results. It needs to be emphasized that the evaluation should be understood as a strategy to understand the main strengths and weaknesses of the project and to facilitate user involvement in the redesign of the project. The quantitative results should not be misunderstood to reflect the overall situation of hospitals in the participating regions and countries.

In general, the feedback showed that the PATH project facilitated quality improvement activities at regional/national and hospital level and was highly valued by the stakeholders and demonstrated, despite methodological limitations, the applicability of generic indicators to improve the quality of care in different settings [6]. The role and responsibilities of the regional/country coordinator proved crucial, and a broad acceptance of the coordinator by hospitals is a requirement for success, in particular given the self-improvement nature of the PATH tool. Moreover, the institutional embedding of the project at regional/national level and the consideration of the interests of different stakeholder groups are paramount for the successful implementation of a quality indicator project [11].

In some regions/countries, the lack of resources and organizational mechanisms set hurdles for hospitals to adapt PATH to their context. While resource requirements were difficult to quantify, clear responsibilities, seed funding and technical support during data collection were considered essential [12]. The quantitative results further support that the burden of data collection seems to be a major factor obstructing the implementation of performance assessment systems.

For hospital coordinators, the timeliness of feedback proved to be an essential element in the implementation, and hospital management expressed a clear expectation to reduce the time lag from reporting of data to user feedback. In order to translate the performance assessment in quality improvement, it is in fact paramount to reduce delays in reporting, in addition to offering additional tools to stimulate learning. Furthermore, considering that both the results from both regional/country coordinators' interviews and the standardized hospital assessment suggests that not all hospital performance dashboards were understood equally, further attention needs to be put on the user-friendly design of the dashboards.

Hospital users gave concrete recommendations for the further development of PATH. In some regions/countries and for some indicators, considerable local adaptations were undertaken, mostly as existing data systems did not allow for the collection of PATH data. However, adaptation processes and continuous revision are a natural phenomenon and a prerequisite for successful implementation of indicators for hospital performance assessment [1316]. Efforts were made in the preparation of the second wave of data collection for PATH to improve standardization of indicators. To this end, a mapping exercise was carried out to compare PATH indicators with those of the Agency for Health Care Research and Quality (AHRQ) and the indicators included in the Joint Commission dataset [17, 18]. Furthermore, we improved comparability of indicators descriptions using ICD-9 and ICD-10 versions [1921] and included codes for the classification of surgical procedures (NCSP) suggested by the Nordic Medico-Statistical Committee (NOMESCO) [22]. The indicators used in the second wave of data collection reflect major improvements [23]; however, there is still work ahead to make indicators comparable across countries (O. Groene, unpublished results).

Despite the limitations of this evaluation, important lessons can be learned for future development and evaluation of quality indicator projects, which are surprisingly similar to the experience from the OECD Health Care Quality Indicator Project. On the one hand, both the HCQI and the PATH project are confronted with considerable methodological challenges. This includes making data collected in different systems and in different contexts comparable: ‘detailing specifications, reconciling differing data sources, understanding differences in health care systems and their mandates, and separating differences in performance from differences in measurement’ [24]. On the other hand, from a project management perspective both initiatives reflect how resource demanding international consensus-building is and signal the importance of clear communication strategies, procedures for the revision of indicators and mechanisms to maintain project momentum.


    Conclusion
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
We evaluated the pilot test of the PATH tool in order to identify factors facilitating or obstructing implementation and to involve users in the revision of the measurement procedures. The major factors identified that affect successful implementation were the institutional embedding of the regional/national project coordination, the timeliness of feedback to hospitals and resources for the project management and data collection.

The involvement of users at regional/national and hospital level led to a revision of indicators and reporting tools, as well as a review of the procedures for data collection and analysis. Further research has been commissioned to test the assumptions of the conceptual model (interrelations of indicators and impact on quality improvement activities).


    Acknowledgement
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 
We would like to thank the following PATH regional/country coordinators for the support in identifying hospitals, adapting indicator definitions to the local context, providing training on data collection issues and participating in the phone interview: Belgium: Pascal Meeus, Denmark: Paul Bartels, France: Pierre Lombrail, Slovak Republic: Viera Rusnakova, South Africa: Mohammed Hoosen Cassimjee.

Furthermore, we would like to express our gratitude to all professionals that supported the data collection in the participating hospitals and provided constructive feedback on the development of PATH during the evaluation period.


    References
 Top
 Abstract
 Introduction
 Methods
 Results
 Context
 Process of implementation
 Benefits and future development
 Hospitals' general experience...
 Hospitals' assessment of PATH...
 Discussion
 Conclusion
 Acknowledgement
 References
 

  1. Øvretveit J. What are the best strategies for ensuring quality in hospitals? Health Evidence Network. (2003) Copenhagen: WHO Regional Office for Europe. (2 February 2008, date last accessed) http://www.euro.who.int/document/Hen/hospquality.pdf.

  2. Groene O. Suggestions of WHO for Comprehensive Hospital Performance. (2006) 11. Gesundh Ökon Qual Manag. 226–33. [in German].

  3. World Health Organization. (2007) March 2007. Assessing health systems performance: first preparatory meeting for the WHO European Ministerial Conference on Health Systems, 2008, Brussels. Copenhagen: WHO Regional Office for Europe. 29–30. (2 February 2008, date last accessed) http://www.euro.who.int/document/HSM/hsc08_prep1_edoc02.pdf.

  4. Freeman T. Using performance indicators to improve health care quality in the public sector: a review of the literature. Health Serv Manage Res (2002) 15:126–37.[Abstract/Free Full Text]

  5. Mattke S, Epstein AM, Leatherman S. The OECD Health Care Quality Indicators Project: history and background. Int J Qual Health Care (2006) 18:1–4. doi:10.1093/intqhc/mzl019.[Abstract/Free Full Text]

  6. Kazandjian VA, Matthes N, Wicker KG. Are performance indicators generic? The international experience of the Quality Indicator Project. J Eval Clin Prac (2003) 9:265–76.[CrossRef][Web of Science][Medline]

  7. World Health Organization. Measuring hospital performance to improve the quality of care in Europe: a need for clarifying the concepts and defining the main dimension. (2003) Copenhagen: WHO Regional Office for Europe. Report on a WHO Workshop Barcelona, Spain, 10–11 January 2003 (2 February 2008, date last accessed) http://www.euro.who.int/document/e78873.pdf.

  8. Veillard J, Champagne F, Klazinga N, et al. A performance assessment framework for hospitals: the WHO regional office for Europe PATH project. Int J Qual Health Care (2005) 17:487–96.[Abstract/Free Full Text]

  9. World Health Organization. Performance Assessment Tool for Quality Improvement in Health Care (2007) Copenhagen: WHO Regional Office for Europe. (2 February 2008, date last accessed) http://www.euro.who.int/document/E89742.pdf.

  10. Groene O. Pilot Test of the Performance Assessment Tool for Quality Improvement in Hospitals (PATH). Copenhagen: WHO Regional Office for Europe. (2 February 2008, date last accessed) http://www.euro.who.int/document/HPH/PATH_PerformanceAss.pdf.

  11. Berg M, Meijerink Y, Gras M, et al. Feasibility first: developing public performance indicators on patient safety and clinical effectiveness for Dutch hospitals. Health Policy (2005) 75:59–73.[CrossRef][Web of Science][Medline]

  12. ten Asbroek AH, Delnoij DM, Niessen LW, et al. Implementing global knowledge in local practice: a WHO lung health initiative in Nepal. Health Policy Plan (2005) 20:290–301.[Abstract/Free Full Text]

  13. Chiu WT, Yang CM, Lin HW, et al. Development and implementation of a nationwide health care quality indicator system in Taiwan. Int J Qual Health Care (2007) 19:21–8.[Abstract/Free Full Text]

  14. Collopy BT, Williams J, Rodgers L, et al. The ACHS Care Evaluation Program: a decade of achievement. J Qual Clin Practice (2000) 20:36–41.[CrossRef][Medline]

  15. Mainz J, Krog BR, Bjornshave B, et al. Nationwide continuous quality improvement using clinical indicators: the Danish National Indicator Project. Int J Qual Health Care (2004) 16:145–50.

  16. Grenier-Sennelier C, Corriol C, Daucourt V, et al. Developing quality indicators in hospitals: the COMPAQH project. Rev Epidemiol Sante Publique (2005) 53.

  17. Agency for Healthcare Research and Quality. Inpatient Quality Indicators Overview. (5 February 2007, date last accessed).

  18. The Joint Commission. Performance Measurement Initiatives. (5 February 2007, date last accessed) http://www.jointcommission.org/PerformanceMeasurement/PerformanceMeasurement/Historical+NHQM+manuals.htm.

  19. International Classification of Diseases and Health Related Problems, 10th Revision. (2007) Geneva: World Health Organization. (5 February 2007, date last accessed) http://www.who.int/classifications/apps/icd/icd10online/.

  20. World Health Organization. ICD-9 to ICD-10 Translator. Health Situation Analysis and Projection Unit (HST/HSP) (1997) Geneva: World Health Organization.

  21. Timely Data Resources. ICD -10 to ICD -9/ICD -9 to ICD -10 Conversion Table. (5 February 2007, date last accessed) http://tdrdata.com/IPD/ipd_ICDTranslator.aspx.

  22. Nordic-Medico Statistical Committee (NOMESCO). Classification of Surgical Procedures (NCSP). (5 February 2007, date last accessed) http://www.nordclass.uu.se/verksam/ncspe.htm.

  23. The Performance Assessment Tool for Quality Improvement (PATH): preparing for the second wave of data collection. (2007) Copenhagen: WHO Regional Office for Europe. Report on Indicator Descriptions (March 2007) (2 February 2008, date last accessed) http://www.pathqualityproject.eu/download2/20%2003%202007%20PATH%20Indicator%20descriptions.pdf.

  24. Kelley ET, Arispe I, Holmes J. Beyond the initial indicators: lessons from the OECD Health Care Quality Indicators Project and the US National Healthcare Quality Report. Int J Qual Health Care (2006) 18:45–51.[Abstract/Free Full Text]

Accepted for publication February 25, 2008.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
Int J Qual Health CareHome page
E. Bradley, K. A. Hartwig, L. A. Rowe, E. J. Cherlin, J. Pashman, R. Wong, T. Dentry, W. E. Wood, and Y. Abebe
Hospital quality improvement in Ethiopia: a partnership-mentoring model
Int. J. Qual. Health Care, December 1, 2008; 20(6): 392 - 399.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
20/3/155    most recent
mzn010v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Groene, O.
Right arrow Articles by Bartels, P.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Groene, O.
Right arrow Articles by Bartels, P.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?