International Journal for Quality in Health Care 15:73-078 (2003)
© 2003 International Society for Quality in Health Care
Paper |
Quality of psychiatric care: validation of an instrument for measuring inpatient opinion
1Epidemiology and Biostatistics Unit, Istituto Superiore di Sanità, Rome
2Department of Psychiatry, S. Filippo Neri Hospital, Rome, Italy
Objectives. To validate a brief self-completed questionnaire for routinely assessing patients opinions on the quality of care in inpatient psychiatric wards (Rome Opinion Questionnaire for Psychiatric Wards).
Design. A preliminary version was assessed for face and content validity by eight psychiatrists and two patient focus groups. The final version was evaluated for acceptability, factor structure, internal consistency, and test-retest reliability.
Setting. An inpatient psychiatric ward in a general hospital in Rome.
Study participants. The questionnaire was administered to all consecutive inpatients admitted over a 6-month period (n = 169). Test-retest reliability was evaluated by administering the questionnaire for a second time to 27 inpatients.
Main outcome measures. Face and content validity: psychiatrists and focus groups opinions on relevance, importance, and clarity; acceptability: inpatients opinions on user-friendliness; factor analysis: principal component analysis; internal consistency: Cronbachs alpha; test-retest reliability: Cohens weighted kappa coefficient, intraclass correlation coefficient.
Results. After evaluating face and content validity, the questionnaire was reduced to 10 items. Inpatients found the questionnaire to be acceptable. Factor analysis revealed that three factorsprofessional qualities of staff, information received, and physical environmentexplained 67.2% of total variance. Cronbachs alpha was 0.82 for the questionnaire and 0.61, 0.71, and 0.35 for the three factors, respectively. Test-retest reliability was good; weighted kappa higher than 0.9 for three items and 0.60.9 for seven items. The intraclass correlation coefficient was 0.80.
Conclusions. The questionnaire seems to be adequate for evaluating patients opinions on care in inpatient psychiatric wards. Because of its user-friendliness, it may be particularly suitable for routine use.
Keywords: patient opinion, mental health services, psychiatric ward, reliability, questionnaire, quality of care