International Journal for Quality in Health Care Advance Access originally published online on June 2, 2007
International Journal for Quality in Health Care 2007 19(4):217-224; doi:10.1093/intqhc/mzm014
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Questionnaire to assess patient satisfaction with pharmaceutical care in Spanish language
1 Pharmaceutical Care Area, Faculty of Biochemical and Pharmaceutical Sciencies, National University of Rosario, Rosario, Argentina
2 Faculty of Medical Sciences, National University of Rosario, Rosario, Argentina
Address reprint requests to: María Luz Traverso, Assistant Professor, Pharmaceutical Care Area, Moreno 1463-App. 8 "B" (2000) Rosario, Argentina. E-mail: mtraver{at}fbioyf.unr.edu.ar
| Abstract |
|---|
|
|
|---|
Objective. To develop and validate a questionnaire, in Spanish, for assessing patient satisfaction with pharmaceutical care received in community pharmacies.
Design. Selection and translation of questionnaire's items; definition of response scale and demographic questions. Evaluation of face and content validity, feasibility, factor structure, reliability and construct validity.
Setting. Forty-one community pharmacies of the province of Santa Fe. Argentina.
Participants. Questionnaire administered to patients receiving pharmaceutical care or traditional pharmacy services.
Main outcome measure. Pilot test to assess feasibility. Factor analysis used principal components and varimax rotation. Reliability established using internal consistency with Cronbach's alpha. Construct validity determined with extreme group method.
Results. A self-administered questionnaire with 27 items, 5-point Likert response scale and demographic questions was designed considering multidimensional structure of patient satisfaction. Questionnaire evaluates cumulative experience of patients with comprehensive pharmaceutical care practice in community pharmacies. Two hundred and seventy-four complete questionnaires were obtained. Factor analysis resulted in three factors: Managing therapy, Interpersonal relationship and General satisfaction, with a cumulative variance of 62.51%. Cronbach's alpha for the whole questionnaire was 0.96, and 0.95, 0.88 and 0.76 for the three factors, respectively. MannWhitney test for construct validity did not showed significant differences between pharmacies that provide pharmaceutical care and those that do not, however, 23 items showed significant differences between the two groups of pharmacies.
Conclusion. The questionnaire developed can be a reliable and valid instrument to assess patient satisfaction with pharmaceutical care in community pharmacies in Spanish. Further research is needed to deepen the validation process.
Keywords: community pharmacy services, patient satisfaction, pharmaceutical care, quality, questionnaire, Spanish language
Patient satisfaction is considered a personal evaluation or appraisal of a service or product received [13]. Data obtained from a patient satisfaction survey can be used for different purposes, such as the identification of potential areas for health care services improvement [2]; the comparison of the quality of different care programs and systems; and the detection of patients likely to disenroll from health care plans [4]. Therefore, data on patient satisfaction can serve as an indicator of service quality and as a predictor of health-related behavior [1].
In the last few decades, patients have emerged as the core concern in health care provision and quality assurance efforts [2, 5]. In developed countries, patient satisfaction is a key factor in quality assessment of the health care system [6], whereas in developing countries, the main quality concern has been the accessibility to health care services [7]. However, with the reforms introduced in the last years and the growing relevance of continuous quality improvement, researchers in Spanish-speaking countries have begun to assess patient satisfaction with health care, increasing the number of studies recently undertaken [79].
Research on patient satisfaction with pharmacy services began
25 years ago and a significant volume of literature has been generated [3]. Most measurement tools have conceptualized patient satisfaction with pharmacy services as a performance indicator. This approach uses rating scales for patients to indicate their opinion about certain service attributes [3]. Evaluation measures have evolved into multidimensional questionnaires that cover various aspects of pharmaceutical services [3, 10].
Pharmaceutical care is a professional practice, the patient being the main beneficiary. This practice involves the responsible provision of pharmacotherapy to achieve definite outcomes related to the improvement of the patient's health and quality of life [11, 12]. Several studies carried out in other countries addressing patient satisfaction with pharmaceutical care in community pharmacies showed that the provision of pharmaceutical care contributes to patient satisfaction. Higher differences between traditional pharmacy practices and the pharmaceutical care services were observed in the dimensions specifically related with this practice [1317].
With the worldwide adoption of pharmaceutical care practice, the need for patient-oriented assessment questionnaires emerged. There are three questionnairesin Englishto assess patient satisfaction with pharmaceutical care services that have proved to be valid and reliable to assess pharmaceutical care [1719].
Although in English-speaking countries patient satisfaction research has been constantly evolving, in others the lack of suitable instruments is a problem [20]. Researchers need to develop a new questionnaire in their own language or adapt the existent onesin Englishthat requires a rigorous adaptation process to guarantee the questionnaire's linguistic and cultural appropriateness [21].
Spanish is the fourth most commonly spoken language in the world and the official language of 22 countries [22]. A recent review of instruments to assess patient satisfaction with pharmaceutical care in Spanish found only two published questionnaires, which can be considered an initial attempt to address the topic [2325]. There is no comprehensive, reliable and valid instrument for assessing patient satisfaction with pharmaceutical care in community pharmacies in Spanish [9, 23].
The goal of this study is to develop and validate a questionnaire in Spanish language for assessing patient satisfaction with pharmaceutical care in community pharmacies.
| Methods |
|---|
|
|
|---|
Design of the questionnaire
The objectives for the questionnaire were to assess patients' satisfaction with their cumulative pharmaceutical care experience in a comprehensive and reliable way, to discriminate practices that provide pharmaceutical care from those that do not, to be completed in no more than 10 min, and to be suitable for self-administration by the patient.
On the basis of previous studies, in order for the questionnaire to meet these requirements it should have the following characteristics:
- Multiple dimensions: To comprehensively assess patient satisfaction with pharmaceutical care.
- Multiple items per dimension: To improve reliability, however, it also lengthens the questionnaire and thus increases the burden for the patient completing it [26, 27].
- Response scale: A five-choice assessment scale (excellent, very good, good, fair, poor), with an assigned score from 5 = excellent to 1 = poor. Patients' surveys demonstrated that this scale yields mean scores closer to the midpoint, greater response variability and better correlation with behavioral intentions than the format extremely satisfiedvery dissatisfied [2628].
- Simple questions and clear instructions: In order to be self-administered.
- Worded to assess cumulative experience with pharmaceutical care: To achieve a comprehensive assessment of the cumulative experience and not only of this single encounter.
The translation of items from questionnaires in English was done with the participation of bilingual patients.
A panel of judges composed of pharmaceutical care professors, a statistician, two community pharmacists and two patientsthat have received pharmaceutical careassessed face and content validity.
The questionnaire was first applied in a pilot test, in 13 pharmacies that provided pharmaceutical care. The results were used to revise the instrument, rephrase or delete items, reduce its length or modify the response scale.
Study sites
The research was developed by the Pharmaceutical Care Area of the Faculty of Biochemical and Pharmaceutical Sciences of National University of Rosario, with the initial supervision of Dr Linda MacKeigan.
To obtain the number of questionnaires required for the data analysis, a total of 41 pharmacies, members of the College of Pharmacists of the Province of Santa Fe, participated in the project. Only 31 pharmacies in the province provided pharmaceutical care, with activities of patient education and counselling and drug therapy assessment, so they were all included. The rest were traditional pharmacies, selected by convenience sampling from the total of pharmacies in the region. All pharmacies were located in the cities of Rosario and Santa Fe and inner towns of the province. The Ethic Committee of the College of Pharmacists gave the ethics approval for this study. The pharmacists attended seminars and received written instructions in order to deepen their knowledge about the topic and standardize their research in the pharmacies.
The inclusion criteria for patients were to be 21 years or older, to have a new prescription filled at least in once in the previous month, to have been taking at least one medication for a chronic disease and receiving pharmaceutical care in this pharmacy. This last criterion was not considered in the pharmacies that provided traditional services.
Data collection
The eligible patients were asked by the pharmacist to answer the self-administered questionnaire, explaining them that it was voluntary and confidential. If they agreed, they answered it in a private room within the pharmacy. Pharmacists had a standard form to record the number of approaches, the number of questionnaires distributed, the number of questionnaires returned and the time needed to answer the questionnaire. During the pilot test stage, patients filled a form to assess the questionnaire from the respondent perspective.
Each questionnaire had a code number (including pharmacy location, pharmaceutical care service and patient number). The first page showed the objectives of the study, the second and third ones contained the questionnaire and other data required from the patient (two sides printed). The questionnaire was given to the patient in an envelope with the same code number. After completing it, the patient closed the envelope and gave it back to the pharmacist.
Period of development of the study: April 2002August 2004.
Data analysis
Reliability of the instrument's scales was assessed with Cronbach's alpha. For an expected reliability coefficient of 0.70 and a confidence interval criterion of ± 0.10 it was considered that the sample size requires 130 subjects [26].
Factor analysis gave information about the validity of the hypothesized grouping of items in dimensions. Principal components extracting factors with varimax rotation was applied. To determine how many factors were retained a criterion of eigenvalue greater than 1.0 was considered. This could lead to a modification of the scale's structure [29]. In order to be retained on a scale an item must meet the following criteria: factor loadings higher than 0.30 and no higher loading on another factor [26, 29]. The sample size for this step was based on the rule of the thumb proposed by Nunnaly, who suggested that the number of subjects should be at least 10 times the number of items [27].
To assess the validity of the construct it was hypothesized that the patients are more satisfied with pharmacies that provide pharmaceutical care, and tested with the extreme group method. The instrument was given to two groups; one of the groups was composed of patients of traditional pharmacies and the other one of patients of pharmacies with pharmaceutical care. The MannWhitney test was applied to compare the data from the two groups of pharmacies.
Discriminant validity was also considered, using Pearson productmoment correlations coefficients (r) to obtain correlations between items and demographic variables.
The mean scores of the questionnaire's scales for each group of patients were compared. On the basis of the results of previous studies, [17, 19] to detect a minimum difference in the scale's mean scores of 0.40, a standard deviation (SD) of 0.85, with alpha (type I error) of 0.05 and a desired power of 0.8, a minimum of 71 patients for each group was required as sample size.
Data were analysed using the SPSS 11.5 statistical software (Statistical Software for Social Sciences).
| Results |
|---|
|
|
|---|
A questionnaire of 27 items, with randomly assigned order, was designed. Five dimensions were initially proposed: General satisfaction (1 item), Explanation (6 items), Managing therapy (9 items), Consideration (7 items) and Setting (4 items).
The instrument also included questions about: demographic information, pharmacy patronage, number of prescriptions in the last month, number of medicines they were taking and drug insurance.
A pilot test was used to assess the feasibility of the tool. From the total of patients asked to answer the questionnaire, 36 (76.6%) accepted and all of them completed it. Pharmacists and patients completed a form that was used to obtain the response rate and the respondent's opinion, respectively. We considered the following to revise and modify the original questionnaire:
- Respondent's perspective of the instrument: recorded opinion of the patient about clarity of the instructions, difficulty to answer any question, ease of administration and length of the questionnaire.
- Item performance statistics: mean, SD and number of missing responses.
In the second application of the questionnaire 28 community pharmacies participated. The procedures in this stage were as in the Pilot Test. A total of 274 questionnaires were answered (81.3% of the approached patients who accepted to answer the questionnaire) and 174 of them were patients receiving pharmaceutical care. The respondents' profile is summarized in Table 1.
|
As regards the time required to complete the questionnaire, 181 (66.0%) needed between 5 and 10 min to answer it.
The total number of missing responses in all the answered questionnaires was of 114. No individual questionnaire had a missing response rate superior to 20%. Relating to individual items, item 9 had 13 missing responses (4.7%) and items 18 and 26 had 10 missing responses, respectively (3.6%).
Factor analysis with principal components and varimax rotation resulted in three factors (Tables 2 and 3). Cumulative variance of the 3-factor solution was 62.51%. According to these results, items were regrouped in three new factors: Managing therapy, Interpersonal relationship and General satisfaction.
|
|
Descriptive statistics for each item as well as the proposed and final dimensions for each one of them are shown in Table 4.
|
The reliability of the instrument's scales was assessed with Cronbach's alpha. The value of the reliability coefficient for the whole questionnaire (27 items) was 0.96 and values for the final three dimensions were as follows: the Managing therapy dimension had a reliability coefficient
of 0.95, the Interpersonal relationship dimension 0.88 and the General satisfaction 0.73. In order to determine the construct validity of the questionnaire, the MannWhitney test was applied to compare the data from the two groups of pharmacies. The MannWhitney test of the overall score gave a mean of 4.20 and a SD of 1.08 for the group of pharmaceutical care pharmacies, and a mean of 3.72 and a SD of 1.30 for the other one, showing no significant difference (P = 0.32). In spite of the overall result, individual items' scores, except for items 5, 11, 23 and 25, showed significant differences between the two groups. The higher differences between the two groups were observed in items 2, 6, 8, 10, 12, 13, 14 and 16 (P < 0.0001). In those variables that showed significant differences, the group with pharmaceutical care always showed a higher average than the other, implying that patients of the pharmaceutical care group assigned higher values to their answers.
The discriminating validity analysis showed no significant correlation (P > 0.05) between items and demographic variables, i.e. the correlation between item 1 and age was 0.062 and the correlation between item 15 and sex was 0.013.
| Discussion |
|---|
|
|
|---|
The aim of this study was to achieve a questionnaire in Spanish to allow the assessment of patient satisfaction with pharmaceutical care.
Results related to the reliability of the questionnaire showed values of Cronbac's alpha superior to 0.70, meaning that items are sufficiently correlated to constitute a scale [26]. Values of
between 0.70 and 0.90 are preferred, higher values could suggest a high level of item redundancy [26, 27]. We decided to maintain all items because this was a first application and next studies could consider the exclusion of any item if Cronbac's alpha continues higher than 0.90.
In the factor analysis, cumulative variance for the three factors was superior to 60.0% and, therefore, none of them was excluded [30, 31]. Items 13 and 16 had similar rotation factor loading for factors 1 and 2, however, both were assigned to the first factor because we considered them more related to it.
Previous validated and multidimensional questionnaires that assessed satisfaction with pharmaceutical care defined similar factors as our three factor solution [1719]. In fact, Managing therapy and Interpersonal relationship are essential components of pharmaceutical care, with high impact on patients' health and quality of life [11, 12].
Although the overall results of the construct validity test did not showed significant differences between the two groups of pharmacies, twenty-three items did so. Only item 25, form the other four items, is specifically related with pharmaceutical care, considering the interaction between pharmacist and physician, a relationship that should be reinforced in community pharmacies in our country. Previous studies that compared patient satisfaction between pharmaceutical care and traditional pharmacy services have found lower differences in patient satisfaction's rate than the expected. [13, 15, 17]. That could be not only for possible limitations of the studies but also because satisfaction with traditional pharmacy services is high [15]. Researchers also suggest that there is a need for increased public awareness about pharmacists' capabilities and the value of pharmaceutical care services, as well as a more proactive approach to the provision of cognitive services [15, 17].
There are two limitations that need to be acknowledged regarding this study. The first is that community pharmacists may have selected patients who were actively involved in pharmaceutical care practice and eager to answer the questionnaire. The other limitation would be that the questionnaire is geographically bounded: even when Spanish is the official language of many countries, diverse cultures coexist within them. Therefore, it would be important to carry out a cross-cultural adaptation before it is use in other countries, and also to validate the adapted questionnaire as if it were a new one [25, 26].
Although this study considered the data of the first validity analysis, the results suggest that the questionnaire developed can be a reliable and valid instrumentin Spanishto assess patient satisfaction with pharmaceutical care in community pharmacies. Further research is needed to deepen the validation process of this questionnaire, with special focus on the construct validity. The next step is to use this questionnaire in other areas of our country and in other Spanish speaking countries.
Finally, in Spanish-speaking countries the number of articles published related with patient satisfaction has increased in the last years, but there are methodological weaknesses in the development of instruments to assess patient satisfaction, a problem that need to be solved in order to give patient satisfaction the same hierarchy than other health indicators [79, 23, 32]. The widespread application of pharmaceutical care practice needs a reliable and valid instrument to be applied in a usual way, not only to obtain results for research, but also for monitoring everyday practice and its impact on quality of health care.
| Acknowledgments |
|---|
The authors would like to thank Dr Linda MacKeigan and the Social and Administrative Group and the Dean of the Faculty of Pharmacy, University of Toronto, Toronto, Canada. During the first steps of this project M.L.T. was supported by a postdoctoral fellowship in Pharmacy Management from the Faculty of Pharmacy, University of Toronto. The community pharmacists that participated in the project: Aceñolaza Mercedes, Alí Adriana, Almirón Diana, Alzugaray Cintia, Antonelli Claudia, Asinari Mónica, Azar Celina, Benitez Nancy, Biagi Betina, Bocadi Fernando, Calzia Javier, Cantoni Liliana, Caraballo Alicia, Chimentón Jordana, Clari Roxana, Clavé Marta, Collura María Luisa, Cosatto Carina, Daulón Marcela, De Luca Claudia, Del Puerto Marcela, Eberhardt Lucindo, Facino María Antonia, Garcia Alejandra, Grassi Stella Maris, Jurado Leonardo, Lambas Erica, Martina Rosana, Mendoza Alicia, Mollardo María Teresa, Mozzicafreddo María Eugenia, Muntane Silvia, Nadziej Beatriz, Orellano Viviana, Pacciaroni Jorgelina, Parlatore Marisa, Pell Betina, Perrone Ariadna, Prieto Patricia, Rodríguez Alicia, Rodríguez Elsa, Ronchy Fanny, Sheridan Silvia, Silva Alejandra, Simoncini Marisa, Sucarrats Marcela, Ventola Valeria, Zalloco Mariela, Sopranzetti Viviana y González Ana María. Guillermina Emanuelli and Fernanda Méndez for their assistance in the statistical analysis. George Jessé and Dr Silvina Bravo for their help in the review and correction of the manuscript.
| References |
|---|
|
|
|---|
- Pascoe GC. Patient satisfaction in primary health care: a literature review analysis. Eval Program Plann (1983) 6:185210.[CrossRef][Medline]
- Aharony L, Strasser S. Patient satisfaction: what we know about and what we still need to explore. Med Care Rev (1993) 50:4979.[Medline]
- Schommer JC, Kucukarslan SN. Measuring patient satisfaction with pharmaceutical services. Am J Health Syst Pharm (1997) 54:272132.[Abstract]
- Jackson J, Chamberlin J, Kroenke K. Predictors of patient satisfaction. Soc Sci Med (2001) 52:60920.[CrossRef][Web of Science][Medline]
- Sitzia J, Wood N. Patient satisfaction: a review of issues concepts. Soc Sci Med (1997) 45:182943.[CrossRef][Web of Science][Medline]
- Gold M, Woodridge J. Surveying consumer satisfaction to assess managed care quality: current practices. Health Care Finance Rev (1995) 16:15573.
- Mera JA. A review of the welfare state and alternative ways of delivering health care. Int J Qual Health Care (2002) 14:8790.
[Free Full Text] - Romano Yalour M, Grunhut Y. La encuesta de satisfacción a los usuarios de servicios de salud. Boletín Programa Investigación Aplicada Isalud (2001) 1:13.
- Barrasa JI, Aibar C. Revisión sistemática de los estudios de satisfacción realizados en España en el periodo 19862001. Rev Calidad Asist (2003) 18:58090.
- Johnson JA, Coons SJ, Hays RD. Structure of satisfaction with pharmacy services. Med Care (1998) 36:24450.[CrossRef][Web of Science][Medline]
- World Health Organization. FIP-WHO. Pharmaceutical Care. Tokyo Declaration (1993) September.
- Hepler CD, Strand LM. Opportunities and responsibilities in pharmaceutical care. Am J Hosp Pharm (1990) 47:53342.[Abstract]
- Shibley MC, Pugh CB. Implementation of pharmaceutical care services for patients with hyperlipidemias by independent community pharmacy practitioners. Ann Pharmacother (1997) 31:7139.[Abstract]
- Carter BL, Barnette DJ, Chrischilles E, et al. Evaluation of hypertensive patients after care provided by community pharmacists in a rural setting. Pharmacotherapy (1997) 17:127485.[Web of Science][Medline]
- Kradjan WA, Schulz R, Christensen D, et al. Patients' perceived benefit from and satisfaction with asthma-related pharmacy services. J Am Pharm Assoc (1999) 39:65865.
- Blenkinsopp A, Phelan M, Bourne J, et al. Extended adherence support by community pharmacists for patients with hypertension: randomized controlled trial. Int J Pharm Pract (2000) 8:16575.
- Volume CI, Farris KB, Kassam R, et al. Pharmaceutical care research and education project: patient outcomes. J Am Pharm Assoc (2001) 41:41120.
- Larson LN, Rovers J, MacKeigan LD. Patient satisfaction with pharmaceutical care: update of a validated instrument. J Am Pharm Assoc (2002) 42:4450.[CrossRef]
- Gourley GK, Gourley DR, La Monica Rigolosi E, et al. Development and validation of the pharmaceutical care satisfaction questionnaire. Am J Managed Care (2001) 7:4616.[Web of Science][Medline]
- Etter JF, Perneger TV. Validating a satisfaction questionnaire using multiple approaches: a case study. Soc Sci Med (1997) 45:87985.[CrossRef][Web of Science][Medline]
- Cella D, Hernandez L, Bonomi A, et al. Spanish language translation and initial validation of the functional assessment of cancer therapy quality of life instrument. Med Care (1998) 36:140718.[CrossRef][Web of Science][Medline]
- Instituto Cervantes. Madrid. España. March 2004. http://www.cervantes.es.
- Traverso ML, MacKeigan L. Instruments for measuring patient satisfaction with pharmacy services in the Spanish language. Pharm World Sci (2005) 27:2814.[CrossRef][Web of Science][Medline]
- Alvarez de Toledo F, Aros Gonzalez P, Eyaralar Riera T, et al. Pharmaceutical Care in people who have had acute coronary episodes(TOMCOR study). Rev Esp Salud Pública (2001) 75:37587.[Medline]
- Hernandez L, Chang CH, Cella D, et al. Development and validation of the satisfaction with pharmacist scale. Pharmacotherapy (2000) 20:83743.[CrossRef][Web of Science][Medline]
- Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. (1995) Oxford: Oxford University Press.
- Nunnally JC. Psychometric Theory (1978) New York: McGraw-Hill, Inc.
- Sudman S, Bradburn N. Asking Questions. A practical guide to Questionnaire design (1982) San Francisco: Jossey Bass Inc.
- Lewis-Beck M. Factor analysis and related techniques. (1994) London: Sage Publications.
- Dillon W, Goldstein M. Multivariate analysis. Methods and applications (1984) New York: John Wiley and Sons.
- Johnson D. Métodos multivariados aplicados al análisis de datos (2000) International Thompson Editores.
- Caminal J. La medida de la satisfacción: un instrumento de participación de la población en la mejora de la calidad de los servicios sanitarios. Rev Calidad Asist (2001) 16:27679.
![]()
CiteULike
Connotea
Del.icio.us What's this?
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||