International Journal for Quality in Health Care 15:407-412 (2003)
© 2003 International Society for Quality in Health Care
A reliability study of an instrument for measuring general practitioner consultation skills: the LIV-MAAS scale
1 Prescribing Research Group, Department of Pharmacology and Therapeutics, 2 Health and Community Care Research Unit, University of Liverpool, UK
Objective. To evaluate the reliability of a new tool, the LIV-MAAS, in assessing consultation competence in UK general practice.
Design. These were pilot studies, with small numbers of participants. Videoed general practitioner (GP) consultations were analysed by trained lay and professional raters, using the LIV-MAAS. The inter-rater reliabilities were assessed. Four videos were assessed by five raters in a pilot study. After this, 71 consultations from eight doctors were assessed by sets of three raters.
Main measures. Inter-rater reliabilities and inter-consultation reliabilities.
Results. For the pilot study, the estimated inter-rater reliability ranged from 0.69 (one rater) to 0.91 (five raters). For the main study, the estimated inter-rater reliability for the LIV-MAAS checklist using two raters was 0.71, and using three raters it was 0.78. Mean differences in reliability within each series of nine consultations were 0.20 (three raters) and 0.42 (two raters).
Conclusions. As a measure of consultation competence, administered by trained raters (medical or lay) to real GP consultations, the LIV-MAAS instrument shows adequate reliability and stability but would benefit from considerable shortening. Further development of the LIV-MAAS and testing with larger samples are required.
Keywords: consultation competence, general practitioner assessment, inter-rater reliability, LIV-MAAS, MAAS-GP
Address reprint requests to Professor T. Walley, Prescribing Research Group, Department of Pharmacology and Therapeutics, University of Liverpool, L69 3GF, UK. E-mail: twalley{at}liv.ac.uk
Accepted for publication April 14, 2003.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
S. Hobma and P. Ram Assessment of GPs in practice Int. J. Qual. Health Care, October 1, 2004; 16(5): 423 - 423. [Full Text] [PDF] |
||||
![]() |
N. L. Keating and J. Z. Ayanian Challenges and opportunities for primary care evaluation Int. J. Qual. Health Care, October 1, 2003; 15(5): 371 - 373. [Full Text] [PDF] |
||||
