Skip Navigation

This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (12)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Kasje, W. N.
Right arrow Articles by Haaijer-Ruskamp, F. M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kasje, W. N.
Right arrow Articles by Haaijer-Ruskamp, F. M.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

International Journal for Quality in Health Care 16:229-236 (2004)
International Journal for Quality in Health Care vol. 16 no. 3 © International Society for Quality in Health Care and Oxford University Press 2004; all rights reserved

Physicians’ views on joint treatment guidelines for primary and secondary care

W. N. Kasje1, P. Denig1, P. A. de Graeff1,2 and F. M. Haaijer-Ruskamp1

1 Department of Clinical Pharmacology, University of Groningen, 2 Department of Internal Medicine, University Hospital Groningen, Groningen, the Netherlands

Objectives. Joint drug formularies and treatment guidelines have been developed to reduce problems arising at the interface between primary and secondary care. The aim is to compare the willingness of hospital specialists and general practitioners to use joint treatment guidelines, and to determine the most relevant barriers and facilitators.

Study design. A structured survey, consisting of questions about the use of guidelines and formularies in general, and possible barriers and facilitators for using a specific joint guideline. These specific guidelines concerned the treatment of hypertension, heart failure, or diabetes mellitus.

Setting and study participants. One hundred and ninety-seven general practitioners and 34 general internists and cardiologists from the north of the Netherlands.

Results. Most hospital specialists relied for their prescribing on international guidelines and agreements within their own department, while general practitioners relied more on national and regional guidelines. General practitioners were more supportive than specialists of the initiative to develop joint treatment guidelines, although both groups had concerns regarding the development process. An important barrier for specialists was that they did not perceive a need for these guidelines. As enabling factors, physicians stated that these joint guidelines can lead to harmonization between specialists and general practitioners, and that they can be useful as an educational tool.

Conclusion. Specialists are less ready to adopt joint treatment guidelines than general practitioners, indicating the need for a different approach to implement such guidelines in the two sectors.

Keywords: attitude of health personnel, continuity of patient care, drug, formularies, practice guidelines, prescriptions

Address reprint requests to P. Denig, Department of Clinical Pharmacology, University of Groningen, A.Deusinglaan 1, 9713 AV Groningen, the Netherlands. E-mail: p.denig{at}med.rug.nl

Accepted for publication December 17, 2003.


Clinical practice guidelines are intended to support health care professionals, but too many different guidelines may confuse rather than provide guidance. Despite the application of the same scientific evidence, guidelines issued by different organizations or in various countries do not always make consistent recommendations [13]. This can be a problem for the health care professional, who may become uncertain about which guideline to follow. It can also lead to confusion in patients who move between different levels of health care, in particular at the primary–secondary care interface [4]. This is especially relevant in health care systems such as that of the Netherlands, where the general practitioner (GP) acts as a gatekeeper, so that patients can only visit a specialist after referral by their GP. In many cases, the specialist can give advice and send the patient back to the GP for follow-up care. To enhance seamless and efficient health care, a number of researchers have recommended the development of joint formularies or treatment guidelines for primary and secondary care [4,5].

In the Netherlands, a programme was set up by the Ministry of Health, Well-being and Sports, and supported by Health Insurance Funds to form joint treatment guidelines. Local committees of hospital specialists, GPs, and hospital and community pharmacists developed the guidelines [6]. At the time of our study, 16 guidelines for shared care had been developed as part of a regional joint formulary in the province of Groningen [7]. An implementation project was planned focusing on two issues: the treatment of chronic heart failure and the treatment of hypertension in diabetic patients. To develop an effective implementation strategy, it is important to know to what extent the target population opposes or supports the use of these guidelines [8,9].

In general, the motivation for using guidelines is related to the quality and reliability of the guideline and its development process, and a variety of barriers and facilitators at the level of the professional and the working environment [1012]. Qualitative research among a small group of Dutch hospital specialists showed that potential barriers for using joint treatment guidelines can be found in all these domains [6]. The importance of the revealed barriers is not clear yet; nor is it known whether specialists and GPs have similar views and attitudes. There might be differences in attitude and culture that are important for implementing changes [13].

The aim of this study is to assess the willingness of both hospital specialists and GPs to use joint treatment guidelines, and to determine the most relevant barriers and facilitators. A comparison will be made between both groups of physicians to determine whether an implementation programme should be tailored to each group separately. The questions addressed focus on the physicians’ current guideline use, their satisfaction with current practice, their support for the development of joint treatment guidelines in general, and perceived barriers and facilitators towards using one specific guideline.


    Methods
 Top
 Methods
 Results
 Discussion
 References
 
Study population
We set out to administer a structured questionnaire to all physicians for whom the specific joint treatment guidelines were relevant. These comprised all 260 GPs, 36 general internists, and 24 cardiologists working in Groningen, a province in the north of the Netherlands. The questionnaire was distributed in two waves. The first wave took place in the autumn of 2000 at a series of educational meetings held yearly for both hospital specialists and GPs in this region. One of the aims during these meetings was to inform the physicians about the transmural project in general, and to present one specific guideline in particular. We distributed and collected our questionnaire during these meetings. Since not all physicians attended the meetings and therefore had not received the questionnaire, the questionnaire was sent or handed out in a second wave between December 2000 and April 2001 to each of the remaining 97 GPs and 19 specialists who did not attend the educational meetings.

Questionnaire
The structured questionnaire consisted of a general and a guideline-specific part. The general part included questions regarding background characteristics, current use of clinical treatment guidelines, followed by three statements regarding satisfaction with current practice and three statements regarding support for the project of developing joint guidelines. Regarding current use of guidelines, respondents could indicate how often they used specific guidelines, formularies, or agreements. There are two sets of national guidelines in the Netherlands. For primary care, there are the Nederlands Huisartsgenootschap (NHG) guidelines developed by the Dutch College of General practitioners. For specialists, there are the Kwaliteitsinstituut voor de Gezondheidszorg (CBO) guidelines developed by the Dutch Institute for Health Care Improvement. On a regional level, a drug formulary exists for GPs, and some regional specialists’ societies have a written agreement on some treatments. Small peer review groups in general practice may develop their own recommendations locally, as may specialists organized in partnerships and departments.

The second part of the questionnaire included statements of possible barriers and facilitators for using one specific joint treatment guideline. The guidelines for chronic heart failure, hypertension, and diabetes were used as examples, since the implementation programme would focus on these guidelines. The statements were phrased to specify one guideline, for example ‘I do not need this guideline (for chronic heart failure)’. The specific guideline was presented to the respondents before they were asked to complete the questionnaire. The list of statements involved the four domains identified in previous research, focusing on: (i) content of the guideline, (ii) development process, (iii) usefulness and value for practitioners, and (iv) aspects of organization and setting [6,11,12]. Statements from existing instruments, such as the Attitudes towards Guidelines Scale [14], were supplemented with statements derived from an earlier qualitative study [6].

A questionnaire with 42 statements was pre-tested by three physicians for clarity and comprehensiveness. Two statements were excluded for being ambiguous or irrelevant. Agreement with all statements was quantified on a seven-point Likert scale, ranging from ‘strongly agree’ to ‘strongly disagree’.

Analysis
Mann–Whitney tests were used to test for differences in agreement between specialists and GPs, and between responders to the first and second wave of data collection. Kruskal–Wallis tests were used to test for differences between responders confronted with different specific guidelines. Differences in guideline use were tested with {chi}2 tests. The statements dealing with attitudes towards a specific guideline were re-coded so that low scores (1–3) were negative, the median score (4) was neutral, and high scores (5–7) were positive towards guideline use. Numbers of specialists and GPs with negative, neutral, or positive attitudes were compared with {chi}2 tests. Cronbach’s {alpha} was calculated to determine internal consistency between the items within each domain. For internally consistent domains, sum scores were computed by calculating the mean score per item, adjusting for missing values on individual items resulting in a scale from 1 (negative) to 7 (positive).


    Results
 Top
 Methods
 Results
 Discussion
 References
 
More than half of all cardiologists (16 out of 24) and internists (18 out of 36), and three-quarters of all GPs (197 out of 261) in the region completed the general part of the questionnaire (Table 1). There were fewer respondents to the specific part of the questionnaire in the first wave, because at one meeting the participants did not receive one of the specific guidelines included in our study.


View this table:
[in this window]
[in a new window]
 
Table 1 Numbers of specialists and general practitioners (GPs) responding to the questionnaire

 

The 197 GPs were on average 48 years old [standard deviation (SD) 6.7], and 37 (19%) of them were women. The mean age of the 34 specialists was 47 years (SD 7.5), and three (9%) of them were women.

Responses to only three of the 40 items differed for physicians who answered the questionnaire during the educational meetings (wave 1) and physicians who did not attend these meetings (wave 2). Physicians from the first wave more often agreed that medical practice was oversimplified in the guideline (P = 0.005). On the other hand, they less often considered the guideline as being too restrictive (P = 0.027) or containing too many equivalent drugs (P = 0.042). For all further analyses, no distinction is made between data collected in wave 1 or wave 2.

Current situation and general views
Almost all specialists and GPs reported that they used some kind of treatment guideline either regularly or always (Figure 1). Significantly more specialists than GPs reported frequent use of international guidelines and local agreements or recommendations, whereas significantly more GPs than specialists reported use of the national and regional guidelines (P < 0.001).



View larger version (24K):
[in this window]
[in a new window]
 
Figure 1 Current use of treatment guidelines.

 

A small majority of the physicians endorsed the view that primary and secondary care were well harmonized, but at the same time most physicians saw room for improvement (Table 2). Almost all physicians agreed that it was worthwhile to make joint treatment agreements, and many considered it not in the patient’s best interest to switch drugs at the primary–secondary care interface. GPs supported the aim and importance of this specific project more than specialists.


View this table:
[in this window]
[in a new window]
 
Table 2 General views of specialists and general practitioners (GPs) on the current situation at the primary–secondary care interface, and percentages of physicians agreeing with the questionnaire statements

 

Specific barriers and facilitators
Regarding most barriers and facilitators, there were no significant differences between responses to the guideline on hypertension, heart failure, or diabetes (data not shown). Only in the case of the diabetes guideline did a significantly greater number of respondents agree that its implementation is too time consuming and expensive (P = 0.004), and that it limits their professional autonomy (P = 0.005). Therefore, the answers for the three guidelines were taken together and presented as such in Table 3.


View this table:
[in this window]
[in a new window]
 
Table 3 Percentages of physicians agreeing and disagreeing with specific statements about joint treatment guidelines

 

The domains ‘content’, ‘usefulness and value’, and ‘organization and setting’ had acceptable reliability scores for calculating sum-scores ({alpha} = 0.69, 0.76, and 0.64, respectively). On average, both groups of physicians were moderately positive regarding all domains (Table 3), and there were no significant differences between the two groups. The reliability of the domain ‘development process’ was too low ({alpha} = 0.42) to calculate sum scores.

Within the domain ‘content’, most physicians agreed that the recommendations in the joint treatment guideline were congruent with their daily practice, although not all agreed that good choices had been made within drug classes. Specialists in particular believed that recommendations should only be given on drug class level. Despite a high level of confidence that the guideline was evidence based, some specialists considered the guideline to be too conservative.

Some barriers were seen in the domain ‘development process’ regarding the dominance of financial interests, and the distance between developers and practitioners. On the other hand, most physicians agreed that the guidelines were developed by experts.

In the domain ‘usefulness and value’, both groups of physicians believed that the joint treatment guideline was useful as an educational tool, was appropriately applicable in practice, and could facilitate communication and improve harmonization between primary and secondary care. Most GPs and a majority of the specialists agreed that the joint guideline was a good source of advice and could improve quality of care. There was less confidence that it would lead to cost savings. A clear barrier was the fear that the guideline could be misused by government and insurance companies. For at least half of the specialists, lack of need for the guideline, negative influence on innovation, and oversimplification of medical practice were identified as barriers.

Some barriers were observed in the domain ‘organization and setting’. One-third of specialists expected to lose industry support for conferences and research. In addition, specialists considered their practice organization as less supportive of the guidelines than the GPs. On the other hand, GPs more than specialists saw a problem with patients not wanting to be treated according to the guideline.


    Discussion
 Top
 Methods
 Results
 Discussion
 References
 
Our study showed that the specialists and the GPs in this study use different treatment guidelines, indicating a potential problem for continuity of care. Most specialists relied on international guidelines and on agreements within their department. International guidelines often provide a detailed review of the evidence, whereas local agreements usually focus more on reducing drug variability or costs. Most GPs reported use of a regional formulary or national guidelines for their prescribing, which both aim at stimulating rational and cost-effective prescribing. This preference of GPs in the Netherlands for national and local guidelines over international ones is similar to preferences found in other countries [15]. The finding that both specialists and GPs reported frequent use of local or regional guidelines may be related to feelings of ownership. Moreover, peer pressure may be an additional factor facilitating implementation of local guidelines.

Joint treatment guidelines could enable the harmonization of pharmacotherapy at the primary–secondary care interface [4,5]. There are only a few examples of joint drug formularies, such as in the Lothian and Grampian regions in Scotland. Their implementation may have been stimulated by the fact that budget responsibilities for hospital and primary care in Scotland were held by one authority [4], which differs from many other countries, including the Netherlands. Organizational policies and procedures as well as enforcement can increase adherence to guidelines [16,17]. When there are no external pressures, the motivation to use guidelines has to come from the physicians themselves. The perceived need to use a new guideline depends on the physician’s satisfaction with the current situation and the perceived efficacy of the recommended change [11,18]. The change should ‘make sense’, and people involved must be trusted and respected [19].

Both specialists and GPs in our study believed that improvements could be made in communication, harmonization, and quality of pharmacotherapy by making and using joint treatment guidelines. However, GPs seemed more supportive of the project than specialists, and more motivated to use the newly developed guidelines. Problems associated with switching drugs may be more noticeable in general practice. GPs sometimes feel unable to take responsibility for certain treatments started by specialists, and reluctant to make changes [20,21]. This poses problems given the current policy debate in primary health care surrounding GPs being given more responsibility in the treatment of chronic patients. Specialists were more critical regarding the conservative and limiting nature of guidelines, and expected more negative consequences, such as loss of industry support. These barriers for specialists were already identified in an earlier exploratory study, but their relevance was not clear [6]. This current study shows that more than one-third of the specialists worried about losing good research opportunities provided by industry. In addition, more than half of the specialists particularly stated that they did not need these guidelines. Guidelines are especially appropriate in situations where physicians are uncertain about the most effective way of treating a disease [22]. A surplus of self-efficacy, however, could form a barrier.

Although most physicians were positive regarding the content of the guidelines, they were concerned about the development and implementation process. They were afraid that the guidelines could be misused by government and insurance companies, and distrusted the financial interests. This distrust is probably linked to the fact that one of the goals of these guidelines is the reduction of clinical variability and costs. The feeling of suspicion and a government ploy to discipline physicians has been seen before and is associated with a negative physician attitude [23].

Limitations
Using a questionnaire is an efficient way to examine beliefs and barriers in a structured way. Our questionnaire was based on the validated Attitudes towards Guidelines Scale [14]. The four domains included coincide with previously suggested theoretical domains [11]. Socially desirable answers are a common problem in this type of research. We have tried to limit this by using positive as well as negative statements, and by emphasizing that the data would be processed anonymously. The response rate was relatively high, but somewhat lower among specialists than GPs, which could be due to the fact that specialists were less interested in the subject of joint treatment guidelines.

The different methods of data collection could be considered a limitation of our study. However, we found no differences in the majority of responses between the two waves of data collection, allowing us to analyse the data together.

Another limitation is that the physicians had not yet worked with these joint treatment guidelines. We did present them with an example of one guideline, so that they could form an opinion on that specific guideline. We used three different examples, but found that there were no major differences in opinion. Only with respect to the diabetes guideline were physicians more concerned about their autonomy and the efforts needed for implementation. It is possible that a guideline on a completely different (non-cardiovascular) subject might elicit different barriers and facilitators.

Implications
Improving continuity of health care has been put on the agenda by governments as well as professional GP organizations in Europe. In several regions, joint drug formularies or guidelines have been developed and new initiatives are being taken, but little is known about the physicians’ motivation to use joint guidelines. Our results indicate that specialists have a different readiness for implementing these guidelines than GPs. The specialists in our study do not see many problems in the current situation, nor do they see much need to use such guidelines themselves, which implies that they are still at the stage Prochaska has termed the ‘precontemplation stage’ of behavioural change [18]. This stage represents those individuals who have no desire to change their behaviours in the immediate future. For them, joint guidelines are not needed as review of the evidence. This might be a universal problem, as specialists by definition should have extensive knowledge within their specialty. An implementation programme for specialists should focus on the objective of harmonization between primary and secondary care, starting by making them aware of the extent and nature of the current problems at the interface. The GPs in our study seem to be in the contemplation stage, i.e. aware of the problem and having a positive attitude towards using joint guidelines. For them it is important to focus on how to apply the recommendations in practice, addressing some specific perceived barriers, e.g. how to deal with uncooperative patients. The GPs’ awareness and positive attitude towards joint guidelines may be related to a health care system where patients frequently switch between primary and secondary care. For both groups of physicians, it seems necessary to address the distrust regarding financial objectives, and focus more on quality of care than on cost savings.

The authors wish to thank the specialists and GPs who participated in this study. They are also very grateful to the following people: Bert Tent and Jelly Meindersma, who made it possible for the questionnaire to be distributed during the continuing educational meetings, and Cecilia Aarnoudse, who entered the data. The study was funded by the University of Groningen.


    References
 Top
 Methods
 Results
 Discussion
 References
 

  1. Burgers JS, Bailey JV, Klazinga NS, Van Der Bij AK, Grol R, Feder G. Inside guidelines: comparative analysis of recommendations and evidence in diabetes guidelines from 13 countries. Diabetes Care 2002; 25: 1933–1939.[Abstract/Free Full Text]

  2. Iqbal A, Schloss S, George D, Isonaka S. Worldwide guidelines for chronic obstructive pulmonary disease: A comparison of diagnosis and treatment recommendations. Respirology 2002; 7: 233–239.[CrossRef][Web of Science][Medline]

  3. Koes BW, van Tulder MW, Ostelo R, Kim BA, Waddell G. Clinical guidelines for the management of low back pain in primary care: an international comparison. Spine 2001; 26: 2504–2513.[CrossRef][Web of Science][Medline]

  4. Duerden M, Walley T. Prescribing at the interface between primary and secondary care in the UK. Towards joint formularies? Pharmacoeconomics 1999; 15: 435–443.[CrossRef][Medline]

  5. Kvamme OJ, Olesen F, Samuelsson M. Improving the interface between primary and secondary care: a statement from the European working party on quality in family practice (EQuiP). Qual Health Care 2001; 10: 33–39.[Abstract/Free Full Text]

  6. Kasje WN, Denig P, Haaijer-Ruskamp FM. Specialists’ expectations regarding joint treatment guidelines for primary and secondary care. Int J Qual Health Care 2002; 14: 509–518.[Abstract/Free Full Text]

  7. Proeftuin Farmaceutische Zorg. Towards the Groningen Joint Formulary (in Dutch). Groningen: Proeftuin Farmaceutische Zorg, 2000, http://www.proeftuinfarmaciegroningen.nl

  8. Grol R, Jones R. Twenty years of implementation research. Fam Pract 2000; 17 (suppl. 1): S32–S35.[Medline]

  9. Wensing M, van der Weijden T, Grol R. Implementing guidelines and innovations in general practice: which interventions are effective? Br J Gen Pract 1998; 48: 991–997.[Web of Science][Medline]

  10. Thorsen T, Makela M. Changing Professional Practice. Theory and Practice of Clinical Guidelines Implementation. Copenhagen, DSI: Danish Institute for Health Services Research and Development, 1999, http://www.dsi.dk

  11. Cabana MD, Rand CS, Powe NR et al. Why don’t physicians follow clinical practice guidelines? J Am Med Assoc 1999; 282: 1458–1465.[Abstract/Free Full Text]

  12. Langley C, Faulkner A, Watkins C, Gray S, Harvey I. Use of guidelines in primary care-practitioners’ perspective. Fam Pract 1998; 15: 105–111.[Abstract/Free Full Text]

  13. Evans D. A stakeholder analysis of developments at the primary and secondary care interface. Br J Gen Pract 1996; 46: 675–677.[Medline]

  14. Elovainio M, Eccles M, Makela M. Attitudes towards guidelines and a scale for measuring them. In Changing Professional Practice. Copenhagen, DSI: Danish Institute for Health Services, 1999, http://www.dsi.dk

  15. Hobbs FR, Erhardt L. Acceptance of guideline recommendations and perceived implementation of coronary heart disease prevention among primary care physicians in five European countries: the Reassessing European Attitudes about Cardiovascular Treatment (REACT) survey. Fam Pract 2002; 19: 596–604.[Abstract/Free Full Text]

  16. Ward MM, Vaughn TE, Uden-Holman T, Doebbeling BN, Clarke WR, Woolson RF. Physician knowledge, attitudes and practices regarding a widely implemented guideline. J Eval Clin Pract 2002; 8: 155–162.[CrossRef][Web of Science][Medline]

  17. Pathman DE, Konrad TR, Freed GL, Freeman VA, Koch GG. The awareness-to-adherence model of the steps to clinical guideline compliance. The case of pediatric vaccine recommendations. Med Care 1996; 34: 873–889.[CrossRef][Web of Science][Medline]

  18. Prochaska JO. Systems of Psychotherapy: a Transtheoretical Analysis, 2nd edn. Homewood, IL: Dorsey, 1984.

  19. Armstrong D, Reyburn H, Jones R. A study of general practitioners’ reasons for changing their prescribing behaviour. Br Med J 1996; 312: 949–952.[Abstract/Free Full Text]

  20. Sibbald B, Wilkie P, Raftery J, Anderson S, Freeling P. Prescribing at the hospital–general practice interface. II: Impact of hospital outpatient dispensing policies in England on general practitioners and hospital consultants. Br Med J 1992; 304: 31–34.[Abstract/Free Full Text]

  21. Horne R, Mailey E, Frost S, Lea R. Shared care: a qualitative study of GPs’ and hospital doctors’ views on prescribing specialist medicines. Br J Gen Pract 2001; 51: 187–193.[Web of Science][Medline]

  22. Hurwitz B. Guidelines, judgement, opinion, and clinical experience. Qual Health Care 2001; 10: 202–203.[Free Full Text]

  23. Johnston G, Crombie IK, Davies HT, Alder EM, Millard A. Reviewing audit: barriers and facilitating factors for effective clinical audit. Qual Health Care 2000; 9: 23–36.[Abstract/Free Full Text]


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
J Health Serv Res PolicyHome page
S. Campbell, M. MacDonald, B. Carr, D. Anderson, R. MacKinley, and S. Cairns
Bridging the gap between primary and secondary care: use of a clinical pathway for the investigation and management of deep vein thrombosis
J Health Serv Res Policy, January 1, 2008; 13(suppl_1): 15 - 19.
[Abstract] [Full Text] [PDF]


Home page
Int J Qual Health CareHome page
M. Harter, I. Bermejo, G. Ollenschlager, F. Schneider, W. Gaebel, U. Hegerl, W. Niebling, and M. Berger
Improving quality of care for depression: the German Action Programme for the implementation of evidence-based guidelines
Int. J. Qual. Health Care, April 1, 2006; 18(2): 113 - 119.
[Abstract] [Full Text] [PDF]


Home page
Eur J Heart FailHome page
T. Jaarsma, F. M. Haaijer-Ruskamp, H. Sturm, and D. J. Van Veldhuisen
Management of heart failure in The Netherlands
Eur J Heart Fail, March 16, 2005; 7(3): 371 - 375.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (12)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Kasje, W. N.
Right arrow Articles by Haaijer-Ruskamp, F. M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kasje, W. N.
Right arrow Articles by Haaijer-Ruskamp, F. M.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?