• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of bmcfpBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Family Practice
BMC Fam Pract. 2005; 6: 37.
Published online Sep 9, 2005. doi:  10.1186/1471-2296-6-37
PMCID: PMC1253510

Implementing evidence-based medicine in general practice: a focus group based study

Abstract

Background

Over the past years concerns are rising about the use of Evidence-Based Medicine (EBM) in health care. The calls for an increase in the practice of EBM, seem to be obstructed by many barriers preventing the implementation of evidence-based thinking and acting in general practice. This study aims to explore the barriers of Flemish GPs (General Practitioners) to the implementation of EBM in routine clinical work and to identify possible strategies for integrating EBM in daily work.

Methods

We used a qualitative research strategy to gather and analyse data. We organised focus groups between September 2002 and April 2003. The focus group data were analysed using a combined strategy of 'between-case' analysis and 'grounded theory approach'. Thirty-one general practitioners participated in four focus groups. Purposeful sampling was used to recruit participants.

Results

A basic classification model documents the influencing factors and actors on a micro-, meso- as well as macro-level. Patients, colleagues, competences, logistics and time were identified on the micro-level (the GPs' individual practice), commercial and consumer organisations on the meso-level (institutions, organisations) and health care policy, media and specific characteristics of evidence on the macro-level (policy level and international scientific community). Existing barriers and possible strategies to overcome these barriers were described.

Conclusion

In order to implement EBM in routine general practice, an integrated approach on different levels needs to be developed.

Background

Over the past years concerns are rising about the use of Evidence-Based Medicine (EBM) in health care. The calls for an increase in the practice of EBM, seem to be obstructed by many barriers preventing the implementation of evidence-based thinking and acting in general practice. There is a growing need to develop strategies that are able to address the barriers towards evidence-based thinking and acting. We searched Medline, the Cochrane Library, ACP-Journal Club, Dare, Sociological abstracts, Psychinfo and the Campbell Library to reveal studies addressing barriers towards the implementation of EBM (table (table1)1) as well as relevant literature proposing feasible interventions for an evidence-based approach in general practice (table (table2)2) up till May 2003 [1-22]. We used the MeSH-terms Evidence-Based Medicine, Family Physician, Attitude of Health Personal and combined them with free text words like implement$, utilization, use, barrier$, obstacle$, intervent$ and strateg$. An additional hand search was conducted for the period 2000-May 2003 in the BMJ, JAMA, Lancet, New England Journal of Medicine, Annals of Internal Medicine, British Journal of General Practice, Journal of Evidence-Based Medicine and the European Journal of Family Practice. Numerous studies have suggested that a lack of time, easy accessible EBM-resources and competences (knowledge, skills, attitudes) affect the implementation of EBM, as well as the gaps in existing scientific knowledge. Also colleagues, patients and commercial organisations have an influence on the ability to think and act Evidence-Based. Existing interventions aiming to improve the implementation of EBM are limited to logistic or educational support. The review demonstrates a lack of well-controlled empirical studies identifying clear suggestions on how to bridge barriers and improve the implementation of EBM. As a consequence it becomes very difficult to make potential actors at different levels in the health care system feel responsible for developing strategies to optimise the implementation of EBM. The exploration of barriers Flemish GPs (General Practitioners) experience when implementing EBM in daily clinical practice can lead to suggestions about an approach to break down existing barriers. This study proposes a framework, based on experiences of GPs, considering the complex networks of 'actors' and 'factors' affecting the implementation of EBM.

Table 1
Studies addressing barriers towards EBM in general practice
Table 2
Studies addressing strategies to bridge barriers towards EBM in general practice

Methods

An inductive qualitative study was conducted (September 2002 – June 2003) using four focus groups with a total of 31 GPs. Purposeful sampling was used to recruit participants. Two major criteria were used to select the participants: (1) variability in interest towards EBM and (2) variability in expertise with respect to EBM. One group of 7 academics was chosen because of their status of being good informants on EBM. Group 2 consisted of 7 GPs recruited from different local peer groups in a major Flemish city. Group 3 consisted of 6 GPs recruited from an interuniversity postgraduate course in EBM. Group 4 consisted of 11 GPs from a local peer group in a small town.

A professional moderator was hired to facilitate the focus group discussion using a semi-structured interview guide. One researcher took notes on non-verbal actions of participants. Four general topics were discussed: 1. Knowledge and understanding of EBM; 2. Applicability of EBM in general practice; 3. Specific barriers to implement EBM; 4. Suggestions for bridging the barriers. At the end of the focus group (1.5–2 hours) GPs were asked to complete a short questionnaire collecting demographic data (table (table3).3). Each focus group was recorded and transcribed verbatim. Two independent researchers identified the important concepts by coding the first two transcripts separately. No major interrater inconsistencies were found. Data collection and analysis were guided by a combination of a 'between-case' analysis [23] and an inductive strategy based on 'grounded theory' approach [24]. In the 'between-case' analysis we classified the content of all focus groups (1 group = 1 case) in a matrix, looking for themes that cut across the different cases. Concepts were classified in different levels: a micro-, a meso- and a macro level (table (table4).4). To check the consistency of the matrix all individual ideas were then attached to a board and categorised by a group of researchers from three different disciplines (medicine, sociology, andragology). No theoretical framework was proposed to the researchers in advance. Starting from the original data, barriers and strategies were then labelled as clusters of influencing 'actors' and 'factors' (table (table4)4) towards the ability of GPs to implement EBM. To gain a certain level of abstraction in the empirical material insights of both analyses were used to develop a classification framework (figure (figure1),1), which will be further explained in the results section.

Table 3
Demographic data of GP participants (n = 31)
Table 4
Explanation of the concepts used to build the classification scheme
Figure 1
Classification scheme of influencing 'Actors' and 'Factors' on different levels.

Results

The classification scheme focuses on influencing 'actors' and 'factors' at different levels in health care that might have an impact on the ability of GPs to think and act according to the principles of EBM (figure (figure1).1). All EBM-related barriers and strategies, mentioned by the GPs, were classified as an 'actor' or a 'factor' on a micro-, meso- or macro-level. On the micro level (individual practice) we identified two 'actors' (patients and colleagues) and three 'factors' (competences, time and EBM-resources) that have an impact on the intention of GPs to handle clinical problems according to the principles of EBM. On the meso level (institutional level) two 'actors' were identified to affect implementation of EBM: commercial organisations and consumer organisations. Health care policy and the media were the influencing 'actors' on the macro level (broader social and political environment). The 'factor' 'characteristics of evidence' was also categorised on the macro level, because of its relevance to the international scientific community.

1. Problems and interventions related to the special identity of general practice as a discipline (table (table55)

Table 5
Statements related to the specific identity of general practice as a discipline

In the focus group interviews one of the important issues was: does the EBM-paradigm fit our specific way of acting and the problems that occur in our daily practice (1:23.1 – statement 1 in table table5)?5)? Many GPs stated that their acting is built on intuition, habits and previous experience. They also indicate hat it is often impossible to handle the care for patients completely evidence-based, because the patients' symptoms are often vague and GPs are confronted with a broad spectrum of different questions and diseases (4:23.3). A continuous update on scientific information is not feasible. According to several GPs a possible strategy for improving the use of evidence will need a better demarcation of the GPs tasks and responsibilities. The rather broad spectrum of health care problems they are confronted with makes it hard to keep up to date with current knowledge. Furthermore they stated that their intellectual position must be strengthened (1:153.4). Many GPs think it is worthwhile to be stimulated and encouraged to reflect on individual decisions, patterns of prescribing and perceptions of therapeutic freedom (4:36.1). Furthermore, GPs consider very important the impact of 'evidence-based thinking and acting' on outcomes (improvement of mortality and morbidity rates, better quality of life,...) for patients to be assessed in order to keep them motivated to implement it in practice. Despite the fact that many patient outcomes can not be easily fit in existing research designs on the effectiveness of clinical practice, the participating GPs do feel the need to be aware of these outcomes in order to maintain the efforts needed for EBM.

2. Problems and interventions at the micro-level (table (table66)

Table 6
Statements related to the micro-, meso- or macro-level

Actor: patients

The interaction process with patients has, according to many participants, an impact on the possibility to implement EBM in practice. Many patients have clear expectations on how they wish to be treated. This forces GPs in a position adapting to the patients' preferences, rather than to behave in an evidence-based manner (4:134.2). GPs state that the emancipation process of patients has blurred the autocratic position of doctors and demands for different behavioural strategies. Despite the fact that doctors consider their patients as well-informed, they lack the knowledge of EBM (6:30.2). Many GPs refer to the difficulties of patients to understand the rapid changes and insights in medicine (1:53.2). To dissolve this problem, most of the GPs are willing to take responsibility to create a safe environment in which the evidence-based story can be taught to the patient, for example by searching for evidence together through an evidence-based internet approach during consultation. Consumers need education, in which they can be taught to behave critically towards medication and media. According to several GPs consumer organisations could play an important role here.

Actor: colleagues

Conflicts with colleagues seem to be common. GPs clearly express the opinion that specialists' thinking is too commercial (4:148.5). This implies they are promoting and using products based on a commercial rather than an evidence-based approach. There is a general feeling that specialists who do act evidence-based should be protected. GPs also feel strongly for building networks with reliable colleagues. The fact that patients still consider the advice of a specialist more valuable is also brought forward. GPs are very much concerned about the fact that their role will become reduced to treating those patients who do not fit the criteria of specialists (1:65.6). Furthermore, in educational programmes more lectures and workshops should be given by colleagues who are not explicitly connected to universities, making EBM more of a real-life business (1:56.1).

Factors: time, EBM-resources and competences

Lack of time, EBM-resources, knowledge and skills are the barriers that are most recognised in existing literature. They recur during the focus group interviews. Many GPs think it is worthwhile to create a helpdesk system or a central on-line information system that provides answers to specific questions (4:180.3). On-line sources should be easy to navigate and free of charge. Guidelines and Critical Appraised Topics would be a great help. A select team of GPs should be paid to develop them. Educational programs should focus on an integration of EBM-principles in medical school and further training courses. Specialised EBM-teams should be established. The idea of outreach visits by independent educators, paid by government, gains approval by many GPs (4:181.2). As a lot of existing EBM material does not reach the GPs, they suggest to put more efforts into getting this material under their attention. Furthermore, it will be important to change GPs attitudes towards EBM. Many GPs state that EBM remains too theoretical and authority based (1:126.4). It restricts clinical practice, limiting the choices. Resistance should be broken down, for instance by finding inspiration in change management techniques, as indicated by some participants.

3. Problems and interventions at the meso-level (table (table66)

The EBM movement is relatively new in Flanders. At this stage different organisations undertook efforts to stimulate EBM, for example universities, the Belgian Centre for Evidence-Based Medicine and other occupational groups. Some GPs criticise the fragmentation of initiative, which does lead to an organisational chaos in the field. GPs do see a role for government in providing a network which tightens all different institutions together (6:99.9).

Actor: commercial organisations

Several GPs criticise the fact that educational programmes and the development of guidelines is sponsored by commercial organisations, for example pharmaceutical firms and their representatives (1:152.5). Questions do rise about the honesty of their message, in which EBM is used as a fashion term. Moreover, GPs receive a lot of information from different sources. Only a small part of the information is independent and unfortunately not easily identified in the information overload (5:73.3). Suggestions are made to label independent information, distinguishing it from less relevant information. Conflicts of interest must be clearly stated. Many participants feel that spreading a uniform EBM message by all actors in the field of health care is very important and that this specific approach should also become a necessity for the commercial organisations.

Actor: consumer organisations

GPs in the sample worry about the quality of the messages spread by consumer organisations, for example self help groups. In order to stimulate EB-practice more attention should be paid to the content and form of the messages and the methods used (1:101.4). According to several GPs consumer organisations could play a major role in distributing evidence-based messages to patients that are screened for quality and in measuring their satisfaction with evidence-based treatments.

4. Problems and interventions at the macro-level (table (table66)

Actor: health care policy

Belgium has a particular way of financing the GPs. GPs are most of the time independent entrepreneurs, who are financed by the number of medical acts defined in the nomenclature. Several GPs raise their voice about 'the policy system' that works counterproductive for an evidence-based approach. The time spent on research and information seeking behaviour is not paid for. One focuses necessarily on the amount of consultations, rather then evidence-based acting, and doctors adapt to the protocols they are forced to follow (1:188.6). Consultations lead to a higher income for a doctor but, as indicated by several GPs, often also to unnecessary practices (4:102.2). According to some participants a fixed income could be a solution, as well as financial incentives for extra time that is invested in acting evidence-based. Reimbursement systems should be consequent with what is promoted regarding to EBM (4:132.6). Some GPs criticise the fact that EBM seems to develop as a reductionist model to judge results of clinical acting. Most GPs think that broader outcome-measures should be taken into account, for example quality of life (1:212.5). Some concerns are expressed about the coaching of GPs to implement evidence. Too easily, government assumes that all doctors are comfortable with the evidence-based paradigm. GPs are given the noble task of being the messengers, without having enough structured information and without being enough knowledgeable for that 'new' role. Therefore many voices are raised to improve the distribution of evidence-based information.

Actor: the media

The mass media are identified as a counterproductive force, because products or services are being promoted that are not always supported by evidence (1:98.2). Patients seek answers to their questions on the internet. The quality of this information is doubtable. This changing information seeking behaviour has an impact on the relation between GPs and patients. Some GPs state that patients become negotiating partners (6:27.8). Starting a social debate could be a first step to promote coherence between different parties of interest involved in the production, interpretation, use, dissemination and promotion of evidence. In defining a rational policy towards EBM GPs find it important to be involved in the process and to integrate late-adapters in the evidence-based movement (1:149.3). The media could play an important role in representing their voice in the economic choices made to support an evidence-based health care system, since these choices are often made by governmental institutions only.

Factor: sub-optimality of 'evidence'

The sub-optimality of the evidence provided is frequently stated as a barrier to the implementation of EBM. Contradictions between similar evidence-based studies are common. Some of the studies that are promoted as 'evidence-based' are not up-to-date. Several GPs point towards the lack of evidence for many of their problems (5:56.3). There is also a time-delay between the research process and the actual adaptation of the new insights in the field (6:11.8). No explicit suggestions to overcome these barriers are given by the participants.

Discussion

The results presented in previous sections give an overview of issues mentioned by different GPs during the focus group sessions. Compared to what already was known from previous qualitative research (table 1.2) this study adds two more 'actors' that influence the implementation of EBM in general practice: consumer organisations at the meso-level and health care policy at the macro level. Providing logistic and educational support seems to be important to participants in previous research programmes, as well as for Flemish practitioners. Recent reviews on the effects of decision support systems to support evidence-based practice conclude that these strategies improve practitioners' performance [25,26]. Practitioners start using online evidence during consultations much more than previously reported [27,28]. Educational programmes have also proven to impact on practitioners' competences [29,30]. However, they should be moved from the classroom to clinical practice [31]. The approach for implementing EBM in general practice needs to start from the specific characteristics of the profession. Despite the fact that GPs are keen to consider evidence in clinical decision making, there is a widespread belief that intuition plays a vital role in primary care [32]. GPs are not likely to change this belief until the impact of the evidence-based thinking and acting on patients' outcomes is assessed.

Apart from these insights the focus group research reveals that interventions should also focus on communication, rational policy making and the building of networks between different 'actors' to impact on an actual implementation of EBM in practice. The analytic classification proposed in this paper has the advantage to identify the complexity of problems and by consequence to identify and focus on interventions. To our knowledge no other study in the field of difficulties in the implementation of EBM in general practice has proposed a theoretical framework wherein barriers can easily be located and which naturally leads to the development of strategies to tackle them at the right level. We feel the framework is of relevance to the international community of GPs and those who promote EBM in this context. The classification model as presented seems to be a useful tool to orient change management processes.

Some specific barriers for GPs are directly linked to the specific characteristics of the Belgian health care system. These characteristics should be taken into account in other countries or regions. Considering this aspect we want to warn for generalisations even in Belgium. Although the organisation of the health care system is a federal issue, the results presented could be biased since health care traditions are culturally diverging in Flanders, the Walloon provinces and Brussels. However, these contextual issues are fundamental to address when developing policies or interventions.

The issue of generalisation brings us to some other methodological considerations. The 31 general practitioners who participated in this study formed a small sample of Flemish GPs. The sample was neither random nor representative. Given the basis on which most of the GPs joined the study we assume that their interest in EBM would be greater than that of their colleagues in the field. However, we are convinced that precisely this positive attitude and experience revealed knowledgeable results to contemplate further about interventions facilitating an evidence-based approach. The focus group methodology was considered appropriate to identify barriers and suggestions to overcome them. Methodological rigour was assured by using a combined approach of 'between-case analyses' and an inductive strategy based on 'grounded theory approach'. The first two focus groups were coded by two independent researchers and the analysis was checked and discussed with two senior researchers. However, when assessing the outcomes of the focus groups it was noticed that saturation was not reached. The last focus group interview still generated seven new ideas: five new barriers and two more interventions. Therefore we cannot guarantee that all factors, actors and suggestions were identified. More methodological research on predictive models for saturation points in qualitative research is necessary.

Another interesting methodological issue is that we found a high level of 'agreement' between participants. A possible explanation for the lack of 'extreme cases' could be that the topic under study (the implementation of EBM) was relatively new to many participants. Conversation in the focus groups were about 'recognition' and 'explanation' rather than 'debate' and 'opposing opinions' about suggestions. This probably explains why we inventoried more barriers than suggestions on interventions and strategies.

Conclusion

The classification model can be used as a frame of reference to initiate change management and policy interventions. For a successful implementation of EBM different 'actors' should be mobilised at different levels, as they are able to prevent GPs from acting evidence-based. However, potential conflicts between 'actors' can be bridged by (1) creating the necessary communication platforms between actors at different levels and within different disciplines (including patients, policy makers, researchers, consumer organisations, representatives from the media, commercial organisations, primary care practitioners, secondary care practitioners etc.), (2) communicating a consistent and uniform message on the principles of EBM and (3) modifying the current health care system towards a more evidence-based approach (for example an update of the reimbursement system, incentives that stimulate evidence-based acting, (re)opening the discussion on a fixed income vs. an income based on consultations). Future research projects should focus on the changing relations between GPs and other 'actors'. Furthermore, (4) qualitative educational programmes should be offered, ideally within working hours, with a reasonable compensation for the income lost and organised by independent organisations, (5) access to EBM-resources should be free of charge, easy accessible and whenever possible provided in the mother tongue of the practitioners and (6) gaps in knowledge need to be addressed by researchers world wide. A better understanding of the complex relationships as proposed in the conceptual framework (figure (figure1)1) and the 'factors' influencing the implementation of EBM will hopefully lead to the funding of research projects in which a set of strategic priorities can be inventoried and worked out to support and stimulate a coherent evidence-based approach within the health care system. In this important negotiation process all identified actors in the field of health care have to be involved.

Competing interests

The author(s) declare that they have no financial competing interests. However, answers to questions could have been influenced by a convenience bias, as the participating GPs were aware that the focus groups were carried out by a research team known to be in favour of EBM.

Authors' contributions

KH set up the focus groups, coded the manuscripts, analyzed the qualitative data and drafted the manuscript. BA coordinated the research process and participated in the design of the study. EV assisted in the coding process and participated in the data-analysis. ML helped developing the conceptual framework. AD and FB interpreted the results and commented on the draft version of the manuscript. All authors read and approved the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2296/6/37/prepub

Acknowledgements

We wish to acknowledge the time and enthusiasm of the GPs who took part in the focus groups. We like to thank Professor R. Schepers from the department of sociology of 'Katholieke Universiteit Leuven' for her comments on the final drafts of the manuscript.

References

  • Olatunbosun OA, Edouard L, Pierson RA. Physicians' attitudes toward evidence- based obstetric practice:a questionnaire survey. BMJ. 1998;316:365–6. [PMC free article] [PubMed]
  • McColl A, Smith H, White P, Field J. General practitioners' perceptions of the route to evidence-based medicine: a questionnaire survey. BMJ. 1998;316:361–65. [PMC free article] [PubMed]
  • McAlister FA, Graham I, Karr GW, Laupacis A. Evidence-based medicine and the practicing clinician. J Gen lntern Med. 1999;14:236–42. doi: 10.1046/j.1525-1497.1999.00323.x. [PMC free article] [PubMed] [Cross Ref]
  • Mayer J, Piterman L. The attitude of Australian GP's to evidence-based medicine: a focus group study. Fam Pract. 1999;16:627–32. doi: 10.1093/fampra/16.6.627. [PubMed] [Cross Ref]
  • Tomlin Z, Humprey C, Rogers S. General practitioners' perceptions of effective health care. BMJ. 1999;318:1532–5. [PMC free article] [PubMed]
  • Scott I, Heyworth R, Fairweather P. The use of evidence-based medicine in the practice of consultant physicians. Aust N Z J Med. 2000;30:319–26. [PubMed]
  • Freeman AC, Sweeney K. Why do general practitioners do not implement evidence?: qualitative study. BMJ. 2001;323:1100–2. doi: 10.1136/bmj.323.7321.1100. [PMC free article] [PubMed] [Cross Ref]
  • Young JM, Ward JE. Evidence-based medicine in general practice: beliefs and barriers among Australian GP's. J Eval Clin Pract. 2001;7:201–10. doi: 10.1046/j.1365-2753.2001.00294.x. [PubMed] [Cross Ref]
  • Ely JW, Osheroff A, Ebell MH, Chambliss ML, Vinson DC, Stervermer JJ, Pifer EA. Obstacles to answering doctors' questions about patient care with evidence:qualitative study. BMJ. 2002;324:1–7. doi: 10.1136/bmj.324.7339.710. [PMC free article] [PubMed] [Cross Ref]
  • Putnam W, Twohig PL, Burge FI, Jackson LA, Cox JL. A qualitative study of evidence in primary care: What the practitioners are saying. CMJA. 2002;166:152–30. [PMC free article] [PubMed]
  • Al-Ansary LA, Khoja TA. The place of evidence-based medicine among primary health care physicians in Riyadh region, Saudi Arabia. Fam Pract. 2002;19:537–42. doi: 10.1093/fampra/19.5.537. [PubMed] [Cross Ref]
  • Shawn T, Guilherme CD, Ross EGU. Evidence-based medicine in primary care: a qualitative study of family physicians. Fam Pract. 2003;4:1–9.
  • Hayward JA, Wearne SM, Middleton PF, Silagy CA, Weller DP, Doust JA. Providing evidence-based answers to clinical questions: a pilot information service for general practitioners. Med J Aust. 1999;171:547–50. [PubMed]
  • Oswald N, Bateman H. Applying research evidence to individuals in primary care: a study using non-rheumatic atrial fibrillation. Family Practice. 1999;16:414–9. doi: 10.1093/fampra/16.4.414. [PubMed] [Cross Ref]
  • Brassey J, Elwyn G, Price C, Kinnersley P. Just in time information for clinicians: a questionnaire evaluation of the ATTRACT project. BMJ. 2001;322:529–30. doi: 10.1136/bmj.322.7285.529. [PMC free article] [PubMed] [Cross Ref]
  • Markey P, Schattner P. Promoting evidence-based medicine in general practice-the impact of academic detailing. Family Practice. 2001;18:364–6. doi: 10.1093/fampra/18.4.364. [PubMed] [Cross Ref]
  • Alper BS, Stevermer JJ, White DS, Ewigman BG. Answering family physicians' clinical questions using electronic medical databases. Journal of family practice. 2001;50 http://www.jfponline.com/content/2001/11/jfp_1101_09600.asp [online] [PubMed]
  • Del Mar CB, Silagy CA, Glasziou PP, Weller D, Spinks AB, Bernath V, Anderson JN, Hilton DJ, Sanders SL. Feasability of an evidence-based literature search service for general practitioners. Med J Aust. 2001;175:134–7. [PubMed]
  • Swinglehurst DA, Pierce M, Fuller JC. A clinical informaticist to support primary care decision making. Qual Health Care. 2001;10:245–9. doi: 10.1136/qhc.0100245... [PMC free article] [PubMed] [Cross Ref]
  • Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer HH, Kunz R. Do short courses in evidence-based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence-based medicine. BMJ. 2002;325:1338–41. doi: 10.1136/bmj.325.7376.1338. [PMC free article] [PubMed] [Cross Ref]
  • Greenhalgh T, Hughes J, Humprey C, Rogers S, Swinglehurst D, Martin P. A comparative study of two models of a clinical informaticist service. BMJ. 2002;324:524. doi: 10.1136/bmj.324.7336.524. [PMC free article] [PubMed] [Cross Ref]
  • Schwartz K, Northrup J, Israel N, Crowell K, Lauder N, Neale AV. Use of on-line Evidence-based Resources at the point of care. Fam Med. 2003;35:251–6. [PubMed]
  • Miles M, Huberman A. Qualitative data analysis: an expanded sourcebook. California (US): Sage Publications; 1994.
  • Strauss A, Corbin J. Grounded theory in practice. London (UK): Sage Publications; 1997.
  • Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330:765. doi: 10.1136/bmj.38398.500764.8F. [PMC free article] [PubMed] [Cross Ref]
  • Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293:1223–38. doi: 10.1001/jama.293.10.1223. [PubMed] [Cross Ref]
  • Magrabi F, Coiera EW, Westbrook JI, Gosling AS, Vickland V. General practitioners' use of online evidence during consultations. Int J Med Inform. 2005;74:1–12. doi: 10.1016/j.ijmedinf.2004.10.003. [PubMed] [Cross Ref]
  • Van Duppen D, Aertgeerts B, Goossens F, Van Linden A, Neirinckx J, Seuntjens L, Hannes K. Internet implementation of Evidence Based Medicine during patient visits (online-on-the-spot) Health Expectations.
  • Hyde C, Parkes J, Deeks J, Milne R. Systematic Review of effectiveness of teaching critical appraisal [critical appraisal] Oxford University Institute of Health Sciences, Centre for Statistics in Medicine; 2000.
  • Parkes J, Hyde C, Deeks J, Milne R. Teaching critical appraisal skills in health care settings. The Cochrane Database of Systematic Reviews. 2001. [PubMed]
  • Coomarasamy A, Khan KS. What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJ. 2004;329:1017. doi: 10.1136/bmj.329.7473.1017. [PMC free article] [PubMed] [Cross Ref]
  • Tracy CS, Dantas GC, Upshur RE. Evidence-based medicine in primary care: qualitative study of family physicians. BMC family practice. 2003;1:6. doi: 10.1186/1471-2296-4-6. [PMC free article] [PubMed] [Cross Ref]

Articles from BMC Family Practice are provided here courtesy of BioMed Central
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

  • MedGen
    MedGen
    Related information in MedGen
  • PubMed
    PubMed
    PubMed citations for these articles