pmc logo image
Logo of jmlaJournal information.SubscribeSubmissions on the Publisher web site.Current issue of JMLA in PMC.Also see BMLA journal in PMC.

Formats:

J Med Libr Assoc. 2009 January; 97(1): 47–50.
doi: 10.3163/1536-5050.97.1.009.
PMCID: PMC2605037
The information-seeking behavior of clinical staff in a large health care organization
Philip N. Hider, MBBChB FAFPHM MMedSci MPH,corresponding author Gemma Griffin, BA LLB, Marg Walker, BA DipNZLS ALIANZA, and Edward Coughlan, MBChB DipCompSci FAChSHM
Philip N. Hider, Senior Lecturer, University of Otago, Christchurch P.O. Box 4345, Christchurch 8140, New Zealand. Email: phil.hider/at/chmeds.ac.nz;
corresponding authorCorresponding author.
Received May 2008; Accepted August 2008.
Internet-based tools are easily accessible and can assist busy health professionals who cannot be expected to know the answer to every clinical question [1]. Some variability appears to exist in how Internet-based resources are used by different groups of health professionals [2].
A postal survey was undertaken to assess the information-seeking behavior and needs of a wide range of hospital-based staff including allied health professionals in one large organization to inform training and resource planning. The study was undertaken at the Canterbury District Health Board (CDHB), the main health funding and provider organization serving 500,000 people in the center of the South Island of New Zealand. The main hospital site provides approximately 1,000 beds and includes a medical library with librarians who are available to assist with searching and training. Staff have access to computers with high-speed Internet; however, their formal training in evidence-based medicine varies.
A random sample of 850 hospital clinical staff belonging to 3 professional groupings—medical and dental, nursing, and allied health professionals—was obtained from a payroll database that included all employees. The number from each group in the sample was based on their respective proportions in the CDHB workforce. Staff were eligible for inclusion in the survey if they worked any number of hours as a nursing, allied health, or medical and dental professional. The nursing category included midwives, and allied health included a variety of occupations such as physiotherapists and pharmacists. Casual, agency, and locum staff were excluded. Sample size estimates allowed for the frequency in any group of 40% and frequency in another group of 60% and an expected minimum response rate of 33% per group, with alpha of 0.05, power of 80% [3].
A two-page survey was mailed to staff using an internal mail system in November 2006. The survey was previously piloted among several groups of different health professionals. A postal survey was decided on because feedback suggested it would be more acceptable to staff than an online version. Questions in the survey asked staff how often they consulted textbooks or papers, experts, coworkers, search engines, and library resources to find information. The term “experts” was undefined, and respondent were left to identify colleagues they considered experts. The questions focused on ten key Internet-based resources provided by the library: UpToDate, Clinical Evidence, EBM Reviews, Harrisons, MEDLINE via Ovid MEDLINE or PubMed, Embase, TRIP, CINAHL, Google, and Google Scholar. Staff were asked how often they used these, how valuable they found each one, and what techniques they used when searching MEDLINE. Additional questions asked staff about their method of assessing the validity of information, wish to obtain more teaching in searching and/or appraisal, and preferred method for further tuition.
The survey was completely anonymous and only collected limited demographic data (age and professional group) to assess the representativeness of the responders. Two reminder mailings were conducted to improve the response rate, before the response collection period ended in January 2007. The returned survey forms were entered into a database using Microsoft Access 2003. The database was manually checked against the original forms. The data were analyzed using Microsoft Excel 2003 and Stata (version 8). Ethical approval was gained from the South Island Health Ethics Committee.
Responses were received from 518 staff (60.9% of 850). Among the sample group, medical and dental professionals had the highest return rate (69.5%, n = 73), followed by allied health (64.8%, n = 149) and nursing staff (56.2%, n = 290). Most respondents were over 45 years of age (45.6%, n = 236) or between 30–45 years (41.5%, n = 215).
Professional groups showed some variation in information resource use. Medical and dental staff were more likely to consult search engines at least weekly (82.8%, n = 58) or use library resources (62.9%, n = 46) than either nursing (38.8% and 16.5%, n = 101) or allied health staff (51.4% and 27.3%, n = 72). A similar proportion of nurses consulted coworkers at least once a week (85.4%, n = 228) as did medical staff (81.3%, n = 52), but the proportion of allied health professionals was smaller (54.6%, n = 107). All professional groups frequently consulted experts (nurses: 80%, n = 216; doctors: 73.2%, n = 52; allied health: 80%, n = 107).
All professional groups used Google more than any other electronic resource (Table 1). More than half of all professional groups used Google at least once a month, including 86% of medical and dental staff. Ovid/PubMed was used at least monthly by most (81.6%) medical and dental staff but fewer nursing (31%) and allied health (40.6%) staff. By contrast, nursing staff reported higher levels of use of the CINAHL database, particularly compared with medical and dental staff. Differences between professional groups were also evident in use of the UpToDate service, with a higher proportion of medical and dental staff using it at least monthly (34.8%), compared with nursing (15.8%) and allied health (8.9%). Overall, many respondents did not regularly access any information resource: 37% rarely or never consulted Google, and 58% rarely or never consulted Ovid MEDLINE or PubMed.
Table 1
Table 1
Frequency of use of electronic information sources by professional group
Those resources for which high levels of use were reported somewhat predictably also received high value ratings from staff. Google received the most “very valuable” ratings of any resource. It topped all other resources in responses from nursing and allied health staff and was ranked second behind Ovid/PubMed by medical and dental staff. Interestingly, some resources that were accessed less often were still given comparatively high value ratings, notably TRIP and EBM Reviews.
In relation to the searching methods clinical staff employed with their use of MEDLINE, almost all responders (98%) used keywords to search the database, but few (7%) used a Clinical Queries or Medical Subject Headings browser.
The most popular option (85.3% of responders) for how staff assessed the reliability and authority of medical information found on the Internet was whether the information had been published in a reliable journal. This option was followed by information published by a professional organization (64.8%) and staff's critical appraisal of the information (48.3%).
A strong desire for further training was also evident. Over 82% of staff wanted to receive further training in searching Internet-based resources. Nearly three-quarters of staff wanted such training to be delivered as a 1–2 hour course.
The results from this survey indicate that hospital clinical staff in a large health care organization have clear preferences for particular resources, searching methods, and continuing education formats. The results are largely consistent with those from other relevant studies. Recent systematic reviews [2,4] have reported that people and text resources appear to be favored over electronic resources and that this has not changed over time, even though access to electronic resources has increased [2,4].
All three groups of hospital clinical staff show a clear preference for Google among electronic resources. The high use of Google recorded in this study is probably related to the expansion of the Internet, the growing familiarity of health professionals with electronic resources, and health professionals' realization that the Internet, and particularly Google, is able to yield results quickly in time-pressured clinical environments [5]. Google has been shown to be useful in diagnosing difficult cases [1]; however, concerns have been raised about the quality of information it returns [6]. Google rates information according to the number of hits and may therefore favor older references. While Google Scholar offers better coverage of peer-reviewed medical literature, the only health sciences database indexed is MEDLINE and complex searching is still limited [7]. The fact that staff most commonly judges information to be authoritative if it is published in a reliable journal suggests that, while staff frequently use Google, they might be cautious about the reliability of information they find this way. It appears that with the increasing amount of academic health information being placed on the Internet, staff may be using Google as a quick way to access journals, possibly even using Google as a portal to MEDLINE, instead of using traditional library resources.
The data on the search techniques of those staff who used the MEDLINE database to find information presented very similar results when compared with previous research. Cullen consistently noted that 94% of users searched with keywords [8], and both studies showed very low use of Clinical Queries or Medical Subject Headings browsers and other advanced functions offered by MEDLINE. The absence of these skills suggested that practitioners might not be receiving the best evidence, and they identified a priority for future training, particularly given the phenomenal growth in MEDLINE [9].
This survey provides a unique snapshot of the skills, attitudes, and behavior of hospital clinical staff, including allied health professionals, in a large regional health organization. Potential limitations include the relatively few medical staff responders and the proportionately lower response from nursing staff. The findings suggest that a large number of staff use and highly value Internet-based resources for clinical information seeking. Employers need to ensure that skills in this area continue to be developed and ensure that reliable Internet-based resources are readily available to staff. Future research should explore what type of clinical questions health professionals use different resources for, how they search for information, and how effective they are at using this information to inform patient care.
Contributor Information
Philip N. Hider, Senior Lecturer, University of Otago, Christchurch P.O. Box 4345, Christchurch 8140, New Zealand. Email: phil.hider/at/chmeds.ac.nz;
Gemma Griffin, Student, University of Otago, Christchurch P.O. Box 4345, Christchurch 8140, New Zealand. Email: gemma/at/ gemmagriffin.com;
Marg Walker, Head Librarian, Canterbury Medical Library; University of Otago, Christchurch P.O. Box 4345, Christchurch 8140, New Zealand Email: marg.walker/at/otago.ac.nz;
Edward Coughlan, Clinical Director, Christchurch Hospital, Riccarton Avenue, Christchurch 8011, New Zealand Email: edward.coughlan/at/cdhb.govt.nz;
1. Tang H., Ng J.H. Googling for a diagnosis—use of Google as a diagnostic aid: Internet based study. BMJ. 2006 Dec 2;333(7579):1143–5. doi: 10.1136/bmj.39003.640567.AE. [PubMed]
2. Dawes M., Sampson U. Knowledge management in clinical practice: a systematic review of information seeking behavior in physicians. Int J Med Inform. 2003 Aug;71(1):9–15. doi: 10.1016/S1386-5056(03)00023-6. [PubMed]
3. Dupont W., Plummer W. Power and sample size calculations. a review and computer program. Controlled Clinical Trials. 1990;11:116–28. [PubMed]
4. Coumou H.C.H., Meijman F.J. How do primary care physicians seek answers to clinical questions? a literature review. J Med Libr Assoc. 2006 Jan;94(1):55–60. [PubMed]
5. Giustini D. How Google is changing medicine. BMJ. 2005 Dec 24;331(7531):1487–8. doi: 10.1136/bmj.331.7531.1487. [PubMed]
6. Steinbrook R. Searching for the right search—reaching the medical literature. N Engl J Med. 2006 Jan 5;354(1):4–7. [PubMed]
7. Andrews J.E., Pearce K.A., Ireson C., Love M.M. Information-seeking behaviors of practitioners in a primary care practice-based research network (PBRN). J Med Libr Assoc. 2005 Apr;93(2):206–12. [PubMed]
8. Cullen R.J. In search of evidence: family practitioners' use of the Internet for clinical information. J Med Libr Assoc. 2002 Oct;90(4):370–9. [PubMed]
9. Druss B.G., Marcus S.C. Growth and decentralization of the medical literature: implications for evidence-based medicine. J Med Libr Assoc. 2005 Oct;93(4):499–501. [PubMed]

See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph