• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of procamiaLink to Publisher's site
AMIA Annu Symp Proc. 2003; 2003: 405–409.
PMCID: PMC1480095

Why Don’t Physicians Use Their Personal Digital Assistants?

Yen-Chiao Lu, MS, RN,1 Jin (Janet) Kyung Lee, BSN, RN,1 Yan Xiao, PhD,2 Andrew Sears, PhD,3 Julie A. Jacko, PhD,4 and Kathleen Charters, PhD1

Abstract

As the Personal Digital Assistant (PDA) user population continues to expand, there is a need to design more useful devices and applications to facilitate the utilization of PDAs. We conducted a structured interview study to examine PDA usage and non-usage patterns among physicians. The purpose of this descriptive study was to identify the barriers that impede physicians in their PDA use. A data collection tool was developed to record: 1) how physicians use their PDAs, 2) functions and applications used, 3) functions and applications not used, 4) reasons and examples of why physicians don’t use PDAs for those functions, and 5) the recall of specific incidents of PDA usage using Critical Incident Technique (CIT). Interview data were transcribed and analyzed. Study findings and how those barriers can be addressed are discussed.

INTRODUCTION

Sparked by enthusiasm over these types of devices, more than 20 million personal digital assistants (PDAs) have been sold worldwide over last 5 years. These pocket-sized digital companions can store thousands of appointments, contacts, notes, as well as other personal and professional data. Worldwide shipments of PDAs totaled up to 12.1 million units in 2002, according to Dataquest Inc. Currently, most people purchase PDAs to use at work and connect them to applications on desktop computers.12

In Healthcare, approximately 26% of U.S. physicians used PDAs in 2001, and it has been documented that approximately 85% of physicians would consider carrying a PDA.34 These data suggest that PDAs have become an integral component of many clinicians’ daily routines. PDAs may provide tremendous benefits in assisting physicians and other healthcare providers to access, manage, and share critical medical information at the point of care.

Many efforts have been reported in the literature on physicians’ PDA usage patterns. For example, some of these studies showed that physicians used PDAs to manage personal information using a datebook or address book, to access drug references, and to record data. 57 However, no attempts have been made to examine the non-usage patterns. It would be valuable and beneficial to understand the barriers to full utilization of PDAs, so that technical, educational, and organizational or institutional solutions may be proposed to address those barriers.

The goal of our study was to investigate the physicians’ non-usage patterns by conducting a structured interview using the Critical Incident Technique (CIT) with physicians to identify potential barriers to PDA usage in various acute clinical settings.

SETTING & SUBJECTS

Twenty physicians from a major university medical center were recruited and interviewed face to face. Seven were attending physicians, twelve were residents, and one was a fellow. Fifteen of the subjects were males and five were females. The settings where the subjects worked included trauma, general surgery, emergency department, and neonatal intensive care. The average length of PDA ownership was 1.17 years. Seven of the physicians were issued a PDA whereas thirteen purchased the devices themselves. All PDAs run the Palm operating system.

METHOD

Tool design

A data collection tool using the principles of CIT was developed to interview the subjects. Table 1 provides CIT interview questions.

Table 1
CIT Questions.

Flanagan developed CIT in the early 1950s; the technique was used to improve the selection of pilots and pilot training programs.8 According to Flanagan, the CIT “outlines procedures for collecting observed incidents having special significance and meeting systematically defined criteria.”9 The incidents are defined as any “observable human activity that is sufficiently complete in itself to permit inferences and predictions to be made about the person performing the act.”9 To be critical, “an incident must occur in a situation where the purpose or intent of the act seems fairly clear to the observer and where its consequences are sufficiently definite to leave little doubt concerning its effects.”9

CIT has been found useful to study various research questions in many different types of settings.1011 In healthcare, for example, Kent et al. used CIT to investigate patient reactions to met and unmet psychological needs.9 Gilbart et al. also reported using CIT to develop and assess a rating form for selection of surgical residents based on criteria for successful performance.11

We use the CIT to explore PDA non-usage patterns and barriers faced by physicians. Data collection in CIT-based studies has been performed using interviews.8 We developed CIT-based questions based on the literature and our preliminary study.12 In addition to the CIT questions, other specific usage pattern questions were included in our data collection tool for use during the interview process.

Data Collection and Analysis

One nurse (JKL, who was in a Masters’ Degree program in Nursing) under the guidance of a senior researcher (YX), conducted the interviews. The interviewer and a nursing PhD student (YCL) were then trained by the senior researcher to analyze the data. The interviewer was blinded to priori hypotheses in order to minimize the interviewer bias. The PhD student, on the other hand, had reviewed related literature and participated in the development of research hypotheses. The interviews were tape recorded and transcribed for analysis. Data recorded from the data collection sheets were also coded and analyzed.

RESULTS

The healthcare PDA functions identified by literature are scheduling, medical references, medication dose calculations, alerts for tasks, alarms clock, reference algorithms, notes, documents editing, billing, access or input of patient information, medical images, wireless medical information referencing, email or instant messaging communication, and electronic prescription. Figure 1 shows the percentages of the studied 20 PDA owners who reported use of specific functions. For example, among the functions identified from the literature, 90% of physicians in our study used PDAs for scheduling, 85 % of them used PDAs for medical reference, and 65% used PDAs for medical calculation.

Figure 1
Percentages of PDA owners who reported use of specific functions.

We identified four types of barriers from the analysis: 1) organizational barriers (30% of subjects), 2) usability barriers (95%), 3) inadequate technology support or access barriers (85%), and 4) lack of need or motivation (100%).

Organizational barriers include lack of integration and institutional supports, and legal issues. For example, if institutions do not have integrated information systems that allow for real-time access to hospital databases, physicians cannot use their PDAs to access patient data. On the other hand, if the institutions have all the support and technology available, physicians are more likely to use it.

Usability barriers include usability issues such as screen size, hand writing recognition problems, data entry mechanism, short battery life, perceived delicacy of the device, and additional accessories needed to perform functions. One physician indicated that he did not like to go through several screens to pull all the necessary information (such as medication and lab value) together.

Inadequate technology support and access barriers include unavailability of technology support, expired warranty, and unavailable features or applications. For example, some physicians cannot address malfunctions on their PDAs because of inadequate or inaccessible tech support; hence, they cannot use the PDAs or specific applications.

Lack of need or motivation include applications or functions perceived as unnecessary and too general for practice, information integrated into profession, dissatisfaction with previous experience, preference for manual method, function performed by other personnel, and function performed with other hardware or methods.

Those barriers can interact with one another and either enhance or diminish the impact of one another. For instance, a usability barrier could discourage physicians from using PDAs (reduced motivation). On the other hand, if physicians have unlimited institutional or technical support, their motivation might increase. Table 2 provides representative quotes from interviews.

Table 2
Representative Quotes from Physicians

DISCUSSION

We have identified a number of barriers to using PDAs (lack of integration and institutional support, screen size, graffiti, battery life, inadequate technical support, and perceived delicacy of PDAs). Some of these barriers were consistent with the literature 1317 However, we found when physicians frequently use a particular PDA application, it is well integrated into the daily workflow. Physicians also tend to use a particular application when the application is easy to access and user-friendly. For example, physicians often use ePocrates from their PDAs to obtain drug information, because they feel that the manual alternative (e.g. go to library and pull out medical reference books) interferes with an efficient workflow. In addition, it is a free application; many of their colleagues are using it.

In contrast, if the functions or applications required additional effort (such as debugging), cost (purchasing accessories or applications), or time (e.g. spending a lot of time to look for or learn the function or application), physicians are less likely to use them.

It is also interesting to note that physicians tended to opt out of an application or PDA function if it did not prove effective after the first attempt. This might result from an individual’s characteristics or the nature of the physician’s busy practice. They usually do not want to waste their scarce time on some nuisances like trouble shooting their PDAs. However, further research is necessary to examine the correlation between negative prior experiences and the decision of not using an application or function.

It is worthy to mention one extreme case in our study: a physician who was issued a PDA but never used it. When asked why his PDA was still in the box, he indicated that there was no incentive for using a PDA since he had easier access to information from unit computers and a pocket pharmacopoeia. From this case, we could see that for this particular physician, lack of need or motivation seems to be the strongest predictor of use or non-use of PDA and functions. However, whether this result can be generalized to other physicians is unknown. Further studies are recommended to investigate the relationship between the motivation/need and non-use patterns.

This study has several limitations. First, only one researcher conducted the interviews; however, the potential for bias was minimized because all researchers had input into the design of the interview questions and two researchers analyzed the data. However, one analyst was not blinded to the priori hypotheses, which could introduce an analysis bias. Second, small sample size and use of convenience samples limited generalization of the findings. Last, other non-usage patterns or factors might be overlooked due to the study design. However, we will address these issues in our future studies.

CONCLUSION

Physicians have regarded PDAs as portable, relatively inexpensive devices for point of care clinical reference and information management. We investigated the barriers that influence physicians’ usage patterns and behaviors. The findings can serve as a user modeling profile for designing hardware, software, and for institutionally supported implementation of a facility-wide mobile computing system. For our next phases of study, we would like to further examine the relationships between the four types of barriers and non-use of PDAs to determine which is the best predictor of PDA non-usage. Further research is recommended to look at the impact of PDA technology on clinical practice.

Acknowledgments

We would like to acknowledge the patience and cooperation of the physicians interviewed for this study and Jake Seagull, PhD for his assistance. This material is based upon work supported by the National Science Foundation (NSF) under Grant Nos. ITR-0081868 and IIS-0121570. Any opinions, findings and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the NSF. Email contact: ude.dnalyramu@oaixy.

REFERENCES

1. The Mercury News. PDA sales slump in 2002 on slack corporate demand. The Mercury News, Jan 27, 2003. Retrieved March 3, 2003 from http://www.siliconvalley.com/mld/siliconvalley/news/editorial/5043972.htm Accessed Feb 24, 2003.
2. Tischelle G. PDA Sales Remain Strong. InformationWeek, Feb 7, 2002. Access March 3, 2003 from http://www.informationweek.com/story/IWK20020207S0015
3. Criswell DF, Parchman ML. Handheld computer use in U.S. family practice residency programs. Journal of American Informatics Association. 2002;9:80–86. [PMC free article] [PubMed]
4. Ebell MH, Gaspar DL, Khurana S. Family physicians’ preferences for computerized decision support hardware and software. Journal of Family Practice. 1997;45:2:137–141. [PubMed]
5. d’Hemecourt P. Assistance in the palm of your hand. Healthcare Informatics. 2001:102–103. [PubMed]
6. Survey shows PDAs are just what the doctor ordered. Retrieved March 3, 2003 from http://www.avantgo.com/news/press/press_archive/2002/release04_11_02.html
7. Digital Library. The trends Retrieved March 3, 2003 from http://www.lib.hku.hk/denlib/sep2002/trend.html
8. Ölvingson C, Hallberg N, Timpka T, Greenes RA. Using the critical incident technique to define a minimal data set for requirements elicitation in public health. International Journal of Medical Informatics. 2002;68:165–174. [PubMed]
9. Flanagan JC. The critical incident technique. Psychological Bulletin. 1954;51:4:327. [PubMed]
10. Kent G, Wills G, Faulkner A, Parry G, Whipp M, Coleman R. Patient reactions to met and unmet psychological need: A critical incident analysis. Patient Education And Counseling. 1996;28:187–190. [PubMed]
11. Gilbart MK, Cusimano MD, Regehr G. Evaluating surgical resident selection procedures. The American Journal of Surgery. 2001;181:221–225. [PubMed]
12. Lu, YC, Xiao, Y, Sears, A & Jacko, J. An observational and interview study on personal digital assistant (PDA) uses by clinicians in different contexts. Proceeding HCI International Conference, 2003 (in press).
13. Kiél J M, Goldblum O M. Using personal digital assistant to enhance outcomes. Journal of Healthcare Information Management. 2001;15(3):237–250. [PubMed]
14. Brody J A, Camamo J M, Maloney M E. Implementing a personal digital assistant to document clinical interventions by pharmacy residents. American Journal of Health-System Pharmacy. 2001;58(16):1520–1522. [PubMed]
15. Ammenwerth E, Buchauer A, Bludau B, Haux R. Mobile information and communication tools in the hospital. International Journal of Medical Informatics. 2000;57:21–40. [PubMed]
16. Kelly J. Going wireless. Hospitals & Health Networks 2002; 65–68.
17. Garvin R, Otto F, McRae D. Using handheld computers to document family practice resident procedure experience. Family Medicine. 2000;32(2):115–118. [PubMed]

Articles from AMIA Annual Symposium Proceedings are provided here courtesy of American Medical Informatics Association
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

  • PubMed
    PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...