41Human Factors and Medical Devices

Publication Details

Harvey J. Murff, MD

Harvard Medical School

John W. Gosbee, MD, MS

Deparment of Veterans Affairs National Center for Patient Safety

David W. Bates, MD, MSc

Harvard Medical School

Introduction

Human factors engineering (HFE), áalso known as usability engineering or ergonomics, is the study of how humans interact with machines and complex systems. 1 Through the merging of cognitive psychology, engineering and other disciplines, human factors researchers have detailed numerous principles concerning device and software program designs that allow for optimal usage. 2 When these principles are violated, improper use of a machine is more likely to result.3,4áSpecific examples have been detailed during observations of user errors with electronic infusion devices. 5

Medical device misuse is an important cause of medical error,6,7áand therefore, incorporating human factors methodology into the design of medical devices has assumed an important role in ensuring patient safety.2,8áThis chapter first describes the use of HFE principles as a safety practice in the design of medical devices and their evaluation both prior to and after institutional purchase. Next, medical device alarms and the contribution of HFE to alarm improvements will be evaluated. Finally, the chapter reviews the use of preoperative checklist procedures to reduce anesthesia device failures (see also Chapter 23).

Subchapter 41.1. The Use of Human Factors in Reducing Device-related Medical Errors

Background

Human factors engineering is a powerful component in the design of usable, safe medical devices. 8 HFE principles can be incorporated as safety practices that occur at various points during device development and usage. Industry can use HFE principles at multiple times in the design and developmental cycle of medical devices and software packages. 3 Health care institutions can consider results of HFE evaluations when deciding which products to purchase. Finally, HFE principles can also be incorporated into the ongoing evaluation of devices that have already been purchased and are in use. While these practices have high face validity, there has been little formal study of their effectiveness in reducing medical error. They are presented here because they may hold promise if scrutinized rigorously, and to familiarize readers with their potential to reduce medical error.

Design and Developmental Phase

Data collected by the United States Food and Drug Administration (FDA) áin the late 1980s demonstrated that almost half of all medical device recalls resulted from design flaws. 9 In 1990, Congress passed the Safe Medical Devices Act, giving the FDA the ability to mandate good manufacturing practices (GMP). These GMP involve design controls for manufacturers that help ensure the use of HFE within medical device design. 9 As described in the Good Manufacturing Practice Regulation, Design Control subsection (Title 21-Section 820.30), these include the use of iterative design and testing during the developmental phase. The Act requires that designs be "appropriate and address the intended use of the device, including the needs of the user and patient." 10 Multiple human factors techniques, such as user studies, prototype tests, and task/function analysis, are utilized in the development and design process.

Manufacturers are required not only to use human factors principles to repeatedly test the product in all phases of design, but also to validate the ultimate device design. Validation entails testing the device, either in an actual clinical situation or a simulation, and documenting that the device conforms to the individual user's needs. Thus, manufacturers are required to apply HFE methods through the multiple phases of device design and development cycles. 10

Human factors engineering practices for medical device design and evaluation have been well described. In 1993 the Association for the Advancement of Medical Instrumentation and the American National Standards Institute established guidelines for the incorporation of HFE principles into medical device design. 11 This comprehensive document helped direct attention to the problem of poor medical device design and helped establish the design standards necessary to ensure safe medical equipment and thus should stand as the safety benchmark for industry.

Only limited data are available concerning the application of HFE principles to medical device design, and most are not published. Nonetheless, the application of human factors principles during a device's design phase has been demonstrated to reduce user error. Patient controlled analgesia (PCA) pumps are a case in point of how HFE principles in product design reduce user error. User errors associated with poor interface design have been described with PCA pumps.12,13áLin and colleagues investigated whether applying human factors engineering principles to the design of the user interface of a PCA pump could result in fewer dosage errors as well as less time spent programming the device. 14 Information on device usage was obtained through cognitive task analysis. This involved observing and interviewing nurses operating PCA pumps both in the laboratory setting and in the field. Utilizing this feedback, as well as other human factors design principles, a "new" PCA pump interface was designed. Twelve recovery room nurses were required to complete specific tasks with both the standard PCA user interface and the newly designed interface. There were 29 programming errors on the traditional interface and 13 on the redesigned interface (an error reduction of 55%, p<0.01). Furthermore, users were able to program in the necessary orders in 18% less time. 13

Another example involves the design of an ultrasound machine. In this study, Aucella and colleagues 15 interviewed sonographers, videotaped the ultrasound device being used, and performed usability testing through simulation to collect information regarding the operator-machine interface of the ultrasound machine. After their extensive investigations they implemented over 100 design changes to the console and control panel. Although errors with the machine were not measured, comments collected by the authors from the beta operators of the newly designed device suggested that the resulting machine was much easier to use.

There are enormous numbers of medical devices and software being designed and developed. Thus the FDA has initiated several regulatory mechanisms to ensure compliance with these guidelines. Some of the mechanisms include site inspections of manufacturers, review and approval of medical devices before marketing, and review of medical device incident reports. 16 Despite the tremendous amount of effort put forth by the FDA to ensure compliance with the Good Manufacturing Practices Regulation, individual institutions should critically analyze whether a device they intend to purchase meets HFE principles for user-centered design.

Device Evaluation Prior to Purchase

Adhering to HFE principles during initial design stages of a medical device is essential. However, human factors analysis should also be incorporated into the institutional decision to acquire a new medical device or software program. 3 Device purchasers should strongly consider institution-specific human factors testing. Usability testing áat the institutional level establishes built-in redundancies to capture any design problems missed by manufacturers. Furthermore, the users and environments at individual institutions will differ, possibly in important ways, from the users and environments in which the device or program was initially designed and tested. It is important for an institution to be aware of who the intended users of the device or software will be, as well as where and when they plan to use the device. The information for such evaluations may be obtained from vendors, from an in-house analysis, or from independent organizations.

Vendors must be able to prove to the FDA that the user will be able to operate the medical device in the way in which it was intended. 10 As companies are required to collect human factors analysis data, it is important that institutions wishing to purchase a new medical device or software receive and carefully review this information. Gosbee provides a list of questions to ask a vendor before a purchase, which include: "How long does it take to learn to operate the system? How long does it take to complete typical set-up tasks? What are the types and frequency of errors that could happen, and the systems to thwart them?" 3

It is also important to consider the environment in which a device will be used. Idiosyncratic features of the environment, such as excessive noise or poor lighting, and differences in user skill or acuity due to fatigue or otherwise, may affect safety and the device's in-house usability.

Some institutions have developed in-house usability labs, in order to rigorously test any device before purchasing. The Mayo Clinic uses simulations to test the usability of medical software before purchasing. 17 By carefully measuring user performance with the software they are able to uncover latent errors in the design. The usability lab is also able to measure the time necessary to learn to use the new software. This important information can help predict the device's or software's influence on workflow as well as its predilection for operator misuse.

Even without sophisticated usability laboratories, an institution can use basic human factors techniques to evaluate a product before purchase. 3 Powerful techniques such as cognitive walk-through can be easily utilized at any institution. This involves observing the end-users of a product interact with the product. As they attempt to use the device, they are instructed to "think out loud." Careful observation of the user's actions and comments can identify potential design flaws that might make it difficult to utilize the device or software.

Independent organizations are another potential source of information on device safety. Unfortunately, most independent sources do not make clear to what degree HFE principles were used in product evaluations, although they do provide some assessment of safety. One such organization is ECRI (formerly the Emergency Care Research Institute), a nonprofit international health services research agency. Another is the Institute of Safe Medical Practices (ISMP). Both release newsletters and publications regarding product safety. By searching these and similar databases, institutions can gather additional information concerning product safety prior to purchasing a device. ERCI also publishes articles specifically geared to the institutions that might wish to purchase a medical device or software.

Regardless of the level of pre-procurement testing, some unsafe designs will not be detected until after the product is in use. 3 Therefore, it is important for institutions to continuously evaluate these products to ensure safety.

Ongoing Device Evaluation

Devices and software at greatest risk for user error should be systematically evaluated. This is particularly important in areas where multiple devices are used with different interfaces, such as the operating room or the intensive care units. 3 Furthermore, areas where multiple medications are stored together should be scrutinized for potential latent errors within device or software user interfaces prior to user errors occurring.

Resources are available that can help direct an institution's search. Through publications from the FDA, ECRI, ISMP and similar organizations, medical device problems identified at other institutions can be targeted. Thus an important safety practice may be using this published information to search for latent errors within already purchased medical devices and applying this information toward a directed product evaluation at the local institution.

Another potential safety practice is to educate practitioners about HFE principles to increase awareness of medical device user error. 3 Several groups, including the American Nurses' Credentialing Center and the American Society of Health-Systems Pharmacists, recommend incorporating HFE training within health care curricula as a means to reduce error. 18

To create a culture of safety within medicine, practitioners must couple the ability to identify potential design weaknesses with a change in the prevailing culture of silence surrounding medical errors. Educational programs directed at health care providers in training should address both of these important concerns. Curricula for teaching medical student and medical residents HFE principles have been described 18 and will likely be adopted at other institutions. Casarett and Helms caution that an unintended result of error curriculum 19 may be that residents become too willing to attribute an error to system causes. Their concern is that the resident will ignore any possible individual contribution to the adverse medical event and not learn from analyses of the event. This concern has been discounted by Gosbee, stating that any error-in-medicine curriculum should aim to "teach residents to see when errors are due to inadequate skills and knowledge versus when they are due to inherent cognitive limitations and biases." 18

Subchapter 41.2.á Refining the Performance of Medical Device Alarms

Background

Numerous aspects of patient care compete for providers' attention and can reduce their vigilance in monitoring medical devices. Alarms can alert providers to urgent situations that might have been missed due to other distractions and have become a necessary part of patient monitoring. In a study looking at critical incidents within a neonatal intensive care unit, 10% were detected through alarms. 20

However, fundamental flaws in the design of current alarm systems likely decrease their impact. 21 There are reports documenting some alarm failings in the medical literature, 22 but few data address interventions to improve alarm system effectiveness. For an alarm to be effective it requires that a medical problem trigger the alarm, that personnel identify the source and reason for the alarm, and that the medical problem be corrected prior to patient injury. This section reviews 2 aspects of alarm safety: (1) the use of HFE principles in the redesign of medical alarms to improve identification of the source and reason for alarm, and (2) practices in both device design and programming that may improve safety by decreasing false positive alarms.

Identification of Alarm Source and Reason

The recognition accuracy of alarms within the operating room is quite low. When presented with alarm sounds and asked to identify the source, anesthesiologists, operating room technicians, and operating room nurses correctly identify the device producing the alarm only 33 to 53.8% of the time.23-25áFurthermore, experiments suggest that humans have difficulty reliably recognizing more than 6 alarms at one time. 26 The sheer number of different medical devices with alarms can make it difficult to discern one alarm from another and studies within the human factors literature have documented the inability of medical providers to discern between high priority and low priority alarms. 27 While this is a known problem in operating rooms and intensive care units, how well alarms are recognized in other settings has not been described.

Some effort has been made to improve alarm systems through redesign. 28 One non-medical study examined ways to improve the recognition of auditory alarms by comparing abstract alarm sounds with specially designed alarms using speech and auditory icons. 29 Other studies within the human factors literature have revealed certain acoustical properties that are more likely to result in a higher sense of perceived urgency by the operator.

In a series of experiments, Edworthy required subjects to rank the level of áurgency associated with different alarms. 30 The acoustical properties of the alarms were altered for the different subjects. Level of urgency was then correlated with a specific alarm sound. After ranking a set of acoustic parameters based on perceived urgency, the experimenters predicted what urgency ranking the alarm would receive and played the alarms for a new set of subjects. The correlation between the subjects' urgency rating and the investigators' predicted ratings was 93% (p<0.0001). Acoustical properties such as fundamental frequency, harmonic series, and delayed harmonics all affected the users perceived urgency.

Another study looked at the redesign of an alarm to improve detectability within the operating room. 31 An alarm that was spectrally rich, frequency-modulated, and contained small amounts of interpolated silence was detectable with at least 93% accuracy over background operating room noise. However, both of these alarm experiments have only been done in laboratory settings. In addition, Burt and colleagues found that when subjects were required to urgently perform a task, the prior acoustically manipulated perception of urgency was ignored in order to attend to the situational urgency of the task. 32 Furthermore, with both alarms and clinical tasks competing for an operator's attention, the newly designed alarm might not be as discernible. It has continued to be a challenge to create the best auditory alarm sound to indicate an emergency.

Visual Interfaces for Alarms

Alarms can also be visual. Some research has been done to improve hemodynamic monitoring device displays. Responses to abnormal values are delayed when workload for the anesthesiologist is high, 33 prompting interest in improving current visual displays. Furthermore, the clinical decision process often rests on the practitioner's interpretation of a patient's hemodynamic parameters. Thus, it is important that this information be presented in a way that assists with decision making and minimizes errors of interpretation.

Two observational studies have compared different visual displays of data to traditional visual monitors.34,35áEach evaluated errors in performing a designated task as well as response time to completion. One measured how quickly subjects recognized a change in a parameter 34 and the other measured how long it took for anesthesiologist to manipulate a set of abnormal parameters to a stable set.34,35áBoth studies used computerized simulations of anesthesiology cases, with subjects serving as their own controls. In one study, subjects were required to identify when changes in physiologic parameters occurred using different visual formats. 34 Response time and accuracy to the simulated cases was compared among a histogram, polygon, and numerical display. Subject responses were more accurate with the histogram and polygon displays (p=0.01).

In the other study, 20 anesthesiologists with an average working experience of 5 years were required to perform specific tasks on an anesthesia simulator 35 (see Chapter 45). The tasks consisted of returning a set of abnormal hemodynamic parameters to normal using intravenous medications. A specific time for the completion was determined and this time was compared among 3 different visual interfaces. Trial time was significantly shorter with the traditional display (p<0.01), yet there were fewer failed trials using the other monitor displays (26% with the profilogram display, 11% with the ecological display, and 42% with the traditional display). The slower time with the non-traditional displays could have resulted from the subject's lack of experience with such screens. Nevertheless, the newer interfaces produced fewer failed attempts at arriving at the appropriate hemodynamic parameters on the simulator, suggesting that these displays might improve the clinical decision process.

None of the studies comparing traditional auditory alarms and visual monitor displays reported any adverse event associated with the newer technology. However these studies are limited by the artificial nature of the experiments.29,34,35áAnesthesiologists have many tasks to perform during anesthesia, often amidst great distraction. Attending to monitors is only one aspect of their workload. Because these laboratory experiments do not include all of the different "real world" problems and diversions that an anesthesiologist might face, it is difficult to generalize them to the workplace. Also, because this experimental task might be taken out of the context of caring for a patient in the operating room, the subject might simply focus on the completion of the experimental task and not consider other tasks that the anesthesiologist would be required to perform in a real situation.

Decreasing the Frequency of Alarms

Poorly designed device alarms can create not only problems with alarm recognition but also frequent false positive alarms. Two observational studies found that from 72 to 75% of alarms during routine general anesthesia did not require corrective action.36,37áAnother study showed that only 3% of all auditory alarms during routine anesthesia monitoring represented a patient risk. 38 Providers frequently must interrupt clinical tasks to silence these false positive alarms. More concerning is the fact that when alarms are unreliable, they tend to be ignored.21,39áThis "cry-wolf" effect is a significant detriment to the optimal performance of alarm systems and may result in dire consequences when "true alarms" are ignored.

False alarms can be managed in two ways. Devices can be designed so that they identify and eliminate false alarms before triggering or users can manipulate alarm parameters to reduce false alarms. User manipulation can range from adjusting alarm thresholds 40 to even turning the alarms off. 22 There are no data describing how often operators reset alarm parameters to reduce false positive rates.

Some research has focused on the identification of alarm parameters that improve or optimize alarm accuracy (ie, to improve the ratio of true positives to false positives -- the "signal-to-noise" ratio). For example, Rheineck-Leyssius and Kalkman studied how altering an alarm parameter on a pulse oximeter would affect the incidence of hypoxemia. 40 Consecutive patients admitted to the recovery room of a regional hospital in the Netherlands after general or regional anesthesia were randomized to either a lower limit of SpO2 90% or SpO2 85%. The 2 groups were comparable at baseline. The outcomes measured were hypoxemia, defined by a pulse oximeter reading less than or equal to 90% or 85%. The authors were also required to judge if they believed a signal to be artifact versus a true positive. The authors were blinded as to which group the subject was randomized to during artifact assessment and data analysis. The relative risk of having a hypoxic episode (Sp02<85%) in the group with the lower alarm limit set at 85% (as compared with those with the lower alarm limit set at 90%) was 3.10 (95% CI: 1.32-7.28, p<0.001). One weakness of this study was the lack of a bedside observer to verify the validity of the measurement, so that it is unclear to what degree measurement bias could have affected the results. The pulse oximeter was considered the "gold standard" for measuring hypoxia and thus false positives were calculated based on alarm artifact rates (outliers, loss of signal). Keeping the lower alarm limit for a pulse oximeter at 90% did reduce the number of patients with hypoxemia, however it also increased the false positive rate (33% versus 28%). A higher false positive rate on an alarm could make it more likely that an operator might disregard the alarm. The majority of alarms were transient and lasting less than 20 seconds. The authors also noted a 60% reduction in the number of triggered alarms in the Sp02 90% group by introducing a "theoretical delay" of 15 seconds between crossing the alarm threshold and actually triggering the alarm. Other investigators have documented a 26% reduction in mean alarm rate by increasing the alarm delay from 5 to 10 seconds. 41

Overall, only modest evidence supports the practice of not lowering pulse oximeter lower alarms limit settings below 90%. This intervention could reduce hypoxemic events with little added cost. However, there would be an increased number of false positive alarms, which might affect attendance to the device. Fortunately, newer technological advances in oximetry appear to reduce false positives rates and may make this less of a problem. In a study in the Netherlands, a conventional pulse oximeter was compared with a "third generation" pulse oximeter equipped with a signal processing technique designed to reduce false positives. 42 This "smart" pulse oximeter applied signal quality tests, differentially amplified the input signal, and applied motion-detection testing to the identified pulse. The "smart" pulse-oximeter only triggered one false positive (an alarm that did not coincide with hypoxia) and had a relative risk of 0.09 (95% CI: 0.02-0.48) for generating a false positive alarm when compared with conventional pulse oximetryáwith a 21-second delay.

Comment

Observational studies have suggested that current alarm systems could be improved, but future laboratory studies are needed to determine which properties of alarm systems are most effective to alert operators. These tests must be followed by field studies and ultimately with trials looking at actual patient outcomes to determine the best designs. Information concerning the cost and feasibility of implementing these changes should also be gathered.

False positive alarms remain a significant problem. Few data exist on the incidence of resetting alarm parameters or at what parameter values alarm accuracy is optimized. Advances in alarm technology aimed at reducing false positives appear a promising alternative to resetting parameters.

Subchapter 41.3.á Equipment Checklists in Anesthesia

Events related to medical equipment can be divided into two categories, user-error and equipment failure. 43 Health device inspection and preventive maintenance by biomedical or clinical engineering departments have high face validity as an important patient safety practice in reducing equipment failure.

There are many calls in the engineering literature to standardize equipment maintenance.44-46,46áStandardization of protocols is believed to help make the processes more efficient and reduce errors. 47 However, it has been difficult to standardize equipment maintenance practices due to a lack of the appropriate units on which to base measurement. 46 Some authorities have suggested outcomes based on engineering endpoints such as reliability and accuracy. 48 Others have tried to validate a set of maintenance outcome units based on cost or quality metrics.44,45,49 Some engineers have suggested the incorporation of clinical endpoints into medical equipment assessment.48,50áNotwithstanding differing views as to measurement of endpoints, experts uniformly believe that standardization of engineering endpoints is vital to ensure adequately inspected and maintained equipment. 46 No studies to date have developed a widely used standardized protocol for equipment maintenance for clinical engineering departments, largely because the lack of standardization of endpoints renders assessing the relative value of any particular maintenance protocol impossible.44-46,48,50áNonetheless, equipment failure does result in a small fraction of clinical events and thus is an important safety intervention. Hopefully, future studies will help delineate the most effective practices for equipment maintenance processes.

Use of checklists is another practice that helps ensure equipment readiness, particularly for equipment that is needed in critical situations and/or where equipment failure may have dire consequences. For example, a nurse at the beginning of each shift may use a checklist to ensure the readiness of a hospital ward's resuscitation cart ("crash cart") should it be needed (eg, the defibrillator is plugged-in and charged, the back-up suction pump works, medication is not past its expiration date). Similarly, a perfusion technologist can use a checklist to ensure cardiac bypass circuit and back-up equipment are ready before surgery. Published studies on the effectiveness of equipment checklists largely relate to the use of preoperative checklists to prevent anesthesia equipment failures since, to date, studies on the effectiveness of equipment checklists in medicine have been limited to this area.51-53,54 These studies are reviewed in Chapter 23.

Final Comment to Chapter 41

Human factors testing is yielding important data regarding safe and effective medical device and alarm designs that take into account the users' cognitive limitations. Machines can be designed and redesigned that enhance patient safety, rather than compromise it.

Currently, there are no widely accepted standards for equipment maintenance intervals and protocols. Maintenance endpoints that incorporate clinical events as one component of the endpoint have been suggested. Until a reliable and validated engineering endpoint metric is widely recognized it will remain difficult to investigate the most effective maintenance practices.

Other than the pioneering work in anesthesiology, HFE has been underutilized in medicine. Hopefully, in the near future, more attention will be focused on integrating human factors engineering within all aspects of medical training and practice, which will help create a culture of safety.

References

1.
2 ed. New York: John Wiley and Sons, INC, 1997.
2.
Sawyer D Do It By Design: An Introduction to Human Factors in Medical Devices. 1997. FDA.
3.
Gosbee J, Lin L The Role of Human Factors Engineering in Medical Device and Medical Systems Errors. In: Vincent C, editor. Clinical Risk Management: Enhancing Patient Safety. 2000.
4.
Wiklund M, Gardner-Bonneau D, Carstensen P, Weinger M Global standardization of human factors for medical devices and systems. In: Proceedings of the Human Factors and Ergonomics Society 44th Annual Meeting. Santa Barbara, CA: Human Factors and Ergonomics Society, 2000: 533-536.
5.
Cook RI, Woods DD, Howie MB, Horrow JC, Gaba DM Case 2-1992. Unintentional delivery of vasoactive drugs with an electromechanical infusion device. J Cardiothorac Vasc Anesth . 1992;6:238–244. [PubMed: 1568015]
6.
Cooper JB, Newbower RS, Kitz RJ An analysis of major errors and equipment failures in anesthesia management: considerations for prevention and detection. Anesthesiology . 1984;60:34–42. [PubMed: 6691595]
7.
Ludbrook GL, Webb RK, Fox MA, Singleton RJ The Australian Incident Monitoring Study. Problems before induction of anaesthesia: an analysis of 2000 incident reports. Anaesth Intensive Care . 1993;21:593–595. [PubMed: 8273880]
8.
Bogner MS Designing medical devices to reduce the likelihood of error. Biomed Instrum Technol . 1999;33:108–113. [PubMed: 10194563]
9.
http://www.fda.gov/cdrh/humfac/hufacimp.html. 4-22-1998.
10.
Final Rule; Quality System Regulation. http://www.fda.gov/cdrh/humfac/frqsr.html 61[195], 52601-52662. 10-7-1996. Food and Drug Administration.
11.
Human factors engineering guidelines and preferred practices for the design of medical devices (ANSI/AAMI HE-48). Arlington, VA: Association for the Advancement of Medical Instrumentation, 1993.
12.
Brown SL, Bogner MS, Parmentier CM, Taylor JB Human Error and Patient-Controlled Analgesia Pumps. Journal of Intravenous Nursing . 1997;20:311–316. [PubMed: 9423393]
13.
Lin L Human Error in Patient-Controlled Analgesia: Incident Reports and Experimental Evaluation. In: Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting. Santa Barbara, CA: Human Factors and Ergonomics Society. 1998. pp. 1043–1047. [PMC free article: PMC35074] [PubMed: 9501137]
14.
Lin L, Isla R, Doniz K, Harkness H, Vicente KJ, Doyle DJ Applying human factors to the design of medical equipment: patient-controlled analgesia. J Clin Monit Comput . 1998;14(4):253–263. [PubMed: 9754614]
15.
Aucella A, Kirkham T, Barnhart S, Murphy L, LaConte K Improving ultrasound systems by user-centered design. In: Proceedings of the Human Factors and Ergonomics Society. Santa Barbara, CA: Human Factors and Ergonomics Society, 1994.
16.
Sawyer D Medical device requirements, human factors, and the food and drug administration. In: Proceedings of the Human Factors and Ergonomics Society 44th Annual Meeting. Santa Barbara: Human Factors and Ergonomics Society, 2000: 526-527.
17.
Claus P, Gibbons P, Kaihoi, BH, Mathiowetz M Usability lab: A new tool for process anaylsis at the Mayo Clinic. In: HIMSS Proceedings. Chicago: Healthcare Information Management Systems Society, 1997: 149-159.
18.
Gosbee J Human Factors Engineering is the Basis for a Practical Error-in-Medicine Curriculum. First Workshop on Human Error in Clinical Systems. http://www.dcs.gla.ac.uk/~johnson/papers/HECS_99/Gosbee.html. 1999.
19.
Casarett D, Helms C Systems errors versus physicians' errors: Finding the balance in medical education. Acad Med . 1999;74:19–22. [PubMed: 9934289]
20.
Frey B, Kehrer B, Losa M, Braun H, Berweger L, Micallef J et al Comprehensive critical incident monitoring in a neonatal-pediatric intensive care unit: experience with the system approach. Intensive Care Med . 2000;26(1):69–74. [PubMed: 10663283]
21.
Woods D The Alarm Problem and Direct Attention in Dynamic Fault Management. Ergonomics . 1995;38(11):2371–2393.
22.
Samuels SI An alarming problem. Anesthesiology . 1986;64(1):–.
23.
Finley GA, Cohen AJ Perceived urgency and the anaesthetist: responses to common operating room monitor alarms. Can J Anaesth . 1991;38(8):958–964. [PubMed: 1752016]
24.
Loeb RG, Jones BR, Leonard RA, Behrman K Recognition accuracy of current operating room alarms. Anesth Analg . 1992;75(4):499–505. [PubMed: 1530161]
25.
Momtahan K, Hetu R, Tansley B Audibility and identification of auditory alarms in the operating room and intensive care unit. Ergonomics . 1993;36:1159–1176. [PubMed: 8223408]
26.
Patterson R, Milroy R Auditory warnings on civil aircraft: the learning and retention of warnings. Final Contract Report 7D/S/0142. 1980. Cambridge, MRC Applied Psychology Unit.
27.
Simons D, Frederiks T, Tappel J The evaluation of an auditory alarm for a new medical device. In: Proceedings of the Human Factors and Ergonomics Society 41st Annual Meeting. Santa Barbara: Human Factors and Ergonomics Society, 1997: 777-781.
28.
Edworthy J, Stanton N A user-centred approach to the design and evaluation of auditory warning signals: 1. Methodology. Ergonomics . 1995;38:2262–2280. [PubMed: 7498187]
29.
Leung YK, Smith S, Parker S, Martin R Learning and Retentiono of Auditory Warnings. www.icad.org/websiteV2.0/conferences/icad97/leung.pdf. 2001.
30.
Edworthy J, Loxley S, Dennis I Improving auditory warning design: relationship between warning sound parameters and perceived urgency. Hum Factors . 1991;33:205–231. [PubMed: 1860703]
31.
Stanford L, McIntyre J, Hogan J Audible alarm signals for anaesthesia monitoring equipment. Int J Clin Monit Comput . 1985;1:251–256. [PubMed: 3836289]
32.
Burt JL, Bartolome DS, Burdette DW, Comstock JR A psychophysiological evaluation of the perceived urgency of auditory warning signals. Ergonomics . 1995;38:2327–2340. [PubMed: 7498191]
33.
Loeb RG A measure of intraoperative attention to monitor displays. Anesth Analg . 1993;76:337–341. [PubMed: 8424512]
34.
Gurushanthaiah K, Weinger MB, Englund CE Visual display format affects the ability of anesthesiologists to detect acute physiologic changes. A laboratory study employing a clinical display simulator. Anesthesiology . 1995;83:1184–1193. [PubMed: 8533911]
35.
Jungk A, Thull B, Hoeft A, Rau G Ergonomic Evaluation of an Ecological Interface and a Profilogram Display for Hemodynamic Monitoring. J Clin Monit . 1999;15:469–479. [PubMed: 12578045]
36.
Kestin IG, Miller BR, Lockhart CH Auditory alarms during anesthesia monitoring. Anesthesiology . 1988;69:106–109. [PubMed: 3389544]
37.
Sanderson P, Seagull FJ Cognitive Ergonomics of Information Technology in Critical Care: Contexts and Modalities for Alarm Interpretation. Available at: http://www.detir.qld.gov.au/hs/ergo97/sanderso.pdf. Accessed June 20, 2001.
38.
Xiao Y, Mackenzie F, Seagull J, Jaberi M Managing the monitors: an analysis of alarm silencing activities during an anesthetic procedure. In: Proceeding of the Human Factors and Ergonomics Society 44th Annual Meeting. Santa Barbara: Human Factors and Ergonomics Society, 2000: 250-253.
39.
Bliss JP, Gilson RD, Deaton JE Human probability matching behaviour in response to alarms of varying reliability. Ergonomics . 1995;38(11):2300–2312. [PubMed: 7498189]
40.
Rheineck-Leyssius AT, Kalkman CJ Influence of pulse oximeter lower alarm limit on the incidence of hypoxaemia in the recovery room. Br J Anaesth . 1997;79(4):460–464. [PubMed: 9389263]
41.
Makivirta A, Koski EM Alarm-inducing variability in cardiac postoperative data and the effects of prealarm delay. J Clin Monit . 1994;10:153–162. [PubMed: 8027746]
42.
Rheineck-Leyssius AT, Kalkman CJ Advanced pulse oximeter signal processing technology compared to simple averaging. II. Effect on frequency of alarms in the postanesthesia care unit. J Clin Anesth . 1999;11:196–200. [PubMed: 10434214]
43.
Hyman WA Errors in the Use of Medical Equipment. In: Bogner MS, editor. Human Error in Medicine. Hillsdale, New Jersey: Lawrence Erlbaum Associates, 1994: 327-347.
44.
Cohen T, Bakuzonis C, Friedman SB, Roa RL Benchmark indicators for medical equipment repair and maintenance. Biomed Instrum Technol . 1995;29:308–321. [PubMed: 7550498]
45.
Cohen T Validating medical equipment repair and maintenance metrics: a progress report. Biomed Instrum Technol . 1997;31:23–32. [PubMed: 9051223]
46.
Shaffer MJ Biomedical equipment: maintenance factors, units of measurement, and standards. Med Instrum . 1985;19:268–272. [PubMed: 4079851]
47.
Leape LL Error in medicine. JAMA . 1994;272:1851–1857. [PubMed: 7503827]
48.
James PJ Equipment management risk rating system based on engineering endpoints. Biomed Instrum Technol . 1999;33:115–120. [PubMed: 10194564]
49.
Cohen T Validating medical equipment repair and maintenance metrics, Part II: Results of the 1997 survey. Biomed Instrum Technol . 1998;32:136–144. [PubMed: 9559110]
50.
Keil O, Widmann DE Assessment of the impact of medical devices on the quality of care. QRB Qual Rev Bull . 1984;10:278–280. [PubMed: 6436769]
51.
Caplan RA, Vistica MF, Posner KL, Cheney FW Adverse anesthetic outcomes arising from gas delivery equipment: a closed claims analysis. Anesthesiology . 1997;87:741–748. [PubMed: 9357874]
52.
Cooper JB, Newbower RS, Long CD, McPeek B Preventable anesthesia mishaps: a study of human factors. Anesthesiology . 1978;49:399–406. [PubMed: 727541]
53.
Cooper JB Toward prevention of anesthetic mishaps. Int Anesthesiol Clin . 1984;22:167–183. [PubMed: 6724710]
54.
March MG, Crowley JJ An evaluation of anesthesiologists' present checkout methods and the validity of the FDA checklist. Anesthesiology . 1991;75:724–729. [PubMed: 1952196]