• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of bmjBMJ helping doctors make better decisionsSearch bmj.comLatest content
BMJ. May 15, 2004; 328(7449): 1171–1172.
PMCID: PMC411094

Prescribing safety features of general practice computer systems: evaluation using simulated test cases

Bernard Fernando, general practitioner,1 Boki S P Savelyich, research associate,2 Anthony J Avery, professor of primary health care,2 Aziz Sheikh, professor of primary care research & development,3 Mike Bainbridge, technical director,4 Pete Horsfield, clinical director,4 and Sheila Teasdale, service director4

Over 90% of general practices in the United Kingdom regularly use computers for clinical care.1 These computing systems contain drug interaction alerts, and these are considered useful by most general practitioners.2 Relatively little attention, however, has been paid to other potential safety features for prescribing, such as contraindication alerts. The NHS Information Authority has regulated use of general practice computer systems through a set of rules known as requirements for accreditation, but these contain only general references to safety and there is evidence that they do not prevent contraindicated prescribing.3

Reducing the risks of iatrogenic harm is an important issue for the NHS, and interest has focused on safer prescribing in primary care.4 We undertook a laboratory based evaluation of safety features for prescribing of the four main computing systems used in UK primary care.5

Method and results

We used a two round Delphi approach to reach agreement on the most important safety features of general practice computer systems.5 This involved electronically circulating a list of 55 theoretically derived statements related to safety to 22 members of a selected multidisciplinary expert panel. Statements related to eight broad themes covering key areas in the medicines management process: prescriber alerts, reports and clinical audit, user interface, repeat prescribing, decision support, coding, monitoring, and links to laboratories.

Over 90% of the panel judged 32 of these statements to be important, and these were then used to develop 18 scenarios, which were tested using dummy patient records on the four computing systems. The systems (labelled A, B, C, and D in order to preserve suppliers' anonymity) were independently evaluated at Primary Care Information Services (PRIMIS) laboratories by two members of the project team. To minimise risk of bias, systems were tested with each of the scenarios in random order and data were recorded on to piloted data extraction sheets.

We defined the standards against which the computing systems were to be evaluated. These included appropriate alerts when contraindicated drugs or hazardous drug-drug combinations were prescribed. For each scenario, the safety profile of the computing system was categorised as appropriate or inappropriate. Evaluators compared findings, and an agreed mechanism was available for resolving disagreements should these arise. Finally, to ensure that there were no technical set-up problems that could have accounted for the observed failures, we reported the problems that were identified to the manufacturers and invited comment.

None of the systems produced alerts for all of the 18 scenarios (table). In terms of prescription of drugs with similar names, none of the systems warned for all 10 drug pairs considered.

Table 1
Responses of computer systems tested for prescribing scenarios

The evaluators produced no discrepancies in assessing the safety of systems. Each of the four system suppliers agreed with our assessments.

Comment

The safety features of computing systems currently in use in about three quarters of UK general practices have clinically important deficiencies. All may fail to warn in a situation when a warning is expected, thus potentially creating a health hazard to patients.

One solution to this problem is to have more explicit regulations about the situations in which suppliers should implement specific alerts. Because information technology, pharmacology, and medicine are dynamic fields, suppliers of systems and drug databases would need to have regular dialogue with end users about ways of further improving the safety features of these important aides to clinical management. Our discussions with manufacturers indicate that many of the problems uncovered could be resolved, and this work is now being taken forward by the National Patient Safety Agency.

Acknowledgments

We thank the PRIMIS staff for help with the system set up for the evaluation, GP computer system suppliers for responding constructively to our work, and Judy Cantrill and Caroline Morris for their involvement in the Delphi exercise. This work formed a part of BF's MSc thesis which was co-supervised by Dipak Kalra of CHIME, University College, London.

Notes

Contributors: AA and BF conceived the study, all authors were involved in study design, BF and BS tested the computer systems, all authors were involved in the analysis, and BF, BS, AS, and AA wrote the paper. AA is guarantor.

Funding: National Patient Safety Agency.

Competing interests: Until October 2002 MAB was paid as a medical consultant to Torex Health.

Ethical approval: Not required.

References

1. Department of Health. Delivering 21st century IT support for the NHS: national strategic programme. London: Department of Health, 2002. www.dh.gov.uk/assetRoot/04/06/71/12/04067112.pdf (accessed 23 Apr 2004).
2. Magnus D, Rodger S, Avery AJ. GPs' views on computerised drug interaction alerts: questionnaire survey. J Clin Pharm Ther 2002;27: 377-82. [PubMed]
3. Yen-Fu C, Avery AJ, Neil K, Johnson C. Assessing the occurrence and preventability of prescribing potentially hazardous/contraindicated drug combinations in general (family) practice. Pharmacoepidemiol Drug Safety 2001;10: S53. [PubMed]
4. Wilson T, Sheikh A. Enhancing public safety in primary care. BMJ 2002;324: 584-7. [PMC free article] [PubMed]
5. Avery AJ, Savelyich B, Teasdale S. Improving the safety features of general practice computer systems. Informatics Prim Care 2003;11: 203-6. [PubMed]

Articles from BMJ : British Medical Journal are provided here courtesy of BMJ Group
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

  • Cited in Books
    Cited in Books
    PubMed Central articles cited in books
  • PubMed
    PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...