• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of jgimedspringer.comThis journalToc AlertsSubmit OnlineOpen Choice
J Gen Intern Med. Apr 2007; 22(4): 544–548.
Published online Jan 20, 2007. doi:  10.1007/s11606-006-0071-6
PMCID: PMC1839864

Improving Death Certificate Completion: A Trial of Two Training Interventions

Abstract

The death certificate is an important medical document that impacts mortality statistics and health care policy. Resident physician accuracy in completing death certificates is poor. We assessed the impact of two educational interventions on the quality of death certificate completion by resident physicians. Two-hundred and nineteen internal medicine residents were asked to complete a cause of death statement using a sample case of in-hospital death. Participants were randomized into one of two educational interventions: either an interactive workshop (group I) or provided with printed instruction material (group II). A total of 200 residents completed the study, with 100 in each group. At baseline, competency in death certificate completion was poor. Only 19% of residents achieved an optimal test score. Sixty percent erroneously identified a cardiac cause of death. The death certificate score improved significantly in both group I (14±6 vs 24±5, p<0.001) and group II (14±5 vs 19±5, p<0.001) postintervention from baseline. Group I had a higher degree of improvement than group II (24±5 vs 19±5, p<0.001). Resident physicians’ skills in death certificate completion can be improved with an educational intervention. An interactive workshop is a more effective intervention than a printed handout.

Key Words: death certificate, health care policy, intervention, cardiac, workshop

INTRODUCTION

Data from death certificates constitute an essential component of national mortality and morbidity statistics. The Department of Health and Human Services, the National Center for Health Statistics, and the National Death Index rely on the accuracy of these forms. Earlier studies suggest that the accuracy and reliability of certification of underlying cause of death is very poor, and error rates range from 16 to 40%.15

Studies have also suggested that medical students, house staff, and junior physicians frequently commit mistakes in death certificate completion.69 In the majority of teaching hospitals, resident physicians are responsible for death certificate completion, but only a small percentage receives formal training.9 There are several documented causes for inaccuracies in death certificate completion at various stages of the process of death certificate completion, impacting mortality statistics.6,914 Because most academic medical centers do not provide specific training in death certificate completion, an educational intervention may be needed.69

Studies have shown that simple educational interventions can improve the accuracy of death certificate completion.2,15 In our study, we sought to assess the impact of two common types of educational interventions—an interactive workshop versus printed instruction material as a handout—on the accuracy of identifying the underlying cause of death.

MATERIALS AND METHODS

Subjects

A sample of 219 internal medicine residents from five teaching hospitals (University of Missouri School of Medicine, Kansas City, MO, USA; Creighton University School of Medicine, Omaha, NE, USA; Sinai Grace Hospital, Detroit, MI, USA; Harper Hospital, Wayne State University School of Medicine, Detroit, MI, USA; Harbor Hospital, Baltimore, MD, USA) were requested to complete a baseline and postintervention survey along with a model death certificate using sample cases of in-hospital death. The standard death certificate (World Health Organization [WHO]’s International Classification of Diseases [ICD—10th revision]) was used in the survey material.10 The participants were volunteers, and no financial compensation was provided.

Baseline Questionnaire

We designed a questionnaire, which assessed participants’ level of training, gender, previous experience, prior formal training, comfort level, awareness of guidelines, and desire for further training in death certificate completion.

Death Certificate Completion Test

After the baseline test (Test case 1), the participants were randomized to one of the two educational interventions—group I (interactive workshop or “workshop group”, n=105) and group II (printed handout or “print group”, n=114) at each of the five participating institutions separately using an internet-based randomization program16 (Fig. 1). Partic ipants were eliminated from the study if they failed to complete the baseline and postintervention death certificates and/or complete the workshop. Ultimately, data from 100 participants in each group pooled together from all the five participating institutions were available for analysis. The workshop group attended a 45-minute interactive workshop led by one of the authors (DRL, KRB, AKK, and SKR), and the print group received printed instruction materials that outlined the guidelines for optimal completion of death certificates. The authors who were in charge of the workshop were well versed with the guidelines and ICD coding, and the material used for both the interventions was prepared by the authors together. The contents of both types of interventions were the same in all the institutions. After 1 week, both groups were asked to complete a second death certificate (Test case 2) using a different sample case, and these certificates were quantitatively scored. In both model cases, the primary cause of death was noncardiac with patients experiencing unstable cardiac rhythms during resuscitation.

Figure 1
Randomization table of the study.

Underlying cause of death is defined as the initiating event, which starts the sequence of clinical events resulting in death. We used a standard death certificate approved by the WHO, which is in use across the world. Section (a) outlines the chain of events from immediate events to the underlying cause in a descending order. Section (b) outlines the associated comorbidities that add to the disease process. Responses in sections (a) and (b) of the death certificate were tabulated and analyzed based on the MAHI Death Certificate Scoring System.17 This 15-item scoring instrument uses the guidelines established by the College of American Pathologists, the National Association of Medical Examiners, and the National Center for Health Statistics. Each of the 15 items was scored using a 3-point system (0, 1, or 2) based on agreement with the standard (0=poor, 1=borderline, 2=good). We used a scoring system used in previous studies for quantifying level of performance.17 With a 0–2 grading system, “1” is representative of those responses which are not ideal but indicate some degree of knowledge and understanding. Each participant’s score was summed and labeled as acceptable (≥19) or unacceptable (≤18). Three evaluators (DRL, KRB, and AKK) blinded to the participant’s intervention reviewed all death certificates, and the mean was considered as the final score for each participant. The kappa score for each of the MAHIDCC score variable among the three evaluators was 0.88. The death certificate scores of 14 participants in group I and 12 participants in group II had discrepancy of more than 5 points among the three evaluators and were resolved through reevaluation by all the three evaluators together.

Statistical Methods Comparison of intervention groups was done using the chi-square statistic when the outcome variable was categorical. The McNemar test was used to compare two proportions estimated in a single population based on a set of random paired observations. The Fisher’s exact test was used for comparisons involving the categories of death certificate score. Stepwise logistic regression was used to identify the significant independent predictors of change in the death certificate score. Statistical significance was set at p<0.05.

RESULTS

Table 1 reports the baseline characteristics of the participants. Table 2 demonstrates that both groups showed a significant improvement in all areas of death certificate scored.

Table 1
Baseline (Preintervention) Characteristics
Table 2
Differences in Death Certificate Performance Before and After Intervention

The workshop group showed greater improvement compared to the print group in various parameters of death certificate completion as shown in Tables 2 and and3.3. Of note, the workshop group showed a dramatic reduction of incorrect identification of cardiac causes of death from 56 to 6% (p<0.001).

Table 3
Various Erroneous Cardiac Causes Identified by Participants in the Two Groups Before and After Educational Intervention

The stepwise logistic regression analysis showed that desire for further training before intervention (p<0.001), comfort with own ability after intervention (<0.001), intervention through didactic workshop (p<0.001), preintervention awareness of guidelines (p=0.003), and level of training (p=0.037) were independent predictors of change of death certificate scores from unacceptable to acceptable range.

DISCUSSION

Before an educational intervention, 60% of resident physicians in our study incorrectly identified a cardiac cause of death remarkably similar to a study by Behrendt et al.18, showing 61% of physicians who noted a nonspecific cardiovascular event as the cause of death. At least 20% of death certificates are assigned with a different cause of death, most commonly after autopsy.19,20 Clinicians may poorly perform compared with pathologists due to less training in and familiarity with the death certificate process.21 In the face of decreasing autopsies, the degree of accuracy in death certificate completion may decline even further due to lack of training in what is expected on a death certificate.13,5,6,8,12,15,19,2125

To our knowledge, there are only two previous studies that had evaluated the impact of an educational intervention on the death certification errors.15,26 An Australian study on house officers assessed the death certificate error rates 1 month before and after an educational intervention using printed educational material. There was a drop in error rate (22 to 15%) without statistical significance.26 Subsequently, Myers and Farquhar15 attempted to enhance the likelihood of achieving a significant change through an interactive learning method. A 75-minute didactic session, which details the common pitfalls in death certificate completion, was repeated three times over a period of 6 months. There was a reduction in major error rates (33 to 16%, p=0.01) and erroneous identification of cause of death (16 to 6%, p=0.03).

In our study, we used case simulations that are prepared based on real-life cases, and our evaluation was done through a validated scoring system instead of counting error rates. Additionally, we tested both types of educational intervention—printed instruction material and interactive workshop—to assess their effects on the learning process. Our results indicate that the accuracy of death certificate completion can be significantly improved by both interventions. However, the interactive workshop is a better mode of teaching than printed handouts. Interactive sessions provide an opportunity for greater one-on-one learning and enhanced understanding.

STUDY LIMITATIONS

This was a small study limited to internal medicine residents. There was a statistically significant difference in the awareness for guidelines in between the two groups. This fraction of participants was small, and the power of intervention is still valid in improving performance. The postintervention assessment of participants’ abilities was done after only 1 week. The case scenarios used were simulations created based on real cases that the authors had seen in their clinical practice. This study design limits our capability of testing the participants’ performance over time and the need for reeducation.

CONCLUSIONS

Resident physicians have poor skills in death certificate completion and often identify inappropriate cardiovascular causes as the underlying cause of death. Their performance can be significantly improved with an educational intervention. An interactive workshop is a more effective intervention than a printed instruction.

Acknowledgments

The authors of this manuscript would like to acknowledge Ms. Kay Ryschon, MS, of Valentine, NE, USA, for her statistical support during the development of this study. We also thank Dr. Andrea Natale, Head, Division of Electrophysiology, Cleveland Clinic Foundation, and Dr. Syed Mohiuddin, Director, Creighton Cardiac Center, Omaha, NE, USA, for his critical review of the manuscript. We are grateful to Dr. Kamani Lankachandra, MD, Director of Anatomic Pathology, UMKC School of Medicine, for her valuable feedback on various issues related to death certificates. We appreciate the secretarial support of Ms. Caroline Murray, Mid America Cardiology, in the preparation of this manuscript. The powerpoint presentation of the tutorial can be obtained from the corresponding authors if the reader wishes to use it.

Dr. Manohar Gowda passed away during the later half of this study. The other authors would like to dedicate this paper to his memory, great spirit, and kind heart.

Potential Financial Conflicts of Interest None disclosed.

Appendix

Test Case 1

The patient was a 29-year-old Caucasian male with known multiple sclerosis for 3 years complicated by paraplegia and chronic decubitus ulcers. His other medical conditions include atopic dermatitis and asthma. He was admitted to the intensive care unit with high-grade fevers, chills, and rigors, and leukocytosis (19×103/μL) with bandemia of 58%. Vital signs included the following: temperature, 102.5°F; pulse, 128 bpm; blood pressure, 85/55 mmHg; and oxygen saturation, 96% on room air. He also had a chronic indwelling urinary catheter, which had been changed. Urine analysis revealed gross pyuria and bacteriuria. Urine and blood cultures were obtained. He was started on levofloxacin (500 mg once daily intravenously) and was given 1.5 L of fluid bolus, after which his blood pressure improved to 115/60 mmHg. He was continued on normal saline at 100 cm3/h. He was stable for the next 12 hours when his blood pressure dropped to 60/40 mmHg. At that time, he was started on neosynephrine to titrate to systolic blood pressure >80 mmHg. During the next 36 hours, systolic blood pressure stabilized at 80 to 90 mmHg, and serum potassium levels increased from 3.6 to 7.3 mEq/L, whereas serum creatinine levels rose from 1.4 to 4.6 mg/dL. Oxygen saturation dropped to 79% on room air, and he was subsequently put on a 100% nonrebreather mask. Blood pressure started to decrease, and telemetry showed sustained monomorphic ventricular tachycardia. A Code Blue was called. No pulse or spontaneous breaths were detected. Cardiopulmonary resuscitation was initiated, and he was intubated. No pulse or change in rhythm was noted after three DC shocks and three boluses of intravenous epinephrine. Finally, he converted to normal sinus rhythm with shock after lidocaine bolus. He was started on a lidocaine drip. Shock profile was sent, and kayexalate per a nasogastric tube was given to address the high serum potassium level. He remained in normal sinus rhythm with multiple frequent premature ventricular contractions and a blood pressure of 60/30 mmHg. Neosynephrine was increased, and dopamine was started. Another Code Blue was called when the patient was found to be in asystole. Epinephrine and atropine (three boluses each) were administered, and the monitor showed coarse ventricular fibrillation after the fourth dose of atropine. No pulse was noted. He was shocked three times at 360 J, and a lidocaine bolus was given followed by another shock and a procainamide bolus. He was also given a bolus of bretylium as a last resort followed by another shock. Fifty minutes after initiating the second Code Blue, upon agreement with everyone involved, resuscitation attempts were discontinued, and the patient was declared dead.

An external file that holds a picture, illustration, etc.
Object name is 11606_2006_71_Figa_HTML.jpg

Correct completion of test case 1 would be as follows: Part I, line A = septic shock, line B = urinary tract infection, line C = neurogenic bladder, line D = multiple sclerosis; Part II = atopic dermatitis and asthma.

Test Case 2

The patient was a 39-year-old African American woman with known sickle cell disease for the past 22 years. She has been on chronic pain medications for intermittent episodes of sickle cell crises. She was well known to the internal medicine service from her multiple admissions over the last several years for sickle cell crises and her dependence on chronic pain medications. Her other medical problems include hypertension, mild renal insufficiency, and moderate mitral stenosis. She was admitted to the internal medicine service with complaints of painful sickle cell crises involving the lower extremities, fever, nausea, and vomiting. She had mild leukocytosis (12×103/μL). Vital signs included the following: temperature, 101°F; pulse, 114 bpm; blood pressure, 180/95 mmHg; and oxygen saturation, 92% on room air. Her hematocrit was 28, and Cr/BUN was 1.3/38. She was being treated with IV fluids, 3 L of inhaled O2, and pain medications. Also, she was restarted on her home diltiazem and ACE-I with improvement in her BP. The next day, she started complaining of more leg pain with some tenderness in her right calf. On examination, the right calf looked bigger than the left, and the intern had promptly started the patient on IV heparin, and the patient was wheeled down to the radiology department for bilateral lower extremity Doppler to assess for deep venous thrombosis. As the test was completed, patient complained of sudden onset of pleuritic chest pain with shortness of breath. Her oxygen saturation dropped to 82% on 2 L, and she was subsequently put on a 100% nonrebreather mask. She became hypotensive, and a Code Blue was called. Patient subsequently had agonal breathing without a palpable pulse. Portable monitoring unit showed sinus tachycardia at 140 bpm. Cardiopulmonary resuscitation was initiated, and she was intubated. No pulse or change in rhythm was noted after three boluses of intravenous epinephrine and continued CPR. Monitoring showed ventricular fibrillation, and a 360-J DC shock transiently brought the patient back to sinus tachycardia with feeble pulse. As the intern on the code team started getting central venous access through the right femoral vein, the patient went into asystole, and CPR was reinitiated. After 30 more minutes of ACLS upon agreement with everyone involved, resuscitation attempts were discontinued, and the patient was declared dead.

An external file that holds a picture, illustration, etc.
Object name is 11606_2006_71_Figb_HTML.jpg

Correct completion of the test case 2 would be as follows: Part I, line A = massive pulmonary embolism, line B = lower extremity deep venous thrombosis, line C = sickle cell disease, Part II = hypertension, mild renal insufficiency and mitral stenosis.

References

1. Jordan JM, Bass MJ. Errors in death certificate completion in a teaching hospital. Clin Invest Med. 1993;16:249–55. [PubMed]
2. Weeramanthri T, Bensford B. Death certification in Western Australia—classification of major errors in certificate completion. Aust J Public Health. 1992;16:431–4. [PubMed]
3. Slater DN. Certifying the case of death: an audit of wording inaccuracies. J Clinic Pathol. 1993;46:232–4. [PMC free article] [PubMed]
4. Peach HG, Brumley DJ. Death certification by doctors in non-metropolitan Victoria. Aust Fam Physician. 1998;27:178–82. [PubMed]
5. Gjersoe P, Andersen SE, Molbak AG, et al. Reliability of death certificates. The reproducibility of the recorded causes of death in patients admitted to departments of internal medicine. Ugeskr Laeger. 1998;160:5030–4. [PubMed]
6. Maudsley G, Williams E. Death certification by house officers and general practitioners—practice and performance. J Public Health Med. 1993;15:192–201. [PubMed]
7. Pain CH, Aylin P, Taud NA, et al. Death certification production and evaluation of training video. Med Educ. 1996;30:434–9. [PubMed]
8. Horner JS, Horner JW. Do doctors read forms? A one-year audit of medical certificates submitted to a crematorium. J R Soc Med. 1998;91:371–6. [PMC free article] [PubMed]
9. Barber JB. Improving the accuracy of death certificates. J Natl Med Assoc. 1992;84(12):1007–8. [PMC free article] [PubMed]
10. Hanzlick R, ed. The Medical Cause of Death Manual. Instructions for Writing Cause of Death Statements for Deaths Due to Natural Causes. Northfield (IL): College of American Pathologists; 1994:p. 8, 104.
11. Magrane BP, Gilliland MG, King DE. Certification of death by family physicians. Am Fam Phys. 1997;56:1433–8. [PubMed]
12. Fifty years of death certificates: The Framingham Heart Study. Ann Intern Med. 1998;129:1066–7. Editorial; comment. [PubMed]
13. Sorlie PD, Gold EB. The effect of physician terminology preference on coronary heart disease mortality: an artifact uncovered by the 9th revision ICD. Am J Public Health. 1987;77:148–52. [PMC free article] [PubMed]
14. Lloyd-Jones DM, Martin DO, Larson MG, Levy D. Accuracy of death certificates for coding coronary heart disease as the cause of death. Ann Intern Med. 1998;129:1020–6. [PubMed]
15. Myers KA, Farquhar DR. Improving the accuracy of death certification. CMAJ. 1998;158:1317–23. [PMC free article] [PubMed]
16. Dallal GE. First generator. Available at http://www.randomization.com. Accessed on 10/08/2000. (http://www.randomization.com).
17. Lakkireddy DR, Gowda MS, Basarakodu KR, Murray CW, Vacek JL. Death certificate completion—how well are physicians trained and are cardiovascular causes overstated? Am J Med. 2004;117:492–8. [PubMed]
18. Behrendt N, Heegaard S, Fornitz GG. The hospital autopsy: an important factor in hospital quality assurance. Ugeskr Laeger. 1999;161:5543–7. [PubMed]
19. Lu TH, Lee MC, Chou MC. Accuracy of cause of death coding in Taiwan: types of miscoding and effects on mortality statistics. Int J Epidemiol. 2000;29:336–43. [PubMed]
20. Cina SJ, Selby DM, Clark B. Accuracy of death certification in two tertiary care military hospitals. Mil Med. 1999;164:897–9. [PubMed]
21. Smith Sehdev AE, Hutchins GM. Problems with proper completion and accuracy of the cause of death statement. Arch Intern Med. 2001;161:277–84. [PubMed]
22. Roberts IS, Gorodkin LM, Benbow EW. What is a natural cause of death? A survey of coroners in England and walks approach borderline cases. J Clin Pathol. 2000;53:367–73. [PMC free article] [PubMed]
23. Hanzlick R. Death certificates. The need for further guidance. Am J Forensic Med Pathol. 1993;14:249–52. [PubMed]
24. Johansson LA, Westerling R. Comparing Swedish hospital discharge records with death certificates: implications for mortality statistics. Int J Epidemiol. 2000;29:495–502. [PubMed]
25. Sidenius KE, Munch EP, Madsen F, Lange P, Viskum K, Søes-Petersen U. Accuracy of recorded asthma deaths in Denmark in a 12 months period in 1994/95. Respir Med. 2000;94:373–7. [PubMed]
26. Weeramanthri T, Beresford W, Sathianathan V. An evaluation of an educational intervention to improve death certification practice. Aust Clin Rev. 1993;13:185–9. [PubMed]

Articles from Journal of General Internal Medicine are provided here courtesy of Society of General Internal Medicine
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Links

  • MedGen
    MedGen
    Related information in MedGen
  • PubMed
    PubMed
    PubMed citations for these articles