Logo of qualhcLink to Publisher's site
Qual Health Care. 1999 Mar; 8(1): 6–15.
PMCID: PMC2483627

Development of review criteria for assessing the quality of management of stable angina, adult asthma, and non-insulin dependent diabetes mellitus in general practice


OBJECTIVE: To develop review criteria to assess the quality of care for three major chronic diseases: adult asthma, stable angina, and non- insulin dependent diabetes mellitus. SUBJECTS AND METHODS: Modified panel process based upon the RAND/UCLA (University College of Los Angeles) appropriateness method. Three multiprofessional panels made up of general practitioners, hospital specialists, and practice nurses. RESULTS: The RAND/UCLA appropriateness method of augmenting evidence with expert opinion was used to develop criteria for the care of the three conditions. Of those aspects of care which were rated as necessary by the panels, only 26% (16% asthma, 10% non-insulin dependent diabetes, 40% angina) were subsequently rated by the panels as being based on strong scientific evidence. CONCLUSION: The results show the importance of a systematic approach to combining evidence with expert opinion to develop review criteria for assessing the quality of three chronic diseases in general practice. The evidence base for the criteria was often incomplete, and explicit methods need to be used to combine evidence with expert opinion where evidence is not available.

Full Text

The Full Text of this article is available as a PDF (147K).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.
  • Grol R. Development of guidelines for general practice care. Br J Gen Pract. 1993 Apr;43(369):146–151. [PMC free article] [PubMed]
  • Forrest D, Hoskins A, Hussey R. Clinical guidelines and their implementation. Postgrad Med J. 1996 Jan;72(843):19–22. [PMC free article] [PubMed]
  • Thomson R, Lavender M, Madhok R. How to ensure that guidelines are effective. BMJ. 1995 Jul 22;311(6999):237–242. [PMC free article] [PubMed]
  • Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993 Nov 27;342(8883):1317–1322. [PubMed]
  • Eccles M, Clapp Z, Grimshaw J, Adams PC, Higgins B, Purves I, Russell I. North of England evidence based guidelines development project: methods of guideline development. BMJ. 1996 Mar 23;312(7033):760–762. [PMC free article] [PubMed]
  • Majeed FA, Voss S. Performance indicators for general practice. BMJ. 1995 Jul 22;311(6999):209–210. [PMC free article] [PubMed]
  • Anderson BG, Noyce JA. Clinical indicators and their role in quality management. Aust Clin Rev. 1992;12(1):15–21. [PubMed]
  • Angaran DM. Selecting, developing, and evaluating indicators. Am J Hosp Pharm. 1991 Sep;48(9):1931–1937. [PubMed]
  • Baker R, Fraser RC. Development of review criteria: linking guidelines and assessment of quality. BMJ. 1995 Aug 5;311(7001):370–373. [PMC free article] [PubMed]
  • Kosecoff J, Fink A, Brook RH, Chassin MR. The appropriateness of using a medical procedure. Is information in the medical record valid? Med Care. 1987 Mar;25(3):196–201. [PubMed]
  • Kahn KL, Rogers WH, Rubenstein LV, Sherwood MJ, Reinisch EJ, Keeler EB, Draper D, Kosecoff J, Brook RH. Measuring quality of care with explicit process criteria before and after implementation of the DRG-based prospective payment system. JAMA. 1990 Oct 17;264(15):1969–1973. [PubMed]
  • Brook RH, Chassin MR, Fink A, Solomon DH, Kosecoff J, Park RE. A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care. 1986;2(1):53–63. [PubMed]
  • Kahan JP, Bernstein SJ, Leape LL, Hilborne LH, Park RE, Parker L, Kamberg CJ, Brook RH. Measuring the necessity of medical procedures. Med Care. 1994 Apr;32(4):357–365. [PubMed]
  • Kahan JP, Park RE, Leape LL, Bernstein SJ, Hilborne LH, Parker L, Kamberg CJ, Ballard DJ, Brook RH. Variations by specialty in physician ratings of the appropriateness and necessity of indications for procedures. Med Care. 1996 Jun;34(6):512–523. [PubMed]
  • Gray D, Hampton JR, Bernstein SJ, Kosecoff J, Brook RH. Audit of coronary angiography and bypass surgery. Lancet. 1990 Jun 2;335(8701):1317–1320. [PubMed]
  • Scott EA, Black N. Appropriateness of cholecystectomy in the United Kingdom--a consensus panel approach. Gut. 1991 Sep;32(9):1066–1070. [PMC free article] [PubMed]
  • Shekelle PG, Kahan JP, Bernstein SJ, Leape LL, Kamberg CJ, Park RE. The reproducibility of a method to identify the overuse and underuse of medical procedures. N Engl J Med. 1998 Jun 25;338(26):1888–1895. [PubMed]
  • Ayanian JZ, Landrum MB, Normand SL, Guadagnoli E, McNeil BJ. Rating the appropriateness of coronary angiography--do practicing physicians agree with an expert panel and with each other? N Engl J Med. 1998 Jun 25;338(26):1896–1904. [PubMed]
  • Naylor CD. What is appropriate care? N Engl J Med. 1998 Jun 25;338(26):1918–1920. [PubMed]
  • Kravitz RL, Laouri M, Kahan JP, Guzy P, Sherman T, Hilborne L, Brook RH. Validity of criteria used for detecting underuse of coronary revascularization. JAMA. 1995 Aug 23;274(8):632–638. [PubMed]
  • Selby JV, Fireman BH, Lundstrom RJ, Swain BE, Truman AF, Wong CC, Froelicher ES, Barron HV, Hlatky MA. Variation among hospitals in coronary-angiography practices and outcomes after myocardial infarction in a large health maintenance organization. N Engl J Med. 1996 Dec 19;335(25):1888–1896. [PubMed]
  • Hicks NR. Some observations on attempts to measure appropriateness of care. BMJ. 1994 Sep 17;309(6956):730–733. [PMC free article] [PubMed]
  • Charlton BG. Practice guidelines and practical judgement: the role of mega-trials, meta-analysis and consensus. Br J Gen Pract. 1994 Jul;44(384):290–291. [PMC free article] [PubMed]
  • Milholland AV, Wheeler SG, Heieck JJ. Medical assessment by a Delphi group opinion technic. N Engl J Med. 1973 Jun 14;288(24):1272–1275. [PubMed]

Articles from Quality in Health Care : QHC are provided here courtesy of BMJ Group


Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...


  • Cited in Books
    Cited in Books
    PubMed Central articles cited in books
  • MedGen
    Related information in MedGen
  • PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...