• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of bmjBMJ helping doctors make better decisionsSearch bmj.comLatest content
BMJ. May 27, 2006; 332(7552): 1266–1268.
PMCID: PMC1471962

Review of NICE's recommendations, 1999-2005

James Raftery, professor of health technology assessment1

The creation of the National Institute for Clinical Excellence (NICE) in 1999 put the English NHS in a leading role in setting healthcare priorities.1 Although Australia, New Zealand, and Canada have systems that judge the cost effectiveness of drugs,2-4 they do not assess other health technologies. Bodies similar to NICE are reportedly being established in other countries, notably Germany5 and France.6 By April 2005, NICE had published 86 guidances on the use of health technologies and 39 guidelines on the treatment of diseases. It has received several generally favourable reviews from independent agencies including the House of Commons Health Committee,7 the World Health Organization,8 and independent academics.9

NICE recommendations

NICE appraises the clinical and cost effectiveness of health technologies referred to it by the Department of Health. This is different from a scientific assessment and synthesis of the evidence, which is subcontracted to independent academic groups. The two NICE committees appraise this often incomplete evidence. The committees rely on the judgments of their members, who comprise clinicians, health scientists, managers, and patient representatives.

NICE's recommendations are issued in the form of mandatory guidance to the NHS.10 It started controversially by recommending against the use of zanamavir, an antiviral drug for flu. However, reviews of the guidances issued in the first years show that few recommendations can be classified as simply yes or no.11-14

Despite suggestions to the contrary,11,13,15 NICE has repeatedly stated that it does not have a threshold at which cost effectiveness becomes unacceptable. However, it has clarified that when the cost per quality adjusted life year (QALY) is above £20 000 (€29 000; $37 000), “Judgements about the acceptability of the technology as an acceptable use of NHS resources are more likely to make more explicit reference to factors including the range of uncertainty surrounding the calculation, the innovative nature of the technology, the particular features of the condition and population receiving the technology, and where appropriate the wider societal costs and benefits. Above an incremental cost effectiveness ratio of £30 000/QALY, the case for supporting the technology on these factors has to be increasingly strong.”1616

Figure 1

An external file that holds a picture, illustration, etc.
Object name is rafj333963.f1.jpg

Yes but

Credit: AKG IMAGES

NICE is unique internationally in having a formal appeals process. Stakeholders, including companies and clinical organisations, can appeal against its findings on the grounds of process (due process), perversity (given the evidence), or powers (exceeding its powers). Appeals are heard by a panel composed largely of non-executive members of NICE and industry and patient representatives.

Review of guidance

I reviewed the guidance issued by NICE to the NHS between 1999 and 2005. Some appraisals included more than one technology, and some technologies could be used in different groups of patients. For each guidance, I identified one or more patient technology topics and classified the recommendation for each topic as yes, yes with major restrictions, yes with minor restrictions, and no (box). Restrictions for drugs were relative to licence, and for non-pharmaceuticals, relative to the size of the potential patient group. The classification of each guidance was validated by nine experts (see acknowledgments). I also noted the cost effectiveness (incremental cost per QALY) associated with each recommendation and the results of any appeals.

The 86 guidances published up to April 2005 covered 117 technology or patient topics (see bmj.com). Recommendations were fairly evenly distributed across the four categories, with NICE deciding no for 22 (19%), yes for 27 (23%), yes with major restrictions for 38 (32%) and yes with minor restrictions for 30 (26%).

Of the negative recommendations, almost two thirds were on the grounds of insufficient evidence, the rest were because of unacceptable cost effectiveness. The recommendations for use with major restrictions generally imposed restrictions to improve cost effectiveness. The recommendations with minor restrictions usually specified good clinical practice (monitoring required, use by specialist) but sometimes also recommended use of the lowest cost equivalent technology.

Acceptable cost effectiveness

The highest cost per QALY that NICE has accepted is an estimated £39 000 (range £35 000-43 000) for riluzole to treat motor neurone disease. The guidance noted “the values which patients place on the extension of tracheostomy free survival time.”17 For trastuzumab for advanced breast cancer, NICE cited the company's estimate of £37 500 per QALY but considered that the company's assumptions were unduly pessimistic.18 With imatinib for chronic myeloid leukaemia, NICE initially accepted a cost per QALY from £22 000 to £56 00019 but later reduced this to £26 000, which it calculated using a different comparator.20

Classification of NICE recommendations

Yes

Should be used routinely Can be considered as an option

Yes with major restrictions

Use only as second or subsequent line treatment Use only if intolerant to other treatment Must show response within specified time Restricted to sub-groups within licensed indications

Yes with minor restrictions

Use the least costly option Monitoring required Use by specialist only

No

Insufficient evidence for use Do not use because of poor cost effectiveness

Summary points

NICE published 86 guidances covering 117 topics in its first five years

About a fifth of guidances rejected use of the intervention

The remainder recommended use, although mostly with some restrictions

Appeals were made against almost a third of recommendations, four of which resulted in reappraisal

Interferon beta (and glatiramer acetate) for multiple sclerosis were deemed not cost effective at an incremental cost per QALY of £35 000-£104 000 (estimated mean £70 000). The government then intervened with a risk sharing scheme with a cost effectiveness threshold “set, for the purpose of this scheme only, at £36 000.”21 Under the scheme, eligible patients who consent have their clinical progress monitored against that required to meet the target cost effectiveness. Drug prices would be reduced for patients whose progress fell below the target. The scheme, established in 2002, had recruited more than 5000 patients by 2005. No reports of its progress have been published, but it will be interesting to see how well the scheme succeeds in achieving its target level of cost effectiveness.

Although NICE does not officially prioritise interventions that save lives over those that improve quality of life, its treatment of some topics suggests the rule of rescue,22 or prioritising life saving therapies, may play a part. With cancer drugs such as imatinib and trastuzumab, which extend life expectancy, NICE accepted relatively poor cost effectiveness. However, the acceptance of riluzole was based on considerations of quality of life rather than on mortality.

Consistency

Some topics have been appraised several times, partly because of appeals. Antiviral drugs for flu have had three appraisals as well as a rapid review in 1999. Each time NICE reiterated its recommendation against use of these drug by healthy people but in favour of their use in vulnerable groups. Three obesity treatments (two medical and one surgical) have been appraised. NICE concluded for each that they should be used only in people with proved determination and appropriate progress on treatment.

Appeals

NICE's 86 guidances have been subject to 25 appeals (29%). Fifteen were dismissed. Of the 10 appeals that were upheld, five resulted in relatively minor changes in the wording of the guidance. But five decisions (interferon beta in multiple sclerosis, drugs for colorectal cancer, flu antivirals, growth hormone in adults, and renal immunosupression in adults) were referred back to the appraisal committee for further appraisal. The appeals process has required NICE to show that it has been comprehensive in its examination of the evidence and consistent in its treatment of each topic.

Discussion

At its current rate of appraisal—around 20 a year—NICE can cover only a minority of new and existing treatments. This led to announcements in late 2005 of a more rapid review process.23 However, a more rapid process is likely to be considerably less intensive. The appraisal of drug treatments for multiple sclerosis, for example, took much of NICE's first two years, with 338 documents listed on its website. It eventually recommended against use of interferon beta and glatiramer acetate because of their high cost per QALY. Despite considerable effort, including additional research, NICE was unable to identify a subgroup of patients in whom these drugs might have a more acceptable level of cost effectiveness. The fact that the government then intervened with a special purchase scheme based on a cost per QALY gained of £36 00021 indicated that the government thought this was an acceptable level, at least for these drugs.

Overall NICE must be judged to have succeeded in surviving some controversial decisions. Its appeal system has imposed consistency and has so far prevented appellants proceeding to legal challenge. Although clinicians have understandably feared blanket restrictions, these have been fairly rare. NICE continues to be best characterised not by saying no, but by saying yes but...

Supplementary Material

[extra: Classification of the recommendations]

Notes

I thank Amanda Burls, Andy Clegg, Rumona Dickson, Ruairidh Milne, Alec Miners, Mark Sculpher, Ken Stein, Rod Taylor, and Tom Walley for help with classification of NICE guidance and Carey Hendron for administrative help.

Contributors and sources: JR is a health economist who has contributed to seven technology assessments for NICE.

Competing interests: None declared.

An external file that holds a picture, illustration, etc.
Object name is webplus.f2.gifClassification of the recommendations is on bmj.com

References

1. Ham C, Robert G. Conclusions. In: Reasonable rationing. International experience of priority setting in health care. Milton Keynes: Open University Press, 2003: 141-56.
2. Duckett SJ. Drug policy down under: Australia's pharmaceutical benefits scheme. Health Care Financing Review 2004;25(3): 55-67. [PubMed]
3. Porter RJ, Mulder RT. PHARMAC and availability of pharmaceuticals. N Z Med 2002;115: 274-5. [PubMed]
4. Corvari R, King D, Sanidas M. Canada: pharmaceutical pricing and reimbursement. London: London School of Economics, 2005.
5. Stiftung B. Centre for quality in medicine: from policy paper to draft bill. Westphalia: Health Policy Monitor, 2004.
6. French medicine. The price of popping pills. Economist 2004. May15: 40.
7. House of Commons Health Committee. Review of the National Institute for Clinical Excellence. London: Stationery Office, 2002.
8. Hill S, Garattini S, van Loenhout J, O'Brien B, de Joncheere K. Technology appraisal programme of the National Institute for Clinical Excellence: a review by the WHO. London: NICE, 2003.
9. Robert G. The United Kingdom. In: Ham C, Robert G, eds. Reasonable rationing. International experience of priority setting in health care. Milton Keynes: Open University Press, 2003: 64-93.
10. Newdick C. Who should we treat? Rights, rationing and resources in the NHS. 2nd ed. Oxford: Oxford University Press, 2005.
11. Raftery J. NICE: faster access to modern treatments? Analysis of guidance on health technologies. BMJ 2001;323: 1300-3. [PMC free article] [PubMed]
12. Devlin N, Parkin D. Does NICE have a cost effectiveness threshold and what other factors influence its decisions? A binary choice analysis. Health Economics 2004;13: 437-52. [PubMed]
13. Towse A, Devlin N, Pritchard C, eds. Cost effectiveness thresholds: economic and ethical issues. London: Office of Health Economics, King's Fund, 2002.
14. Miners AH, Garau M, Fidan D, Fischer AJ. Comparing estimates of cost effectiveness submitted to the National Institute for Clinical Excellence (NICE) by different organisations: retrospective study. BMJ 2005;330: 65-8. [PMC free article] [PubMed]
15. Devlin N, Parkin D. Does NICE have a cost effectiveness threshold and what other factors influence its decisions? A binary choice analysis. Health Economics 2004;13: 437-52. [PubMed]
16. National Institute for Clinical Excellence. Guide to the methods of technology appraisal. London: NICE, 2004.
17. National Institute for Clinical Excellence. Guidance on the use of riluzole for motor neurone disease. London: NICE, 2001.
18. National Institute for Clinical Excellence. Guidance on the use of trastuzumab for the treatment of advanced breast cancer. London: NICE, 2002.
19. National Institute for Clinical Excellence. Technology appraisal guidance No 50: the use of imatinib for chronic myeloid leukemia. London: NICE, 2002.
20. National Institute for Clinical Excellence. Technology appraisal guidance No 70: use of imatinib for chronic myeloid leukemia. London: NICE, 2003.
21. Department of Health. Cost effective provision of disease modifying therapies for people with multiple sclerosis. Health Service Circular HSC 2002/004.
22. Hadhorn D. Setting health care priorities in Oregon. Cost effectiveness meets the rule of rescue. JAMA 1991;265: 2218-25. [PubMed]
23. National Institute for Clinical Excellence. NICE to issue faster drugs guidance to NHS. London: NICE, 2005.

Articles from BMJ : British Medical Journal are provided here courtesy of BMJ Group
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

  • PubMed
    PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...