• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of brjindmedLink to Publisher's site
Br J Ind Med. Oct 1986; 43(10): 667–676.
PMCID: PMC1007735

Inter-rater agreement in assessing occupational exposure in a case-control study.


The identification of occupational carcinogens in the workplace is a major concern of epidemiologists. A novel case-control approach has been developed which includes as a key component the assessment of a subject's occupational exposure history by a two stage process. Firstly, the subject is interviewed to obtain a detailed lifetime job history. Then a team of chemists and hygienists, hired and trained to do this work on a full time basis, translates each job into a list of potential occupational exposures. The present study investigated the inter-rater agreement in this type of retrospective exposure assessment. Six trials were carried out over a four year period with different raters and different sets of job files. Some trials involved only internal raters from the "in house" group whereas others involved comparisons between the internal raters and other external raters who had expertise in certain industries. In assessing exposure as simply present or absent, two summary indices of agreement were used: per cent with perfect agreement and Cohen's kappa. In most of the trials the per cent with perfect agreement among raters ranged from 95% to 98%, with kappa ranging from 0.5 to 0.7. The kappas were slightly higher for internal-internal comparisons than for internal-external ones. These results indicate a relatively high degree of inter-rater agreement and lend credibility to the validity of this type of retrospective exposure assessment.

Full text

Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (1.4M), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.

Selected References

These references are in PubMed. This may not be the complete list of references from this article.
  • Hoar SK, Morrison AS, Cole P, Silverman DT. An occupation and exposure linkage system for the study of occupational carcinogenesis. J Occup Med. 1980 Nov;22(11):722–726. [PubMed]
  • Siemiatycki J, Day NE, Fabry J, Cooper JA. Discovering carcinogens in the occupational environment: a novel epidemiologic approach. J Natl Cancer Inst. 1981 Feb;66(2):217–225. [PubMed]
  • Hernberg S, Collan Y, Degerth R, Englund A, Engzell U, Kuosma E, Mutanen P, Nordlinder H, Hansen HS, Schultz-Larsen K, et al. Nasal cancer and occupational exposures. Preliminary report of a joint Nordic case-referent study. Scand J Work Environ Health. 1983 Apr;9(2 Spec No):208–213. [PubMed]
  • Hernberg S, Korkala ML, Asikainen U, Riala R. Primary liver cancer and exposure to solvents. Int Arch Occup Environ Health. 1984;54(2):147–153. [PubMed]
  • Greenberg RA, Tamburro CH. Exposure indices for epidemiological surveillance of carcinogenic agents in an industrial chemical environment. J Occup Med. 1981 May;23(5):353–358. [PubMed]
  • Siemiatycki J, Gérin M, Richardson L, Hubert J, Kemper H. Preliminary report of an exposure-based, case-control monitoring system for discovering occupational carcinogens. Teratog Carcinog Mutagen. 1982;2(2):169–177. [PubMed]
  • Gérin M, Siemiatycki J, Kemper H, Bégin D. Obtaining occupational exposure histories in epidemiologic case-control studies. J Occup Med. 1985 Jun;27(6):420–426. [PubMed]
  • Rogot E, Goldberg ID. A proposed index for measuring agreement in test-retest studies. J Chronic Dis. 1966 Sep;19(9):991–1006. [PubMed]
  • Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–174. [PubMed]
  • Baumgarten M, Siemiatycki J, Gibbs GW. Validity of work histories obtained by interview for epidemiologic purposes. Am J Epidemiol. 1983 Oct;118(4):583–591. [PubMed]

Articles from British Journal of Industrial Medicine are provided here courtesy of BMJ Group


Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...


  • PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...