Kappa

Kappa coefficient is a statistical measure of inter-rater reliability. It is generally thought to be a more robust measure than simple percent agreement calculation because kappa takes into account the agreement occurring by chance.