The purpose of this study is to examine the most reliable and valid way for rating and comparing videolaryngostroboscopic recordings with a differentiated protocol. 30 high quality videostroboscopic recordings (2-5 minutes) of all kinds of vocal fold pathology were rated independently by 7 experienced laryngologists/phoniatricians, using a standardized and exhaustive protocol form. Interobserver agreement is high for amplitude, mucosal wave, and type of closure/symmetry, is satisfactory for regularity, consistency and vibration of the lesion (if any), and is rather moderate to low for grade of glottic closure and symmetry. As a general rule, raters trained with the protocol form show higher agreement than raters without such experience. Intraobserver consistency is good for all parameters.