We study the spectral correlation properties of the polarized fluorescence spectra of normal and cancerous human breast tissues, corresponding to patients belonging to diverse age groups and socioeconomic backgrounds. The emission range in the visible wavelength regime of 500 to 700 nm is analyzed, with the excitation wavelength at 488 nm, where flavin is one of the active fluorophores. The correlation matrices for parallel and perpendicularly polarized fluorescence spectra reveal correlated domains, differing significantly in normal and cancerous tissues. These domains can be ascribed to different fluorophores and absorbers in the tissue medium. The spectral fluctuations in the perpendicular component of the cancerous tissue clearly reveal randomization not present in the normal channel. Random matrix-based predictions for the spectral correlations match quite well with the observed behavior. The eigenvectors of the correlation matrices corresponding to large eigenvalues clearly separate out different tissue types and identify the dominant wavelengths, which are active in cancerous tissues.