A closed droplet based lab-on-a-chip (LOC) device has been developed for the differentiation of six species of mycobacteria, i.e., both Mycobacterium tuberculosis complex (MTC) and nontuberculous mycobacteria (NTM), using surface-enhanced Raman spectroscopy (SERS). The combination of a fast and simple bead-beating module for the disruption of the bacterial cell with the LOC-SERS device enables the application of an easy and reliable system for bacteria discrimination. Without extraction or further treatment of the sample, the obtained SERS spectra are dominated by the cell-wall component mycolic acid. For the differentiation, a robust data set was recorded using a droplet based LOC-SERS device. Thus, more than 2100 individual SERS spectra of the bacteria suspension were obtained in 1 h. The differentiation of bacteria using LOC-SERS provides helpful information for physicians to define the conditions for the treatment of individual patients.