Single-molecule fluorescence microscopy enables biological investigations inside living cells to achieve millisecond- and nanometer-scale resolution. Although single-molecule-based methods are becoming increasingly accessible to non-experts, optimizing new single-molecule experiments can be challenging, in particular when super-resolution imaging and tracking are applied to live cells. In this review, we summarize common obstacles to live-cell single-molecule microscopy and describe the methods we have developed and applied to overcome these challenges in live bacteria. We examine the choice of fluorophore and labeling scheme, approaches to achieving single-molecule levels of fluorescence, considerations for maintaining cell viability, and strategies for detecting single-molecule signals in the presence of noise and sample drift. We also discuss methods for analyzing single-molecule trajectories and the challenges presented by the finite size of a bacterial cell and the curvature of the bacterial membrane.