Sensitivity of the amplitude and phase measurements in interferometric microscopy is influenced by factors such as instrument design and environmental interferences. Through development of a theoretical framework followed by experimental validation, we show photon shot noise is often the limiting factor in interferometric microscopy measurements. Thereafter, we demonstrate how a state-of-the-art camera with million-level electrons full well capacity can significantly reduce shot noise contribution resulting in a stability of optical path length down to a few picometers even in a near-common-path interferometer.