Ensuring a suitable pH in the culture broth is a major problem in microorganism-assisted industrial fermentation of organic acids. To address this issue, we investigated the physiological changes in Rhizopus oryzae at different extracellular pH levels and attempted to solve the issue of cell shortage under low pH conditions. We compared various parameters, such as membrane fatty acids' composition, intracellular pH, and adenosine triphosphate (ATP) concentration. It was found that the shortage of intracellular ATP might be the main reason for the low rate of fumaric acid production by R. oryzae under low pH conditions. When 1 g/l citrate was added to the culture medium at pH 3.0, the intracellular ATP concentration increased from 0.4 to 0.7 µmol/mg, and the fumaric acid titer was enhanced by 63% compared with the control (pH 3.0 without citrate addition). The final fumaric acid concentration at pH 3.0 reached 21.9 g/l after 96 h of fermentation. This strategy is simple and feasible for industrial fumaric acid production under low pH conditions.