Internal and external fluctuations are ubiquitous in cellular signaling processes. Because biochemical reactions often evolve on disparate time scales, mathematical perturbation techniques can be invoked to reduce the complexity of stochastic models. Previous work in this area has focused on direct treatment of the master equation. However, eliminating fast variables in the chemical Langevin equation is also an important problem. We show how to solve this problem by utilizing a partial equilibrium assumption. Our technique is applied to a simple birth-death-dimerization process and a more involved gene regulation network, demonstrating great computational efficiency. Excellent agreement is found with results computed from exact stochastic simulations. We compare our approach with existing reduction schemes and discuss avenues for future improvement.