The antibody response elicited after immunization with vaccinia virus (VacV) is known to be sufficient to confer host protection against VacV or smallpox. In humans it has been shown that such anti-VacV antibody production can be sustained for decades. Nevertheless, little is known about the kinetics and the role in protection of the early antibody response after vaccination. In this study we identify VacV neutralizing IgM antibodies as early as 4 days after infection of C57BL/6 mice. Most of this IgM production is T cell dependent and predominantly independent of the germinal center reaction (SAP/SH2D1A independent). Importantly, the IgM neutralized both infectious forms of VacV: the intracellular mature virion (MV, IMV) and the extracellular enveloped virion (EV, EEV). Moreover, in mice primed with MHCII restricted peptides, an increase in the total VacV neutralizing antibody titers was seen, a large component of which was neutralizing IgM against the same protein from which the priming peptide was derived. To further demonstrate the biological relevance of this early neutralizing response, we examined anti-VacV antibodies in humans after vaccination. Human subjects could be divided into two groups early after immunization: IgG(hi) and IgG(lo). VacV IgM neutralizing antibodies were detected in the IgG(lo) group. Taken together these results indicate that both in a small animal model and in humans an early neutralizing IgM response after VacV immunization is present and likely contributes to control of the infection prior to the development of a robust IgG response.