The glycocalyx, a thick layer of carbohydrates, surrounds the cell wall of most bacterial and parasitic pathogens. Recognition of these unique glycans by the human immune system results in destruction of the invaders. To elicit a protective immune response, polysaccharides either isolated from the bacterial cell surface or conjugated with a carrier protein, for T-cell help, are administered. Conjugate vaccines based on isolated carbohydrates currently protect millions of people against Streptococcus pneumoniae, Haemophilus influenzae type b, and Neisseria meningitides infections. Active pharmaceutical ingredients (APIs) are increasingly discovered by medicinal chemistry and synthetic in origin, rather than isolated from natural sources. Converting vaccines from biologicals to pharmaceuticals requires a fundamental understanding of how the human immune system recognizes carbohydrates and could now be realized. To illustrate the chemistry-based approach to vaccine discovery, I summarize efforts focusing on synthetic glycan-based medicinal chemistry to understand the mammalian antiglycan immune response and define glycan epitopes for novel synthetic glycoconjugate vaccines against Streptococcus pneumoniae, Clostridium difficile, Klebsiella pneumoniae, and other bacteria. The chemical tools described here help us gain fundamental insights into how the human system recognizes carbohydrates and drive the discovery of carbohydrate vaccines.