Brain connections are organized into topographic maps that are precisely aligned both within and across modalities. This alignment facilitates coherent integration of different categories of sensory inputs and allows for proper sensorimotor transformations. Topographic maps are established and aligned by multistep processes during development, including interactions of molecular guidance cues expressed in gradients; spontaneous activity-dependent axonal and dendritic remodeling; and sensory-evoked plasticity driven by experience. By focusing on the superior colliculus, a major site of topographic map alignment for different sensory modalities, this review summarizes current understanding of topographic map development in the mammalian visual system and highlights recent advances in map alignment studies. A major goal looking forward is to reveal the molecular and synaptic mechanisms underlying map alignment and to understand the physiological and behavioral consequences when these mechanisms are disrupted at various scales.