Topological associating domains (TADs) are self-interacting genomic units crucial for shaping gene regulation patterns. Despite their importance, the extent of their evolutionary conservation and its functional implications remain largely unknown. In this study, we generate Hi-C and ChIP-seq data and compare TAD organization across four primate and four rodent species, and characterize the genetic and epigenetic properties of TAD boundaries in correspondence to their evolutionary conservation. We find that only 14% of all human TAD boundaries are shared among all eight species (ultraconserved), while 15% are human-specific. Ultraconserved TAD boundaries have stronger insulation strength, CTCF binding, and enrichment of older retrotransposons, compared to species-specific boundaries. CRISPR-Cas9 knockouts of two ultraconserved boundaries in mouse models leads to tissue-specific gene expression changes and morphological phenotypes. Deletion of a human-specific boundary near the autism-related AUTS2 gene results in upregulation of this gene in neurons. Overall, our study provides pertinent TAD boundary evolutionary conservation annotations, and showcase the functional importance of TAD evolution.