Nucleomorphs are the remnant nuclei of algal endosymbionts in cryptophytes and chlorarachniophytes, two evolutionarily distinct unicellular eukaryotic lineages that acquired photosynthesis secondarily by the engulfment of red and green algae, respectively. At less than one million base pairs in size, nucleomorph genomes are the most highly reduced nuclear genomes known, with three small linear chromosomes and a gene density similar to that seen in prokaryotes. The independent origin of nucleomorphs in cryptophytes and chlorarachniophytes presents an interesting opportunity to study the reductive evolutionary forces that have led to their remarkable convergence upon similar genome architectures and coding capacities. In this article, we review the current state of knowledge with respect to the structure, function, origin, and evolution of nucleomorph genomes across the known diversity of cryptophyte and chlorarachniophyte algae.