Information on the genetic diversity, population structure, and trait associations of germplasm resources is crucial for predicting hybrid performance. The objective of this study was to dissect the genetic diversity and population structure of extra-early yellow and orange quality protein maize (QPM) inbred lines and identify secondary traits for indirect selection for enhanced grain yield under low-soil nitrogen (LN). One hundred and ten inbred lines were assessed under LN (30 kg ha -1) and assayed for tryptophan content. The lines were genotyped using 2500 single nucleotide polymorphism (SNP) markers. Majority (85.4%) of the inbred lines exhibited wide pairwise genetic distances between 0.4801 and 0.600. Genetic distances were wider between yellow and orange endosperm lines and predicted high heterosis in crosses between parents of different endosperm colors. The unweighted pair group method with arithmetic mean (UPGMA) and the admixture model-based population structure method both grouped the lines into five clusters. The clustering was based on endosperm color, pedigree, and selection history but not on LN tolerance or tryptophan content. Genotype by trait biplot analysis revealed association of grain yield with plant height and ear height. TZEEQI 394 and TZEEIORQ 73A had high expressivity for these traits. Indirect selection for high grain yield among the inbred lines could be achieved using plant and ear heights as selection criteria. The wide genetic variability observed in this study suggested that the inbred lines could be important sources of beneficial alleles for LN breeding programs in SSA.