We report experimental evidence of a remarkable spontaneous time-reversal symmetry breaking in two-dimensional electron systems formed by atomically confined doping of phosphorus (P) atoms inside bulk crystalline silicon (Si) and germanium (Ge). Weak localization corrections to the conductivity and the universal conductance fluctuations were both found to decrease rapidly with decreasing doping in the Si:P and Ge:P delta layers, suggesting an effect driven by Coulomb interactions. In-plane magnetotransport measurements indicate the presence of intrinsic local spin fluctuations at low doping, providing a microscopic mechanism for spontaneous lifting of the time-reversal symmetry. Our experiments suggest the emergence of a new many-body quantum state when two-dimensional electrons are confined to narrow half-filled impurity bands.