We consider closed quantum systems which are driven such that only negligible heating occurs. If driving only affects small parts of the system, it may nonetheless be strong. Our analysis aims at clarifying under which conditions the Jarzynski relation (JR) holds in such setups, if the initial states are microcanonical or even energy eigenstates. We find that the validity of the JR for the microcanonical initial state hinges on an exponential density of states and on stiffness. The latter indicates an independence of the probability density functions (PDFs) of work of the energy of the respective microcanonical initial state. The validity of the JR for initial energy eigenstates is found to additionally require smoothness. The latter indicates an independence of the work PDFs of the specific energy eigenstates within a microcanonical energy shell. As the validity of the JR for pure initial energy eigenstates has no analog in classical systems, we consider it a genuine quantum phenomenon.