Water in aerosol OT reverse micelles has been extensively studied as a model system for nanoconfined water. Results from previous vibrational studies suggest that water confined this way has slower dynamics compared to bulk water; however, the effects on the hydrogen bonding network are unclear. From our study of the structure of water hydrogen bonding using x-ray Raman spectroscopy, we found an increased fraction of weakened hydrogen bonds upon confinement, similar to the effect seen in temperature increase and NaCl solvation, as evidenced by the changes in specific spectral features.