We calculated the sensitivity of phase (dB/dp) and group (dG/dp) modal birefringence to hydrostatic pressure versus wavelength in two birefringent holey fibers of different construction, where B is the phase modal birefringence, G is the group modal birefringence, and p is the pressure applied to the fiber. The contributions of the geometrical effects that were related only to deformation of the holey structure and the stress-related contribution to the overall pressure sensitivities were analyzed separately. Our results show that these two factors decrease the phase modal birefringence in both structures, which results in negative signs of dB/dp and dG/dp. Furthermore, we demonstrate that the geometrical effects are much weaker than the stress-related effects and contribute only a few percent to the overall pressure sensitivity.