For the shortest pulses generated to date, the amplitude of the electromagnetic wave changes almost as rapidly as the field oscillates. The temporal variation of the field, which directly governs strong-field interactions, therefore depends on whether the maximum of the pulse amplitude coincides with that of the wave cycle or not, i.e., on the phase of the field with respect to the pulse envelope. It is demonstrated that the direction of electron emission from photoionized atoms can be controlled by varying the phase of the field, providing for the first time a tool for its accurate determination. Directing fast electron emission to the right or to the left with the light phase constitutes a new kind of coherent control.