The prefrontal cortex (PFC) is important for flexible, context-dependent behavioral control. It also plays a critical role in short-term memory maintenance. Though many studies have investigated these functions independently, it is unclear how these two very different processes are realized by a single brain area. To address this, we trained two monkeys on two variants of an object sequence memory task. These tasks had the same memory requirements but differed in how information was read out and used. For the "recognition" task, the monkeys had to remember two sequentially presented objects and then release a bar when a matching sequence was recognized. For the "recall" task, the monkeys had to remember the same sequence of objects but were instead required to recall the sequence and reproduce it with saccadic eye movements when presented with an array of objects. After training, we recorded the activity of PFC neurons during task performance. We recorded 222 neurons during the recognition task, 177 neurons during the recall task, and 248 neurons during the switching task (interleaved blocks of recognition and recall). Task context had a profound influence on neural selectivity for objects. During the recall task, the first object was encoded more strongly than the second object, while during the recognition task, the second object was encoded more strongly. In addition, most of the neurons encoded both the task and the objects, evidence for a single population responsible for these two critical prefrontal functions.