Phase coherence is a fundamental concept in quantum mechanics. Understanding the loss of coherence is paramount for future quantum information processing. We studied the coherent dynamics of a single central spin (a nitrogen-vacancy center) coupled to a bath of spins (nitrogen impurities) in diamond. Our experiments show that both the internal interactions of the bath and the coupling between the central spin and the bath can be tuned in situ, allowing access to regimes with surprisingly different behavior. The observed dynamics are well explained by analytics and numerical simulations, leading to valuable insight into the loss of coherence in spin systems. These measurements demonstrate that spins in diamond provide an excellent test bed for models and protocols in quantum information.