MRG15 is a conserved chromodomain protein that associates with histone deacetylases (HDACs) and Tip60-containing histone acetyltransferase (HAT) complexes. Here we further characterize MRG15-containing complexes and show a functional link between MRG15 and histone H3K4 demethylase activity in mammalian cells. MRG15 was predominantly localized to discrete nuclear subdomains enriched for Ser(2)-phosphorylated RNA polymerase II, suggesting it is involved specifically with active transcription. Protein analysis of the MRG15-containing complexes led to the identification of RBP2, a JmjC domain-containing protein. Remarkably, over-expression of RBP2 greatly reduced the H3K4 methylation in culture human cells in vivo, and recombinant RBP2 efficiently removed H3K4 methylation of histone tails in vitro. Knockdown of RBP2 resulted in increased H3K4 methylation levels within transcribed regions of active genes. Our findings demonstrate that RBP2 associated with MRG15 complex to maintain reduced H3K4 methylation at transcribed regions, which may ensure the transcriptional elongation state.