Bone metastasis is very common in advanced prostate cancer. Docetaxel has been shown to improve survival in patients with metastatic prostate cancer. However, treatment with docetaxel is associated with a certain degree of toxicity. Genistein, derived from soybeans, has been found to inhibit cancer cell growth without toxicity. We have recently reported that genistein could potentiate the antitumor activity of chemotherapeutic agents both in vitro and in vivo. However, the molecular mechanism of this novel effect of genistein has not been fully elucidated. In this study, we found that genistein significantly potentiated the antitumor, anti-invasive, and antimetastatic activities of docetaxel both in culture and in severe combined immunodeficient (SCID)-human model of experimental prostate cancer bone metastasis. We further conducted microarray analysis, real-time reverse transcription-PCR, Western blot analysis, small interfering RNA and cDNA transfection, matrix metalloproteinase-9 (MMP-9) activity assay, and invasion assay. We found that the expression of osteoprotegerin (OPG) was induced by genistein and inhibited by docetaxel, whereas genistein significantly down-regulated the expression and secretion of receptor activator of nuclear factor-kappaB (RANK) ligand (RANKL) and inhibited osteoclast formation. Moreover, genistein down-regulated the expression and activity of MMP-9, which was induced by docetaxel treatment, and inhibited invasion of PC-3 cells. These results suggest that the observed potentiation of antitumor activity of docetaxel by genistein in the SCID-human model of experimental bone metastasis could be mediated by regulation of OPG/RANK/RANKL/MMP-9 signaling, resulting in the inhibition of osteoclastic bone resorption and prostate cancer bone metastasis. From these results, we conclude that genistein could be a promising nontoxic agent to improve the treatment outcome of metastatic prostate cancer with docetaxel.