Amyloid-like protein aggregates have been implicated in various diseases and in the protein-based inheritance of yeast prions. The molecular chaperone Hsp104 has been shown to be necessary for the aggregate formation of polyglutamine in yeast, and for the maintenance of several yeast prion phenotypes through the formation of self-propagating aggregates. In this paper, we show that the polyglutamine aggregates that are formed independently of Hsp104, are required for Hsp104 to efficiently produce more aggregates. Similarly, in the yeast prion [PSI+] system, Hsp104-dependent epigenetic changes to the [PSI+] prion phenotype require the presence of prion aggregates in the normal [psi-] state. We also show that the co-localization of different prion aggregates suggests that cross-seeding by different yeast prions increases the probability of Hsp104-dependent epigenetic change. These findings highlight the role of pre-existing aggregates in chaperone-dependent establishment of the epigenetic trait in yeast prions, and possibly in the pathology of several neurodegenerative diseases.