Annexin A6 (AnxA6) belongs to a family of Ca(2+)-dependent membrane-binding proteins and is involved in the regulation of endocytic and exocytic pathways. We previously demonstrated that AnxA6 regulates receptor-mediated endocytosis and lysosomal targeting of low-density lipoproteins and translocates to cholesterol-enriched late endosomes (LE). As cholesterol modulates the membrane binding and the cellular location of AnxA6, but also affects the intracellular distribution of caveolin, we investigated the localization and trafficking of caveolin in AnxA6-expressing cells. Here, we show that cells expressing high levels of AnxA6 are characterized by an accumulation of caveolin-1 (cav-1) in the Golgi complex. This is associated with a sequestration of cholesterol in the LE and lower levels of cholesterol in the Golgi and the plasma membrane, both likely contributing to retention of caveolin in the Golgi apparatus and a reduced number of caveolae at the cell surface. Further strengthening these findings, knock down of AnxA6 and the ectopic expression of the Niemann-Pick C1 protein in AnxA6-overexpressing cells restore the cellular distribution of cav-1 and cholesterol, respectively. In summary, this study demonstrates that elevated expression levels of AnxA6 perturb the intracellular distribution of cholesterol, which indirectly inhibits the exit of caveolin from the Golgi complex.