Sulfated glycosaminoglycans (GAG) are components of the bone marrow stem cell niche and to a minor extent of mature bone tissue with important functions in regulating stem cell lineage commitment and differentiation. We anticipated that artificial extracellular matrices (aECM) composed of collagen I and synthetically oversulfated GAG derivatives affect preferentially the differentiation of osteoblast-precursor cells and early osteoblasts. A set of gradually sulfated chondroitin sulfate and hyaluronan derivatives was used for the preparation of aECM. All these matrices were analysed with human bone marrow stromal cells to identify the most potent aECM and to determine the influence of the degree and position of sulfate groups and the kind of disaccharide units on the osteogenic differentiation. Oversulfated GAG derivatives with a sulfate group at the C-6 position of the N-acetylglycosamine revealed the most pronounced proosteogenic effect as determined by tissue nonspecific alkaline phosphatase activity and calcium deposition. A subset of the aECM was further analysed with different primary osteoblasts and cell lines reflecting different maturation stages to test whether the effect of sulfated GAG derivatives depends on the maturation status of the cells. It was shown that the proosteogenic effect of aECM was most prominent in early osteoblasts.