Cognitive abilities develop during the first 2 decades and start to decrease in the 6th decade of life. There is strong heritability of general cognitive ability as well as of specific cognitive functions which might increase with age till about age 80. Cognitive disorders derive from this physiological cognitive development; they are also under genetic control. This paper discusses age-specific genetic influences on cognitive functions in interplay with environmental factors and compares these determinants across the life span.