In this study, higher order statistics-based radial basis function network (RBF) was proposed for evoked potentials (EPs). EPs provide useful information on diagnosis of the nervous system. They are time-varying signals typically buried in ongoing EEG, and have to be extracted by special methods. RBF with least mean square (LMS) algorithm is an effective method to extract EPs. However, using LMS algorithm usually encounters gradient noise amplification problem, i.e., its performance is sensitive to the selection of step sizes and additional noise. Higher order statistics technique, which can effectively suppress Gaussian and symmetrically distributed non-Gaussian noises, was used to reduce gradient noise amplification problem on adaptation in this study. Simulations and human experiments were also carried out in this study.