Anxiety disorders are thought to reflect deficits in the regulation of fear memories. While the amygdala has long been considered a site of storage of fear memories, newer findings suggest that the prefrontal cortex (PFC) is essential in the regulation of amygdala-dependent memories and fear expression. Here, activation of the prelimbic cortex (PrL) enhances the expression of fear, while an elevated activity in the infralimbic cortex (IL) enhances fear extinction. Despite the presence of these facts, we still know very little about the synaptic interconnectivity within the PFC. The aim of the present study was to investigate the inhibitory circuits between prelimbic and IL using morphological and electrophysiological methods. Our immunohistochemical analysis revealed that the distribution of PV(+)- and NPY(+)-GABAergic neurons was strikingly different within the PFC. In addition, we provided the first experimental evidence that the pyramidal neurons in the PrL received a direct inhibitory input mediated by bipolar NPY(+)-GABAergic projection neurons in the IL. Deletion of the anxiety-related neuroligin 2 gene caused a decrease of this direct synaptic inhibition that originated from the IL. Thus, our data suggested that activation of the IL might not only directly activate the corresponding downstream anxiolytic pathway, but also suppress the PrL-related anxiogenic pathway and thus could differentially bias the regulation of fear expression and extinction.