Magnetoplasmonics, combining magnetic and plasmonic functions, has attracted increasing attention owing to its unique magnetic and optical properties in various nano-architectures. In this work, Ag, CoFeB and ITO layers are fabricated on anodic aluminum oxide (AAO) porous films to form hybrid multi-layered nanoporous thin films by magnetron sputtering deposition process. The designed nanostructure supports localized surface plasmon resonance (LSPR) and tunable magneto-optical (MO) activity, namely, the sign inversion, which can be controlled by AAO porous film geometry (pore diameter and inter-pore spacing) flexibly. The physical mechanism of this special MO phenomena is further analyzed and discussed by the correlation of Kerr rotation and electronic oscillations controlled by the surface plasmon resonance that is related to the nanoporous structure.