This paper proposes an oriented Hausdorff similarity (OHS) measure for robust object alignment. The OHS measure is introduced by replacing the distance concept of conventional Hausdoff distance (HD) algorithms by the similarity concept of the Hough transform (HT). The proposed algorithm can be considered as the modified directed HT using the distance transform (DT). The orientation information at each pixel is also used to remove incorrect correspondences.