Fast k-nearest neighbor classification using cluster-based trees

IEEE Trans Pattern Anal Mach Intell. 2004 Apr;26(4):525-8. doi: 10.1109/TPAMI.2004.1265868.

Abstract

Most fast k-nearest neighbor (k-NN) algorithms exploit metric properties of distance measures for reducing computation cost and a few can work effectively on both metric and nonmetric measures. We propose a cluster-based tree algorithm to accelerate k-NN classification without any presuppositions about the metric form and properties of a dissimilarity measure. A mechanism of early decision making and minimal side-operations for choosing searching paths largely contribute to the efficiency of the algorithm. The algorithm is evaluated through extensive experiments over standard NIST and MNIST databases.

Publication types

  • Comparative Study
  • Evaluation Study
  • Research Support, U.S. Gov't, Non-P.H.S.
  • Validation Study

MeSH terms

  • Algorithms*
  • Artificial Intelligence
  • Cluster Analysis*
  • Computer Graphics
  • Computer Simulation
  • Databases, Factual
  • Handwriting*
  • Image Enhancement / methods
  • Image Interpretation, Computer-Assisted / methods*
  • Imaging, Three-Dimensional / methods
  • Information Storage and Retrieval / methods*
  • Numerical Analysis, Computer-Assisted
  • Pattern Recognition, Automated*
  • Reproducibility of Results
  • Sensitivity and Specificity
  • Signal Processing, Computer-Assisted
  • Subtraction Technique*