Exemplar-centered supervised shallow parametric data embedding

DOIResolve DOI: http://doi.org/10.24963/ijcai.2017/345
AuthorSearch for: ; Search for: ; Search for:
Proceedings titleProceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence
ConferenceTwenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, August 19-25, 2017, Melbourne, Australia
Subjectmachine learning; neural networks; data mining
AbstractMetric learning methods for dimensionality reduction in combination with k-Nearest Neighbors (kNN) have been extensively deployed in many classification, data embedding, and information retrieval applications. However, most of these approaches involve pairwise training data comparisons, and thus have quadratic computational complexity with respect to the size of training set, preventing them from scaling to fairly big datasets. Moreover, during testing, comparing test data against all the training data points is also expensive in terms of both computational cost and resources required. Furthermore, previous metrics are either too constrained or too expressive to be well learned. To effectively solve these issues, we present an exemplar-centered supervised shallow parametric data embedding model, using a Maximally Collapsing Metric Learning (MCML) objective. Our strategy learns a shallow high-order parametric embedding function and compares training/test data only with learned or precomputed exemplars, resulting in a cost function with linear computational complexity for both training and testing. We also empirically demonstrate, using several benchmark datasets, that for classification in two-dimensional embedding space, our approach not only gains speedup of kNN by hundreds of times, but also outperforms state-of-the-art supervised embedding approaches.
Publication date
PublisherInternational Joint Conferences on Artificial Intelligence Organization
AffiliationInformation and Communication Technologies; National Research Council Canada
Peer reviewedYes
NPARC number23002155
Export citationExport as RIS
Report a correctionReport a correction
Record identifierbf98d9e7-d3c6-44db-88a8-d519e81abb48
Record created2017-08-28
Record modified2017-08-28
Bookmark and share
  • Share this page with Facebook (Opens in a new window)
  • Share this page with Twitter (Opens in a new window)
  • Share this page with Google+ (Opens in a new window)
  • Share this page with Delicious (Opens in a new window)