Skip to main content
Article
A Multi-Step Nonlinear Dimension-Reduction Approach with Applications to Bigdata
Procedia Computer Science
  • R. Krishnan
  • V. A. Samaranayake, Missouri University of Science and Technology
  • Jagannathan Sarangapani, Missouri University of Science and Technology
Abstract

In this paper, a multi-step dimension-reduction approach is proposed for addressing nonlinear relationships within attributes. In this work, the attributes in the data are first organized into groups. In each group, the dimensions are reduced via a parametric mapping that takes into account nonlinear relationships. Mapping parameters are estimated using a low rank singular value decomposition (SVD) of distance covariance. Subsequently, the attributes are reorganized into groups based on the magnitude of their respective singular values. The group-wise organization and the subsequent reduction process is performed for multiple steps until a singular value-based user-defined criterion is satisfied. Simulation analysis is utilized to investigate the performance with five big data-sets.

Meeting Name
3rd International Neural Network Society Conference on Big Data and Deep Learning, INNS BDDL 2018 (2018: Apr. 17-19, Bali, Indonesia)
Department(s)
Mathematics and Statistics
Second Department
Electrical and Computer Engineering
Research Center/Lab(s)
Intelligent Systems Center
Second Research Center/Lab
Center for High Performance Computing Research
Comments

This research was supported in part by an NSF I/UCRC award IIP 1134721 and Intelligent Systems Center.

Keywords and Phrases
  • Big data,
  • Mapping,
  • Singular value decomposition,
  • Dimension reduction,
  • Mapping parameters,
  • Non-linear relationships,
  • Nonlinear dimension,
  • Parametric mapping,
  • Simulation analysis,
  • Singular values,
  • Subsequent reduction,
  • Deep learning
Document Type
Article - Conference proceedings
Document Version
Final Version
File Type
text
Language(s)
English
Rights
© 2018 The Authors, All rights reserved.
Creative Commons Licensing
Creative Commons Attribution-Noncommercial-No Derivative Works 4.0
Publication Date
4-1-2018
Publication Date
01 Apr 2018
Citation Information
R. Krishnan, V. A. Samaranayake and Jagannathan Sarangapani. "A Multi-Step Nonlinear Dimension-Reduction Approach with Applications to Bigdata" Procedia Computer Science Vol. 144 (2018) p. 81 - 88 ISSN: 1877-0509
Available at: http://works.bepress.com/jagannathan-sarangapani/198/