With the rapid development in technology, large amounts of high-dimensional data have been generated. This high dimensionality including redundancy and irrelevancy poses a great challenge in data analysis and decision making. Feature selection (FS) is an effective way to reduce dimensionality by eliminating redundant and irrelevant data. Most traditional FS approaches score and rank each feature individually; and then perform FS either by eliminating lower ranked features or by retaining highly-ranked features. In this review, we discuss an emerging approach to FS that is based on initially grouping features, then scoring groups of features rather than scoring individual features. Despite the presence of reviews on clustering and FS algorithms, to the best of our knowledge, this is the first review focusing on FS techniques based on grouping. The typical idea behind FS through grouping is to generate groups of similar features with dissimilarity between groups, then select representative features from each cluster. Approaches under supervised, unsupervised, semi supervised and integrative frameworks are explored. The comparison of experimental results indicates the effectiveness of sequential, optimization-based (i.e., fuzzy or evolutionary), hybrid and multi-method approaches. When it comes to biological data, the involvement of external biological sources can improve analysis results. We hope this work’s findings can guide effective design of new FS approaches using feature grouping.
Frontiers A Review of Feature Selection Methods for Machine
Systematic review - Wikipedia
Comparison of the number of selected features on twelve datasets
Relevance, redundancy, and complementarity trade-off (RRCT): A principled, generic, robust feature-selection tool. - Abstract - Europe PMC
Mean subset size for the eight feature selection methods.
GediNET for discovering gene associations across diseases using knowledge based machine learning approach. - Abstract - Europe PMC
A novel incomplete hesitant fuzzy information supplement and clustering method for large-scale group decision-making [PeerJ]
Wrapper approaches for feature selection. (A) Sequential Forward
LASSO - Definition, Estimation, Uses and Geometry
Prediction performance using SVM after feature selection. Panels a and
miRGediNET: A comprehensive examination of common genes in miRNA-Target interactions and disease associations: Insights from a grouping-scoring-modeling approach - ScienceDirect
PDF) A Review on Feature Extraction and Feature Selection for
The general mechanism of our proposed WGGA feature selection algorithm
Design of feature selection algorithm for high-dimensional network data based on supervised discriminant projection [PeerJ]
Mean accuracy of KNN with the 8 feature selection methods.