CNN feature extraction

The most common linear methods for feature extraction are Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA) . PCA uses an orthogonal transformation to convert data into a lower-dimensional space while maximizing the variance of the data.

Automated feature extraction methods Autoencoders, wavelet scattering, and deep neural networks are commonly used to extract features and reduce dimensionality of the data.

CNN provides better image recognition when its neural network feature extraction becomes deeper (contains more layers), at the cost of the learning method complexities that had made CNN inefficient and neglected for some time.

Feature Selection: Select a subset of input features from the dataset.