# Dimensionality Reduction

### 1 minute read

The machine learning community has experimented with various “pre-processing” steps before performing any analysis on data. Two natural techniques (assuming that the data is “clean” and “usable by a program”) are (i) Blowing up the dimensionality of data and (ii) reducing the dimension of the data. Both these approaches are known to perform exceptionally well in certain circumstances. For example, what Support Vector Machines essentially do is blow up the dimensionality of the data (and if the kernel used is a Gaussian kernel, the dimension is actually increased to infinity!) followed by learning a decition boundary in the “lifted space” whereas, for example in the k Nearest Neighbour problem, in most applications the first step involves a dimensionality reduction. In this article I will explain some of the intuition of two very popular methods for dimensionality reduction: Principal Components’ Analysis and Random Projections.