Determining the Number of Components in Principal Components Analysis
Dozens of different methods have been developed for selecting the number of factors; the three most common are described below.
All the methods employed are Heuristics, which is to say none can be shown to be valid and each can make sense in some circumstances. For this reason, the general advice is to use these different rules as a starting point and then select a number of components such that the resulting components seem valid (see Validating Principal Components Analysis).
Kaiser Rule
The more variables that load onto a particular component (i.e., have a high correlation with the component), the more important the factor is in summarizing the data. An eigenvalue is an index that indicates how good a component is as a summary of the data. An eigenvalue of 1.0 means that the factor contains the same amount of information as a single variable. [note 1]
The Kaiser Rule is the most commonly used approach to selecting the number of components and it is the default in most programs. It is available when using the PCA tool in Displayr (which is available under Insert > Dimension Reduction > Principal Components Analysis).
It has been criticized on the grounds that it sometimes results in the selection of too many components.[1]
Scree plot
The following scree plot shows the number of Eigenvalues from the example shown on the main principal components analysis page, ordered from biggest to smallest. Some researchers conclude that the correct number of components is the number that appear prior to the elbow (in this example, two).
You can create a scree plot in Displayr by selecting Insert > Dimension Reduction > Plot > Scree
Proportion of variance explained
It is sometimes thought that a good factor analysis should explain two-thirds of the variance. Using the example presented in the main principal components analysis page, this leads to selection of a four component solution.
Notes
References
Template:Reflist
Cite error: <ref> tags exist for a group named 'note', but no corresponding <references group='note'/> tag was found
- ↑ Nunnally, J. C. and I. H. Bernstein (1994). Psychometric Theory. New York, McGraw-Hill.