See also Factoring.
Matrices, just as number and expressions, can be decomposed into their most elementary components. Matrix factorization – or decomposition – is the process of finding such elementary components. There are several techniques of matrix factorization, each aiming at a specific problem.
One could use SVD (Singular Value Decomposition) to decompose a matrix and find latent features, for example.