Multivariate statistics

Multivariate statistics or multivariate statistical analysis in statistics describes a collection of procedures which involve observation and analysis of more than one statistical variable at a time. Sometimes a distinction is made between univariate (e.g., ANOVA, t-tests) and multivariate statistics, where univariate statistics only have one dependent variable, whereas multivariate statistics have two or more dependent variables.

There are many different models, each with its own type of analysis:
 * 1) Regression analysis attempts to determine a linear formula that can describe how some variables respond to changes in others. Regression analyses are based on forms of the general linear model.
 * 2) Principal components analysis attempts to determine a smaller set of synthetic variables that could explain the original set.
 * 3) Linear discriminant analysis (LDA) computes a linear predictor from two sets of normally distributed data to allow for classification of new observations.
 * 4) Discriminant function or canonical variate analysis attempt to establish whether a set of variables can be used to distinguish between two or more groups.
 * 5) Logistic regression allows to perform a regression analysis to estimate and test the influence of covariates on a binary response.
 * 6) Multivariate analysis of variance (MANOVA) methods extend analysis of variance methods to cover cases where there is more than one dependent variable and where the dependent variables cannot simply be combined.
 * 7) Artificial neural networks extend regression methods to non-linear multivariate models.
 * 8) Multidimensional scaling covers various algorithms to determine a set of synthetic variables that best represent the pairwise distances between records.  The original method is principal coordinate analysis.
 * 9) Canonical correlation analysis tries to establish whether or not there are linear relationships among two sets of variables (covariates and response).