Quantile

Quantiles are essentially points taken at regular intervals from the cumulative distribution function of a random variable. Dividing ordered data into q essentially equal-sized data subsets is the motivation for q-quantiles; the quantiles are the data values marking the boundaries between consecutive subsets. Put another way, the kth quantile is the value x such that the probability that a random variable will be less than x is about k/q. There are q &minus; 1 quantiles, with k an integer satisfying 0 < k < q.

Some quantiles have special names:
 * The 100-quantiles are called percentiles.
 * The 10-quantiles are called deciles.
 * The 5-quantiles are call quintiles.
 * The 4-quantiles are called quartiles.

Some software programs regard the minimum and maximum as the 0th and 100th percentile, respectively; however, such terminology is an extension beyond traditional statistics definitions. For an infinite population, the kth quantile is the data value where the cumulative distribution function is equal to k/q. For a finite N sample size, calculate $$N\cdot k/q$$--if this is not an integer, then only use the integer part via the Floor function to get the appropriate sample number (assuming samples ordered by increasing value, with the first sample having a sample number of zero.); if it is not an integer it is conventional to take the weighted average of the two sample values (see Calculating the quantiles ).

More formally: the kth quantile $$x_{N\cdot k/q}$$ of the population parameter X can be defined such that:


 * $$P(X\le x_{N\cdot p})\ge p\mbox{ and }P(X\ge x_{N\cdot p})\ge 1-p$$ where $$p=\frac{k}{q}$$

If instead of taking k and q as integers, the k-quantile is based on a real number k with 0<k<1 then this becomes: the k-quantile of the distribution of a random variable X can be defined as the value(s) x such that:


 * $$P(X\leq x)\geq k \ \mathrm{and} \ P(X\geq x)\geq 1-k.$$

Standardized test results are commonly misinterpreted as a student scoring "in the 80th percentile", for example, as if the 80th percentile is an interval to score "in", which it is not; one can score "at" some percentile or between two percentiles, but not "in" some percentile.

Quantiles are useful measures because they are less susceptible to long tailed distributions and outliers. For instance, with a random variable that has an exponential distribution, any particular sample of this random variable will have roughly a 63% chance of being less than the mean. This is because the exponential distribution has a long tail for positive values, but is zero for negative numbers.

Empirically, if the data you are analyzing are not actually distributed according to your assumed distribution, or if you have other potential sources for outliers that are far removed from the mean, then quantiles may be more useful descriptive statistics than means and other moment related statistics.

Closely related is the subject of robust regression in which the sum of the absolute value of the observed errors is used in place of the squared error. The connection is that the mean is the single estimate of a distribution that minimizes expected squared error while the median minimizes expected absolute error. Robust regression shares the ability to be relatively insensitive to large deviations in outlying observations.

The quantiles of a random variable are generally preserved under increasing transformations, in the sense that for example if m is the median of a random variable X then 2m is the median of 2X, unless an arbitrary choice has been made from a range of values to specify a particular quantile. Quantiles can also be used in cases where only ordinal data is available.

Calculating the quantiles
There are several methods for calculating the quantiles:

Let N be the number of nonmissing values of the sample population, and let $$x_0,x_1,\ldots,x_{N-1}$$ represent the ordered values of the sample population such that $$x_0$$ is the smallest value, etc. For the kth quantile between 0 and N, let $$p = k/q$$. Then define $$j$$ as the integer part of $$N\cdot p$$ and $$g$$ as the fractional part.


 * Weighted average : $$x_{N\cdot p}=x_j+g\cdot(x_{j+1}-x_j)$$
 * Empirical distribution function : $$x_{N\cdot p}=\begin{cases}x_j, & g=0\\ x_{j+1}, & g>0\end{cases}$$
 * Empirical distribution function with averaging : $$x_{N\cdot p}=\begin{cases}\frac{1}{2}(x_j+x_{j+1}), & g=0\\ x_{j+1}, & g>0\end{cases}$$
 * Sample number closest to $$N\cdot p$$ : $$x_{N\cdot p}=\begin{cases}x_j, & g<.5\\ x_{j+1}, & g\ge .5\end{cases}$$