Education
 

Multinomial distribution

From Psychology Wiki

Community portal · Tasks to do · News · Help

Clinical · Educational · Ind&Org · Other fields · Professional · Transpersonal · World

Assessment | Biopsychology | Comparative | Cognitive | Developmental | Language
Personality | Philosophy | Research Methods | Social | Statistics

Statistics: Scientific method · Research methods · Experimental design · Undergraduate statistics courses · Statistical tests · Game theory · Decision theory


In probability theory, the multinomial distribution is a generalization of the binomial distribution. The binomial distribution is the probability distribution of the number of "successes" in n independent Bernoulli trials, with the same probability of "success" on each trial. Instead of each trial resulting in "success" or "failure", imagine that each trial results in one of some fixed finite number k of possible outcomes, with probabilities p1, ..., pk, and there are n independent trials. In effect, it is the probability distribution of a random vector

math

satisfying the constraint

math

The probabilities are given by

math

for non-negative integers x1, ..., xk, if

math

and 0 otherwise.

Each of the k components separately has a binomial distribution with parameters n and pi, for the appropriate value of the subscript i, and, because of the constraint that the sum of the components is n, they are negatively correlated.

The expected value is

math

The covariance matrix is as follows. Each diagonal entry is the variance of a binomially distributed random variable, and is therefore

math

The off-diagonal entries are the covariances. These are

math

for i, j distinct. This is a k × k nonnegative-definite matrix of rank k − 1.

The Dirichlet distribution is the conjugate prior of the multinomial in Bayesian statistics.

[edit] See also

Smallwikipedialogo.png This page uses content from the English-language version of Wikipedia. The original article was at Multinomial distribution. The list of authors can be seen in the page history. As with Psychology Wiki, the text of Wikipedia is available under the GNU Free Documentation License.