Education
 

Generalized mean

From Psychology Wiki

Community portal · Tasks to do · News · Help

Clinical · Educational · Ind&Org · Other fields · Professional · Transpersonal · World

Assessment | Biopsychology | Comparative | Cognitive | Developmental | Language
Personality | Philosophy | Research Methods | Social | Statistics

Statistics: Scientific method · Research methods · Experimental design · Undergraduate statistics courses · Statistical tests · Game theory · Decision theory


A generalized mean, also known as power mean or Hölder mean, is an abstraction of the Pythagorean means including arithmetic, geometric and harmonic means.

Contents

[edit] Definition

If math is a non-zero real number, we can define the generalized mean with exponent math of the positive real numbers math as

math

[edit] Properties

  • Like most means, the generalized mean is a homogeneous function of its arguments math. That is, if math is a positive real number, then the generalized mean with exponent math of the numbers math is equal to math times the generalized mean of the numbers math.
  • Like the quasi-arithmetic means, the computation of the mean can be split into computations of equal sized sub-blocks.
math

[edit] Generalized mean inequality

In general, if math, then math and the two means are equal if and only if math. This follows from the fact that math, which can be proved using Jensen's inequality.

In particular, for math, the generalized mean inequality implies the Pythagorean means inequality as well as the inequality of arithmetic and geometric means.

[edit] Special cases

File:RMS-AM-GM-HM.gif
A visual depiction of some of the specified cases for n=2.

[edit] Proof of power means inequality

[edit] Equivalence of inequalities between means of opposite signs

Suppose an average between power means with exponents p and q holds:

math

then:

math

We raise both sides to the power of -1 (strictly decreasing function in positive reals):

math

We get the inequality for means with exponents -p and -q, and we can use the same reasoning backwards, thus proving the inequalities to be equivalent, which will be used in some of the later proofs.

[edit] Geometric mean

For any q the inequality between mean with exponent q and geometric mean can be transformed in the following way:

math
math

(the first inequality is to be proven for positive q, and the latter otherwise)

We raise both sides to the power of q:

math

in both cases we get the inequality between weighted arithmetic and geometric means for the sequence math, which can be proved by Jensen's inequality, making use of the fact the logarithmic function is concave:

math
math

By applying (strictly increasing) exp function to both sides we get the inequality:

math

Thus for any positive q it is true that:

math

since the inequality holds for any q, however small, and, as will be shown later, the expressions on the left and right approximate the geometric mean better as q approaches 0, the limit of the power mean for q approaching 0 is the geometric mean:

math

[edit] Inequality between any two power means

We are to prove that for any p<q the following inequality holds:

math

if p is negative, and q is positive, the inequality is equivalent to the one proved above:

math

The proof for positive p and q is as follows: Define the following function: math math. f is a power function, so it does have a second derivative: math which is strictly positive within the domain of f, since q > p, so we know f is convex.

Using this, and the Jensen's inequality we get:

math
math

after raising both side to the power of 1/q (an increasing function, since 1/q is positive) we get the inequality which was to be proven:

math

Using the previously shown equivalence we can prove the inequality for negative p and q by substituting them with, respectively, -q and -p, QED.

[edit] Minimum and maximum

Minimum and maximum are assumed to be the power means with exponents of math. Thus for any q:

math

For maximum the proof is as follows: Assume WLoG that the sequence xi is nonincreasing and no weight is zero.

Then the inequality is equivalent to:

math

After raising both sides to the power of q we get (depending on the sign of q) one of the inequalities:

WikiTeX: latex reported a failure, namely:
This is pdfeTeX, Version 3.141592-1.21a-2.2 (Web2C 7.5.4)

entering extended mode (./691c0898b941ac711e6efc1ba0498 LaTeX2e <2003/12/01> Babel and hyphenation patterns for american, french, german, ngerman, b ahasa, basque, bulgarian, catalan, croatian, czech, danish, dutch, esperanto, e stonian, finnish, greek, icelandic, irish, italian, latin, magyar, norsk, polis h, portuges, romanian, russian, serbian, slovak, slovene, spanish, swedish, tur kish, ukrainian, nohyphenation, loaded. (/usr/share/texmf/tex/latex/base/article.cls Document Class: article 2004/02/16 v1.4f Standard LaTeX document class (/usr/share/texmf/tex/latex/base/size10.clo)) (/usr/share/texmf/tex/latex/amsfonts/amssymb.sty (/usr/share/texmf/tex/latex/amsfonts/amsfonts.sty)) (/usr/share/texmf/tex/latex/amsmath/amsmath.sty For additional information on amsmath, use the `?' option. (/usr/share/texmf/tex/latex/amsmath/amstext.sty (/usr/share/texmf/tex/latex/amsmath/amsgen.sty)) (/usr/share/texmf/tex/latex/amsmath/amsbsy.sty) (/usr/share/texmf/tex/latex/amsmath/amsopn.sty)) (/usr/share/texmf/tex/latex/amsmath/amscd.sty) (/usr/share/texmf/tex/latex/concmath/concmath.sty) (./691c0898b941ac711e6efc1ba0498.aux) (/usr/share/texmf/tex/latex/concmath/ot1ccr.fd) (/usr/share/texmf/tex/latex/concmath/omlccm.fd) (/usr/share/texmf/tex/latex/concmath/omsccsy.fd) (/usr/share/texmf/tex/latex/concmath/omxccex.fd) (/usr/share/texmf/tex/latex/amsfonts/umsa.fd) (/usr/share/texmf/tex/latex/amsfonts/umsb.fd) ! Undefined control sequence. l.5 ...{equation*}\sum_{i=1}^nw_ix_i^q\leq {\color

                                                 {red} \geq}  x_1^q\end{equ...

[1] (./691c0898b941ac711e6efc1ba0498.aux) ) (see the transcript file for additional information) Output written on 691c0898b941ac711e6efc1ba0498.dvi (1 page, 520 bytes).

Transcript written on 691c0898b941ac711e6efc1ba0498.log.

≤ for q>0, ≥ for q<0.

After subtracting math from the both sides we get:

WikiTeX: latex reported a failure, namely:
This is pdfeTeX, Version 3.141592-1.21a-2.2 (Web2C 7.5.4)

entering extended mode (./3a16fe491c658c3b25cda902e82de LaTeX2e <2003/12/01> Babel and hyphenation patterns for american, french, german, ngerman, b ahasa, basque, bulgarian, catalan, croatian, czech, danish, dutch, esperanto, e stonian, finnish, greek, icelandic, irish, italian, latin, magyar, norsk, polis h, portuges, romanian, russian, serbian, slovak, slovene, spanish, swedish, tur kish, ukrainian, nohyphenation, loaded. (/usr/share/texmf/tex/latex/base/article.cls Document Class: article 2004/02/16 v1.4f Standard LaTeX document class (/usr/share/texmf/tex/latex/base/size10.clo)) (/usr/share/texmf/tex/latex/amsfonts/amssymb.sty (/usr/share/texmf/tex/latex/amsfonts/amsfonts.sty)) (/usr/share/texmf/tex/latex/amsmath/amsmath.sty For additional information on amsmath, use the `?' option. (/usr/share/texmf/tex/latex/amsmath/amstext.sty (/usr/share/texmf/tex/latex/amsmath/amsgen.sty)) (/usr/share/texmf/tex/latex/amsmath/amsbsy.sty) (/usr/share/texmf/tex/latex/amsmath/amsopn.sty)) (/usr/share/texmf/tex/latex/amsmath/amscd.sty) (/usr/share/texmf/tex/latex/concmath/concmath.sty) (./3a16fe491c658c3b25cda902e82de.aux) (/usr/share/texmf/tex/latex/concmath/ot1ccr.fd) (/usr/share/texmf/tex/latex/concmath/omlccm.fd) (/usr/share/texmf/tex/latex/concmath/omsccsy.fd) (/usr/share/texmf/tex/latex/concmath/omxccex.fd) (/usr/share/texmf/tex/latex/amsfonts/umsa.fd) (/usr/share/texmf/tex/latex/amsfonts/umsb.fd) ! Undefined control sequence. l.5 ...{equation*}\sum_{i=2}^nw_ix_i^q\leq {\color

                                                 {red} \geq} (1-w_1)x_1^q\e...

[1] (./3a16fe491c658c3b25cda902e82de.aux) ) (see the transcript file for additional information) Output written on 3a16fe491c658c3b25cda902e82de.dvi (1 page, 588 bytes).

Transcript written on 3a16fe491c658c3b25cda902e82de.log.

After dividing by math:

WikiTeX: latex reported a failure, namely:
This is pdfeTeX, Version 3.141592-1.21a-2.2 (Web2C 7.5.4)

entering extended mode (./5705ea034427fa067d56a3daa2368 LaTeX2e <2003/12/01> Babel and hyphenation patterns for american, french, german, ngerman, b ahasa, basque, bulgarian, catalan, croatian, czech, danish, dutch, esperanto, e stonian, finnish, greek, icelandic, irish, italian, latin, magyar, norsk, polis h, portuges, romanian, russian, serbian, slovak, slovene, spanish, swedish, tur kish, ukrainian, nohyphenation, loaded. (/usr/share/texmf/tex/latex/base/article.cls Document Class: article 2004/02/16 v1.4f Standard LaTeX document class (/usr/share/texmf/tex/latex/base/size10.clo)) (/usr/share/texmf/tex/latex/amsfonts/amssymb.sty (/usr/share/texmf/tex/latex/amsfonts/amsfonts.sty)) (/usr/share/texmf/tex/latex/amsmath/amsmath.sty For additional information on amsmath, use the `?' option. (/usr/share/texmf/tex/latex/amsmath/amstext.sty (/usr/share/texmf/tex/latex/amsmath/amsgen.sty)) (/usr/share/texmf/tex/latex/amsmath/amsbsy.sty) (/usr/share/texmf/tex/latex/amsmath/amsopn.sty)) (/usr/share/texmf/tex/latex/amsmath/amscd.sty) (/usr/share/texmf/tex/latex/concmath/concmath.sty) (./5705ea034427fa067d56a3daa2368.aux) (/usr/share/texmf/tex/latex/concmath/ot1ccr.fd) (/usr/share/texmf/tex/latex/concmath/omlccm.fd) (/usr/share/texmf/tex/latex/concmath/omsccsy.fd) (/usr/share/texmf/tex/latex/concmath/omxccex.fd) (/usr/share/texmf/tex/latex/amsfonts/umsa.fd) (/usr/share/texmf/tex/latex/amsfonts/umsb.fd) ! Undefined control sequence. l.5 ...{i=2}^n\frac{w_i}{(1-w_1)}x_i^q\leq {\color

                                                 {red} \geq} x_1^q\end{equa...

[1] (./5705ea034427fa067d56a3daa2368.aux) ) (see the transcript file for additional information) Output written on 5705ea034427fa067d56a3daa2368.dvi (1 page, 624 bytes).

Transcript written on 5705ea034427fa067d56a3daa2368.log.

1 - w1 is nonzero, thus:

math

Substacting x1q leaves:

WikiTeX: latex reported a failure, namely:
This is pdfeTeX, Version 3.141592-1.21a-2.2 (Web2C 7.5.4)

entering extended mode (./b5f917efb4620cc4b70c09ff6504d LaTeX2e <2003/12/01> Babel and hyphenation patterns for american, french, german, ngerman, b ahasa, basque, bulgarian, catalan, croatian, czech, danish, dutch, esperanto, e stonian, finnish, greek, icelandic, irish, italian, latin, magyar, norsk, polis h, portuges, romanian, russian, serbian, slovak, slovene, spanish, swedish, tur kish, ukrainian, nohyphenation, loaded. (/usr/share/texmf/tex/latex/base/article.cls Document Class: article 2004/02/16 v1.4f Standard LaTeX document class (/usr/share/texmf/tex/latex/base/size10.clo)) (/usr/share/texmf/tex/latex/amsfonts/amssymb.sty (/usr/share/texmf/tex/latex/amsfonts/amsfonts.sty)) (/usr/share/texmf/tex/latex/amsmath/amsmath.sty For additional information on amsmath, use the `?' option. (/usr/share/texmf/tex/latex/amsmath/amstext.sty (/usr/share/texmf/tex/latex/amsmath/amsgen.sty)) (/usr/share/texmf/tex/latex/amsmath/amsbsy.sty) (/usr/share/texmf/tex/latex/amsmath/amsopn.sty)) (/usr/share/texmf/tex/latex/amsmath/amscd.sty) (/usr/share/texmf/tex/latex/concmath/concmath.sty) (./b5f917efb4620cc4b70c09ff6504d.aux) (/usr/share/texmf/tex/latex/concmath/ot1ccr.fd) (/usr/share/texmf/tex/latex/concmath/omlccm.fd) (/usr/share/texmf/tex/latex/concmath/omsccsy.fd) (/usr/share/texmf/tex/latex/concmath/omxccex.fd) (/usr/share/texmf/tex/latex/amsfonts/umsa.fd) (/usr/share/texmf/tex/latex/amsfonts/umsb.fd) ! Undefined control sequence. l.5 ...frac{w_i}{(1-w_1)}(x_i^q-x_1^q)\leq {\color

                                                 {red} \geq} 0\end{equation*}

[1] (./b5f917efb4620cc4b70c09ff6504d.aux) ) (see the transcript file for additional information) Output written on b5f917efb4620cc4b70c09ff6504d.dvi (1 page, 640 bytes).

Transcript written on b5f917efb4620cc4b70c09ff6504d.log.

which is obvious, since x1 is greater or equal to any xi, and thus:

WikiTeX: latex reported a failure, namely:
This is pdfeTeX, Version 3.141592-1.21a-2.2 (Web2C 7.5.4)

entering extended mode (./d437c960a633cad4ac47e495d5e21 LaTeX2e <2003/12/01> Babel and hyphenation patterns for american, french, german, ngerman, b ahasa, basque, bulgarian, catalan, croatian, czech, danish, dutch, esperanto, e stonian, finnish, greek, icelandic, irish, italian, latin, magyar, norsk, polis h, portuges, romanian, russian, serbian, slovak, slovene, spanish, swedish, tur kish, ukrainian, nohyphenation, loaded. (/usr/share/texmf/tex/latex/base/article.cls Document Class: article 2004/02/16 v1.4f Standard LaTeX document class (/usr/share/texmf/tex/latex/base/size10.clo)) (/usr/share/texmf/tex/latex/amsfonts/amssymb.sty (/usr/share/texmf/tex/latex/amsfonts/amsfonts.sty)) (/usr/share/texmf/tex/latex/amsmath/amsmath.sty For additional information on amsmath, use the `?' option. (/usr/share/texmf/tex/latex/amsmath/amstext.sty (/usr/share/texmf/tex/latex/amsmath/amsgen.sty)) (/usr/share/texmf/tex/latex/amsmath/amsbsy.sty) (/usr/share/texmf/tex/latex/amsmath/amsopn.sty)) (/usr/share/texmf/tex/latex/amsmath/amscd.sty) (/usr/share/texmf/tex/latex/concmath/concmath.sty) (./d437c960a633cad4ac47e495d5e21.aux) (/usr/share/texmf/tex/latex/concmath/ot1ccr.fd) (/usr/share/texmf/tex/latex/concmath/omlccm.fd) (/usr/share/texmf/tex/latex/concmath/omsccsy.fd) (/usr/share/texmf/tex/latex/concmath/omxccex.fd) (/usr/share/texmf/tex/latex/amsfonts/umsa.fd) (/usr/share/texmf/tex/latex/amsfonts/umsb.fd) ! Undefined control sequence. l.5 \begin{equation*}x_i^q-x_1^q\leq {\color

                                           {red} \geq} 0\end{equation*}

[1] (./d437c960a633cad4ac47e495d5e21.aux) ) (see the transcript file for additional information) Output written on d437c960a633cad4ac47e495d5e21.dvi (1 page, 464 bytes).

Transcript written on d437c960a633cad4ac47e495d5e21.log.

For minimum the proof is almost the same, only instead of x1, w1 we use xn, wn, QED.

[edit] Generalized math-mean

The power mean could be generalized further to the generalized f-mean:

math

which covers e.g. the geometric mean without using a limit. The power mean is obtained for math.

[edit] Applications

[edit] Signal processing

A power mean serves a non-linear moving average which is shifted towards small signal values for small math and emphasizes big signal values for big math. Given an efficient implementation of a moving arithmetic mean called smooth you can implement a moving power mean according to the following Haskell code.

 powerSmooth :: Floating a => ([a] -> [a]) -> a -> [a] -> [a]
 powerSmooth smooth p =
    map (** recip p) . smooth . map (**p)

[edit] See also

[edit] External links


Smallwikipedialogo.png This page uses content from the English-language version of Wikipedia. The original article was at Generalized mean. The list of authors can be seen in the page history. As with Psychology Wiki, the text of Wikipedia is available under the GNU Free Documentation License.