Faà di Bruno's formula

Part of a series of articles about

Definitions
Derivative (generalizations) Differential infinitesimal of a function total
Concepts
Differentiation notation Second derivative Third derivative Change of variables Implicit differentiation Related rates Taylor's theorem
Rules and identities
Sum Product Chain Power Quotient General Leibniz Faà di Bruno's formula

Integral

Definitions
Lists of integrals
Antiderivative Integral (improper) Riemann integral Lebesgue integration Contour integration
Integration by
Parts Discs Cylindrical shells Substitution (trigonometric) Partial fractions Order Reduction formulae

Series

Convergence tests
Geometric (arithmetico-geometric) Harmonic Alternating Power Binomial Taylor
Summand limit (term test) Ratio Root Integral Direct comparison Limit comparison Alternating series Cauchy condensation Dirichlet Abel

Vector

Theorems
Gradient Divergence Curl Laplacian Directional derivative Identities
Divergence Gradient Green's Kelvin–Stokes

Multivariable

Formalisms
Matrix Tensor Exterior Geometric
Definitions
Partial derivative Multiple integral Line integral Surface integral Volume integral Jacobian Hessian matrix

Specialized

Faà di Bruno's formula is an identity in mathematics generalizing the chain rule to higher derivatives, named after Francesco Faà di Bruno (1855, 1857), though he was not the first to state or prove the formula. In 1800, more than 50 years before Faà di Bruno, the French mathematician Louis François Antoine Arbogast stated the formula in a calculus textbook,^[1] considered the first published reference on the subject.^[2]

Perhaps the most well-known form of Faà di Bruno's formula says that

{d^{n} \over dx^{n}}f(g(x))=\sum {\frac {n!}{m_{1}!\,1!^{m_{1}}\,m_{2}!\,2!^{m_{2}}\,\cdots \,m_{n}!\,n!^{m_{n}}}}\cdot f^{(m_{1}+\cdots +m_{n})}(g(x))\cdot \prod _{j=1}^{n}\left(g^{(j)}(x)\right)^{m_{j}},

where the sum is over all n-tuples of nonnegative integers (m₁, …, m_n) satisfying the constraint

1\cdot m_{1}+2\cdot m_{2}+3\cdot m_{3}+\cdots +n\cdot m_{n}=n.\,

Sometimes, to give it a memorable pattern, it is written in a way in which the coefficients that have the combinatorial interpretation discussed below are less explicit:

{d^{n} \over dx^{n}}f(g(x))=\sum {\frac {n!}{m_{1}!\,m_{2}!\,\cdots \,m_{n}!}}\cdot f^{(m_{1}+\cdots +m_{n})}(g(x))\cdot \prod _{j=1}^{n}\left({\frac {g^{(j)}(x)}{j!}}\right)^{m_{j}}.

Combining the terms with the same value of m₁ + m₂ + ... + m_n = k and noticing that m_j has to be zero for j > n − k + 1 leads to a somewhat simpler formula expressed in terms of Bell polynomials B_n,k(x₁,...,x_n−k+1):

{d^n \over dx^n} f(g(x)) = \sum_{k=1}^n f^{(k)}(g(x))\cdot B_{n,k}\left(g'(x),g''(x),\dots,g^{(n-k+1)}(x)\right).

Combinatorial form

The formula has a "combinatorial" form:

{d^{n} \over dx^{n}}f(g(x))=(f\circ g)^{(n)}(x)=\sum _{\pi \in \Pi }f^{(\left|\pi \right|)}(g(x))\cdot \prod _{B\in \pi }g^{(\left|B\right|)}(x)

where

$π$ runs through the set Π of all partitions of the set { 1, ..., n },
"B ∈ $π$ " means the variable B runs through the list of all of the "blocks" of the partition $π$ , and
|A| denotes the cardinality of the set A (so that | $π$ | is the number of blocks in the partition $π$ and |B| is the size of the block B).

Explanation via an example

The combinatorial form may initially seem forbidding, so let us examine a concrete case, and see what the pattern is:

{\begin{aligned}(f\circ g)''''(x)&=f''''(g(x))g'(x)^{4}+6f'''(g(x))g''(x)g'(x)^{2}\\[8pt]&{}\quad +\;3f''(g(x))g''(x)^{2}+4f''(g(x))g'''(x)g'(x)\\[8pt]&{}\quad +\;f'(g(x))g''''(x).\end{aligned}}

The pattern is

{\begin{aligned}g'(x)^{4}&&\leftrightarrow &&1+1+1+1&&\leftrightarrow &&f''''(g(x))&&\leftrightarrow &&1\\[12pt]g''(x)g'(x)^{2}&&\leftrightarrow &&2+1+1&&\leftrightarrow &&f'''(g(x))&&\leftrightarrow &&6\\[12pt]g''(x)^{2}&&\leftrightarrow &&2+2&&\leftrightarrow &&f''(g(x))&&\leftrightarrow &&3\\[12pt]g'''(x)g'(x)&&\leftrightarrow &&3+1&&\leftrightarrow &&f''(g(x))&&\leftrightarrow &&4\\[12pt]g''''(x)&&\leftrightarrow &&4&&\leftrightarrow &&f'(g(x))&&\leftrightarrow &&1.\end{aligned}}

The factor $\scriptstyle g''(x)g'(x)^{2}\;$ corresponds to the partition 2 + 1 + 1 of the integer 4, in the obvious way. The factor $\scriptstyle f'''(g(x))\;$ that goes with it corresponds to the fact that there are three summands in that partition. The coefficient 6 that goes with those factors corresponds to the fact that there are exactly six partitions of a set of four members that break it into one part of size 2 and two parts of size 1.

Similarly, the factor $\scriptstyle g''(x)^{2}\;$ in the third line corresponds to the partition 2 + 2 of the integer 4, (4, because we are finding the fourth derivative), while $\scriptstyle f''(g(x))\,\!$ corresponds to the fact that there are two summands (2 + 2) in that partition. The coefficient 3 corresponds to the fact that there are ${\tfrac {1}{2}}{\tbinom {4}{2}}=3$ ways of partitioning 4 objects into groups of 2. The same concept applies to the others.

A memorizable scheme is as follows:

{\begin{aligned}&{\frac {D^{1}(f\circ {}g)}{1!}}&=\left(f^{(1)}\circ {}g\right){\frac {\frac {g^{(1)}}{1!}}{1!}}\\[8pt]&{\frac {D^{2}(f\circ g)}{2!}}&=\left(f^{(1)}\circ {}g\right){\frac {\frac {g^{(2)}}{2!}}{1!}}&{}+\left(f^{(2)}\circ {}g\right){\frac {{\frac {g^{(1)}}{1!}}{\frac {g^{(1)}}{1!}}}{2!}}\\[8pt]&{\frac {D^{3}(f\circ g)}{3!}}&=\left(f^{(1)}\circ {}g\right){\frac {\frac {g^{(3)}}{3!}}{1!}}&{}+\left(f^{(2)}\circ {}g\right){\frac {\frac {g^{(1)}}{1!}}{1!}}{\frac {\frac {g^{(2)}}{2!}}{1!}}&{}+\left(f^{(3)}\circ {}g\right){\frac {{\frac {g^{(1)}}{1!}}{\frac {g^{(1)}}{1!}}{\frac {g^{(1)}}{1!}}}{3!}}\\[8pt]&{\frac {D^{4}(f\circ g)}{4!}}&=\left(f^{(1)}\circ {}g\right){\frac {\frac {g^{(4)}}{4!}}{1!}}&{}+\left(f^{(2)}\circ {}g\right)\left({\frac {\frac {g^{(1)}}{1!}}{1!}}{\frac {\frac {g^{(3)}}{3!}}{1!}}+{\frac {{\frac {g^{(2)}}{2!}}{\frac {g^{(2)}}{2!}}}{2!}}\right)&{}+\left(f^{(3)}\circ {}g\right){\frac {{\frac {g^{(1)}}{1!}}{\frac {g^{(1)}}{1!}}}{2!}}{\frac {\frac {g^{(2)}}{2!}}{1!}}&{}+\left(f^{(4)}\circ {}g\right){\frac {{\frac {g^{(1)}}{1!}}{\frac {g^{(1)}}{1!}}{\frac {g^{(1)}}{1!}}{\frac {g^{(1)}}{1!}}}{4!}}\end{aligned}}

Combinatorics of the Faà di Bruno coefficients

These partition-counting Faà di Bruno coefficients have a "closed-form" expression. The number of partitions of a set of size n corresponding to the integer partition

\displaystyle n=\underbrace {1+\cdots +1} _{m_{1}}\,+\,\underbrace {2+\cdots +2} _{m_{2}}\,+\,\underbrace {3+\cdots +3} _{m_{3}}+\cdots

of the integer n is equal to

{\frac {n!}{m_{1}!\,m_{2}!\,m_{3}!\,\cdots 1!^{m_{1}}\,2!^{m_{2}}\,3!^{m_{3}}\,\cdots }}.

These coefficients also arise in the Bell polynomials, which are relevant to the study of cumulants.

Variations

Multivariate version

Let y = g(x₁, ..., x_n). Then the following identity holds regardless of whether the n variables are all distinct, or all identical, or partitioned into several distinguishable classes of indistinguishable variables (if it seems opaque, see the very concrete example below):^[3]

{\partial ^{n} \over \partial x_{1}\cdots \partial x_{n}}f(y)=\sum _{\pi \in \Pi }f^{(\left|\pi \right|)}(y)\cdot \prod _{B\in \pi }{\partial ^{\left|B\right|}y \over \prod _{j\in B}\partial x_{j}}

where (as above)

$π$ runs through the set Π of all partitions of the set { 1, ..., n },
"B ∈ $π$ " means the variable B runs through the list of all of the "blocks" of the partition $π$ , and
|A| denotes the cardinality of the set A (so that | $π$ | is the number of blocks in the partition $π$ and |B| is the size of the block B).

More general versions hold for cases where the all functions are vector- and even Banach-space-valued. In this case one needs to consider the Frechét-differential or Gateaux-differential.

Example

The five terms in the following expression correspond in the obvious way to the five partitions of the set { 1, 2, 3 }, and in each case the order of the derivative of f is the number of parts in the partition:

{\begin{aligned}{\partial ^{3} \over \partial x_{1}\,\partial x_{2}\,\partial x_{3}}f(y)={}&f'(y){\partial ^{3}y \over \partial x_{1}\,\partial x_{2}\,\partial x_{3}}\\[10pt]&{}+f''(y)\left({\partial y \over \partial x_{1}}\cdot {\partial ^{2}y \over \partial x_{2}\,\partial x_{3}}+{\partial y \over \partial x_{2}}\cdot {\partial ^{2}y \over \partial x_{1}\,\partial x_{3}}+{\partial y \over \partial x_{3}}\cdot {\partial ^{2}y \over \partial x_{1}\,\partial x_{2}}\right)\\[10pt]&{}+f'''(y){\partial y \over \partial x_{1}}\cdot {\partial y \over \partial x_{2}}\cdot {\partial y \over \partial x_{3}}.\end{aligned}}

If the three variables are indistinguishable from each other, then three of the five terms above are also indistinguishable from each other, and then we have the classic one-variable formula.

Formal power series version

Suppose $f(x)=\sum _{n=0}^{\infty }{a_{n}}x^{n}$ and $g(x)=\sum _{n=0}^{\infty }{b_{n}}x^{n}$ are formal power series and $b_{0}=0$ .

Then the composition $f\circ g$ is again a formal power series,

f(g(x))=\sum _{n=0}^{\infty }{c_{n}}x^{n},

where c₀ = a₀ and the other coefficient c_n for n ≥ 1 can be expressed as a sum over compositions of n or as an equivalent sum over partitions of n:

c_{n}=\sum _{\mathbf {i} \in {\mathcal {C}}_{n}}a_{k}b_{i_{1}}b_{i_{2}}\cdots b_{i_{k}},

where

{\mathcal {C}}_{n}=\{(i_{1},i_{2},\dots ,i_{k})\,:\ 1\leq k\leq n,\ i_{1}+i_{2}+\cdots +i_{k}=n\}

is the set of compositions of n with k denoting the number of parts,

c_{n}=\sum _{k=1}^{n}a_{k}\sum _{\mathbf {\pi } \in {\mathcal {P}}_{n,k}}{\binom {k}{\pi _{1},\pi _{2},...,\pi _{n}}}b_{1}^{\pi _{1}}b_{2}^{\pi _{2}}\cdots b_{n}^{\pi _{n}},

where

{\mathcal {P}}_{n,k}=\{(\pi _{1},\pi _{2},\dots ,\pi _{n})\,:\ \pi _{1}+\pi _{2}+\cdots +\pi _{n}=k,\ \pi _{1}\cdot 1+\pi _{2}\cdot 2+\cdots +\pi _{n}\cdot n=n\}

is the set of partitions of n into k parts, in frequency-of-parts form.

The first form is obtained by picking out the coefficient of xⁿ in $(b_{1}x+b_{2}x^{2}+\cdots )^{k}$ "by inspection", and the second form is then obtained by collecting like terms, or alternatively, by applying the multinomial theorem.

The special case f(x) = e^x, g(x) = ∑_{n ≥ 1} a_n/n! xⁿ gives the exponential formula. The special case f(x) = 1/(1 − x), g(x) = ∑_{n ≥ 1} (−a_n) xⁿ gives an expression for the reciprocal of the formal power series ∑_{n ≥ 0} a_n xⁿ in the case a₀ = 1.

Stanley ^[4] gives a version for exponential power series. In the formal power series

f(x)=\sum _{n}{a_{n} \over n!}x^{n},

we have the nth derivative at 0:

f^{(n)}(0)=a_{n}.\;

This should not be construed as the value of a function, since these series are purely formal; there is no such thing as convergence or divergence in this context.

g(x)=\sum _{n=0}^{\infty }{b_{n} \over n!}x^{n}

and

f(x)=\sum _{n=1}^{\infty }{a_{n} \over n!}x^{n}

and

g(f(x))=h(x)=\sum _{n=0}^{\infty }{c_{n} \over n!}x^{n},

then the coefficient c_n (which would be the nth derivative of h evaluated at 0 if we were dealing with convergent series rather than formal power series) is given by

c_{n}=\sum _{\pi =\left\{\,B_{1},\,\dots ,\,B_{k}\,\right\}}a_{\left|B_{1}\right|}\cdots a_{\left|B_{k}\right|}b_{k}

where $π$ runs through the set of all partitions of the set { 1, ..., n } and B₁, ..., B_k are the blocks of the partition $π$ , and | B_j | is the number of members of the jth block, for j = 1, ..., k.

This version of the formula is particularly well suited to the purposes of combinatorics.

We can also write with respect to the notation above

g(f(x))=b_{0}+\sum _{n=1}^{\infty }{\sum _{k=1}^{n}b_{k}B_{n,k}(a_{1},\dots ,a_{n-k+1}) \over n!}x^{n},

where B_n,k(a₁,...,a_n−k+1) are Bell polynomials.

A special case

If f(x) = e^x then all of the derivatives of f are the same, and are a factor common to every term. In case g(x) is a cumulant-generating function, then f(g(x)) is a moment-generating function, and the polynomial in various derivatives of g is the polynomial that expresses the moments as functions of the cumulants.

Notes

↑ Arbogast, L.F.A. (1800). Du calcul des derivations. Strasbourg: Levrault.
↑ Craik, A.D.D. (2005). "Prehistory of Faà di Bruno's Formula". American Mathematical Monthly. Mathematical Association of America. 112 (2): 217–234. doi:10.2307/30037410. JSTOR 30037410.
↑ Hardy, Michael (2006). "Combinatorics of Partial Derivatives". Electronic Journal of Combinatorics. 13 (1): R1.
↑ See the "compositional formula" in Chapter 5 of Stanley, Richard P. (1999) [1997]. Enumerative Combinatorics. Cambridge University Press. ISBN 0-521-55309-1.

References

Historical surveys and essays

Brigaglia, Aldo (2004), "L'Opera Matematica", in Giacardi, Livia, Francesco Faà di Bruno. Ricerca scientifica insegnamento e divulgazione, Studi e fonti per la storia dell'Università di Torino (in Italian), XII, Torino: Deputazione Subalpina di Storia Patria, pp. 111–172 . "The mathematical work" is an essay on the mathematical activity, describing both his research and teaching, of Francesco Faà di Bruno.
Craik, Alex D. D. (February 2005), "Prehistory of Faà di Bruno's Formula", American Mathematical Monthly, 112 (2): 217–234, doi:10.2307/30037410, JSTOR 30037410, MR 2121322, Zbl 1088.01008 .
Johnson, Warren P. (March 2002), "The Curious History of Faà di Bruno's Formula" (PDF), American Mathematical Monthly, 109 (3): 217–234, doi:10.2307/2695352, JSTOR 2695352, MR 1903577, Zbl 1024.01010 .

Research works

Arbogast, L. F. A. (1800), Du calcul des derivations (in French), Strasbourg: Levrault, pp. xxiii+404 , Entirely freely available from Google books.
Faà di Bruno, F. (1855), "Sullo sviluppo delle funzioni" [On the development of the functions], Annali di Scienze Matematiche e Fisiche (in Italian), 6: 479–480, LCCN 06036680 . Entirely freely available from Google books. A well-known paper where Francesco Faà di Bruno presents the two versions of the formula that now bears his name, published in the journal founded by Barnaba Tortolini.
Faà di Bruno, F. (1857), "Note sur une nouvelle formule de calcul differentiel", The Quarterly Journal of Pure and Applied Mathematics (in French), 1: 359–360 . Entirely freely available from Google books.
Faà di Bruno, Francesco (1859), Théorie générale de l'élimination (in French), Paris: Leiber et Faraguet, pp. x+224 . Entirely freely available from Google books.
Fraenkel, L. E. (1978), "Formulae for high derivatives of composite functions", Mathematical Proceedings of the Cambridge Philosophical Society, 83 (2): 159–165, doi:10.1017/S0305004100054402, MR 0486377, Zbl 0388.46032

Krantz, Steven G.; Parks, Harold R. (2002), A Primer of Real Analytic Functions, Birkhäuser Advanced Texts - Basler Lehrbücher (Second ed.), Boston: Birkhäuser Verlag, pp. xiv+205, ISBN 0-8176-4264-1, MR 1916029, Zbl 1015.26030
Porteous, Ian R. (2001), "Paragraph 4.3: Faà di Bruno's formula", Geometric Differentiation (Second ed.), Cambridge: Cambridge University Press, pp. 83–85, ISBN 0-521-00264-8, MR 1871900, Zbl 1013.53001 .
T. A., (Tiburce Abadie, J. F. C.) (1850), "Sur la différentiation des fonctions de fonctions", Nouvelles annales de mathématiques, journal des candidats aux écoles polytechnique et normale, Série 1, (in French), 9: 119–125 , available at NUMDAM. This paper, according to Johnson (2002, p. 228) is one of the precursors of Faà di Bruno 1855: note that the author signs only as "T.A.", and the attribution to J. F. C. Tiburce Abadie is due again to Johnson.
A., (Tiburce Abadie, J. F. C.) (1852), "Sur la différentiation des fonctions de fonctions. Séries de Burmann, de Lagrange, de Wronski", Nouvelles annales de mathématiques, journal des candidats aux écoles polytechnique et normale, Série 1, (in French), 11: 376–383 , available at NUMDAM. This paper, according to Johnson (2002, p. 228) is one of the precursors of Faà di Bruno 1855: note that the author signs only as "A.", and the attribution to J. F. C. Tiburce Abadie is due again to Johnson.

External links

Weisstein, Eric W. "Faa di Bruno's Formula". MathWorld.

An intuitive presentation of Faà di Bruno's formula, with examples

This article is issued from Wikipedia - version of the 11/28/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.