First-order Second-moment Method

In probability theory, the first-order second-moment (FOSM) method, also referenced as mean value first-order second-moment (MVFOSM) method, is a probabilistic method to determine the stochastic moments of a function with random input variables. The name is based on the derivation, which uses a ''first-order'' Taylor series and the first and ''second moments'' of the input variables.

Approximation

Consider the objective function $g(x)$, where the input vector $x$ is a realization of the random vector $X$ with probability density function $f_X(x)$. Because $X$ is randomly distributed, $g$ is also randomly distributed.
Following the FOSM method, the mean value of $g$ is approximated by

:$\mu_g \approx g(\mu)$

The variance of $g$ is approximated by

:$\sigma^2_g \approx \sum_^n \sum_^n \frac \frac \operatorname\left(X_i, X_j\right)$

where $n$ is the length/dimension of $x$ and $\frac$ is the partial derivative of $g$ at the mean vector $\mu$ with respect to the ''i''-th entry of $x$. More accurate, second-order second-moment approximations are also available

Derivation

The objective function is approximated by a Taylor series at the mean vector $\mu$.

:$g(x) = g(\mu) + \sum_^n \frac (x_i - \mu _i) + \frac \sum_^n \sum_^n \frac (x_i - \mu _i)(x_j - \mu _j) + \cdots$

The mean value of $g$ is given by the integral
:\mu_g = E g(x)= \int_^\infty g(x) f_X(x)\, dx

Inserting the first-order Taylor series yields
:\begin

\mu_g & \approx \int_^\infty \left g(\mu) + \sum_^n \frac (x_i - \mu_i) \rightf_X(x) \, dx \\

& = \int_^\infty g(\mu) f_X(x) \, dx + \int_^\infty \sum_^n \frac (x_i - \mu_i) f_X(x) \, dx \\

& = g(\mu) \underbrace_1
+ \sum_^n \frac \underbrace_0 \\

& = g(\mu).

\end

The variance of $g$ is given by the integral
:
\sigma_g^2 = E\left( (x) - \mu_g2\right) = \int_^\infty (x) - \mu_g2 f_X(x) \, dx.

According to the computational formula for the variance, this can be written as
:
\sigma _g^2
= E\left( (x) - \mu_g2\right) = E\left(g(x)^2\right) - \mu_g^2
= \int_^\infty g(x)^2 f_X(x) \, dx - \mu_g^2

Inserting the Taylor series yields
:\begin
\sigma_g^2 & \approx \int_^\infty \left g(\mu) + \sum_^n \frac (x_i - \mu _i) \right2 f_X (x) \, dx - \mu _g^2 \\
& = \int_^\infty \left\ f_X (x) \, dx - \mu _g^2 \\
& = \int_^\infty g(\mu)^2 f_X (x) \, dx + \int_^\infty 2\,g_\mu \sum_^n \frac (x_i - \mu _i) f_X (x) \,dx \\
& \quad + \int_^\infty \left sum_^n \frac (x_i - \mu_i) \right2 f_X (x) \, dx - \mu _g^2 \\
& = g_\mu^2 \underbrace_1 + 2 g_\mu \sum_^n \frac \underbrace_0 \\
& \quad + \int_^\infty \left \sum_^n \sum_^n \frac \frac (x_i - \mu _i)(x_j - \mu_j) \rightf_X (x) \, dx - \mu_g^2 \\
& = \underbrace_ + \sum_^n \sum_^n \frac \frac \underbrace_ - \mu_g^2 \\
& = \sum_^n \sum_^n \frac \frac \operatorname\left(X_i, X_j\right).
\end

Higher-order approaches

The following abbreviations are introduced.

:\begin
g_\mu &= g(\mu), &
g_ &= \frac, &
g_ &= \frac, &
\mu _ &= E\left (x_i - \mu _i)^j \right\end

In the following, the entries of the random vector $X$ are assumed to be independent.
Considering also the second-order terms of the Taylor expansion, the approximation of the mean value is given by
:$\mu _g \approx g_\mu + \frac\sum_^n g_ \;\mu _$

The second-order approximation of the variance is given by
:$\begin \sigma _g^2 \approx g_\mu^2 &+ \sum_^n g_^2 \,\mu _ + \frac\sum_^n g_^2 \,\mu _ + g_\mu \sum_^n g_ \,\mu _ + \sum_^n g_ \,g_ \,\mu _ \\ &+ \frac\sum_^n \sum_^n g_ \,g_ \,\mu _ \,\mu _ + \sum_^n \sum_^n g_^2 \,\mu _ \,\mu _ - \mu _g^2 \end$

The skewness of $g$ can be determined from the third central moment $\mu_$. When considering only linear terms of the Taylor series, but higher-order moments, the third central moment is approximated by
:$\mu _ \approx \sum_^n g_^3 \;\mu _$

For the second-order approximations of the third central moment as well as for the derivation of all higher-order approximations see Appendix D of Ref.B. Kriegesmann, "Probabilistic Design of Thin-Walled Fiber Composite Structures", Mitteilungen des Instituts für Statik und Dynamik der Leibniz Universität Hannover 15/2012, , Gottfried Wilhelm Leibniz Universität Hannover, Hannover, Germany, 2012
PDF; 10,2MB
Taking into account the quadratic terms of the Taylor series and the third moments of the input variables is referred to as second-order third-moment method. However, the full second-order approach of the variance (given above) also includes fourth-order moments of input parameters,Mallor C, Calvo S, Núñez JL, Rodríguez-Barrachina R, Landaberea A. "Full second-order approach for expected value and variance prediction of probabilistic fatigue crack growth life." International Journal of Fatigue 2020;133:105454. https://doi.org/10.1016/j.ijfatigue.2019.105454. the full second-order approach of the skewness 6th-order moments,Mallor C, Calvo S, Núñez JL, Rodríguez-Barrachina R, Landaberea A. "Uncertainty propagation using the full second-order approach for probabilistic fatigue crack growth life." International Journal of Numerical Methods for Calculation and Design in Engineering (RIMNI) 2020:11. https://doi.org/10.23967/j.rimni.2020.07.004. and the full second-order approach of the kurtosis up to 8th-order moments.

Practical application

There are several examples in the literature where the FOSM method is employed to estimate the stochastic distribution of the buckling load of axially compressed structures (see e.g. Ref.B. Kriegesmann, R. Rolfes, C. Hühne, and A. Kling, "Fast Probabilistic Design Procedure for Axially Compressed Composite Cylinders", Compos. Struct., 93, pp 3140–3149, 2011.). For structures which are very sensitive to deviations from the ideal structure (like cylindrical shells) it has been proposed to use the FOSM method as a design approach. Often the applicability is checked by comparison with a Monte Carlo simulation. Two comprehensive application examples of the full second-order method specifically oriented towards the fatigue crack growth in a metal railway axle are discussed and checked by comparison with a Monte Carlo simulation in Ref.

In engineering practice, the objective function often is not given as analytic expression, but for instance as a result of a finite-element simulation. Then the derivatives of the objective function need to be estimated by the central differences method. The number of evaluations of the objective function equals $2 n + 1$. Depending on the number of random variables this still can mean a significantly smaller number of evaluations than performing a Monte Carlo simulation. However, when using the FOSM method as a design procedure, a lower bound shall be estimated, which is actually not given by the FOSM approach. Therefore, a type of distribution needs to be assumed for the distribution of the objective function, taking into account the approximated mean value and standard deviation.

References

{{Reflist

Probabilistic models
Randomized algorithms