Lorenz system

The Lorenz system is a system of ordinary differential equations first studied by mathematician and meteorologist Edward Lorenz. It is notable for having chaotic solutions for certain parameter values and initial conditions. In particular, the Lorenz attractor is a set of chaotic solutions of the Lorenz system. The term "butterfly effect" in popular media may stem from the real-world implications of the Lorenz attractor, namely that tiny changes in initial conditions evolve to completely different trajectories. This underscores that chaotic systems can be completely deterministic and yet still be inherently impractical or even impossible to predict over longer periods of time. For example, even the small flap of a butterfly's wings could set the earth's atmosphere on a vastly different trajectory, in which for example a hurricane occurs where it otherwise would have not (see Saddle points). The shape of the Lorenz attractor itself, when plotted in phase space, may also be seen to resemble a butterfly.

Overview

In 1963, Edward Lorenz, with the help of Ellen Fetter, who was responsible for the numerical simulations and figures, and Margaret Hamilton, who helped in the initial, numerical computations leading up to the findings of the Lorenz model, developed a simplified mathematical model for atmospheric convection. The model is a system of three ordinary differential equations now known as the Lorenz equations:

: \begin
\frac &= \sigma (y - x), \\ pt\frac &= x (\rho - z) - y, \\ pt\frac &= x y - \beta z.
\end

The equations relate the properties of a two-dimensional fluid layer uniformly warmed from below and cooled from above. In particular, the equations describe the rate of change of three quantities with respect to time: is proportional to the rate of convection, to the horizontal temperature variation, and to the vertical temperature variation. The constants , , and are system parameters proportional to the Prandtl number, Rayleigh number, and certain physical dimensions of the layer itself.

The Lorenz equations can arise in simplified models for lasers, dynamos, thermosyphons, brushless DC motors, electric circuits, chemical reactions and forward osmosis. Interestingly, the same Lorenz equations were also derived in 1963 by Sauermann and Haken for a single-mode laser. In 1975, Haken realized that their equations derived in 1963 were mathematically equivalent to the original Lorenz equations. Haken's paper thus started a new field called laser chaos or optical chaos. The Lorenz equations are often called Lorenz-Haken equations in optical literature. Later on, it was also shown the complex version of Lorenz equations also had laser equivalent ones.
The Lorenz equations are also the governing equations in Fourier space for the Malkus waterwheel. The Malkus waterwheel exhibits chaotic motion where instead of spinning in one direction at a constant speed, its rotation will speed up, slow down, stop, change directions, and oscillate back and forth between combinations of such behaviors in an unpredictable manner.

From a technical standpoint, the Lorenz system is nonlinear, aperiodic, three-dimensional and deterministic. The Lorenz equations have been the subject of hundreds of research articles, and at least one book-length study.

Analysis

One normally assumes that the parameters , , and are positive. Lorenz used the values , , and . The system exhibits chaotic behavior for these (and nearby) values.

If then there is only one equilibrium point, which is at the origin. This point corresponds to no convection. All orbits converge to the origin, which is a global attractor, when .

A pitchfork bifurcation occurs at , and for two additional critical points appear at$\left( \sqrt, \sqrt, \rho-1 \right) \quad\text\quad \left( -\sqrt, -\sqrt, \rho-1 \right).$ These correspond to steady convection. This pair of equilibrium points is stable only if
:$\rho < \sigma\frac,$
which can hold only for positive if . At the critical value, both equilibrium points lose stability through a subcritical Hopf bifurcation.

When , , and , the Lorenz system has chaotic solutions (but not all solutions are chaotic). Almost all initial points will tend to an invariant setthe Lorenz attractora strange attractor, a fractal, and a self-excited attractor with respect to all three equilibria. Its Hausdorff dimension is estimated from above by the Lyapunov dimension (Kaplan-Yorke dimension) as , and the correlation dimension is estimated to be . The exact Lyapunov dimension formula of the global attractor can be found analytically under classical restrictions on the parameters:
:$3 - \frac$

The Lorenz attractor is difficult to analyze, but the action of the differential equation on the attractor is described by a fairly simple geometric model. Proving that this is indeed the case is the fourteenth problem on the list of Smale's problems. This problem was the first one to be resolved, by Warwick Tucker in 2002.

For other values of , the system displays knotted periodic orbits. For example, with it becomes a torus knot.

Connection to tent map

In Figure 4 of his paper, Lorenz plotted the relative maximum value in the direction achieved by the system against the previous relative maximum in the direction. This procedure later became known as a Lorenz map (not to be confused with a Poincaré plot, which plots the intersections of a trajectory with a prescribed surface). The resulting plot has a shape very similar to the tent map. Lorenz also found that when the maximum value is above a certain cut-off, the system will switch to the next lobe. Combining this with the chaos known to be exhibited by the tent map, he showed that the system switches between the two lobes chaotically.

A Generalized Lorenz System

Over the past several years, a series of papers regarding high-dimensional Lorenz models have yielded a generalized Lorenz model, which can be simplified into the classical Lorenz model for three state variables or the following five-dimensional Lorenz model for five state variables: \begin
\frac &= \sigma (y - x), \\ pt\frac &= x (\rho - z) - y, \\ pt\frac &= x y - x y_1 - \beta z, \\ pt\frac &= x z - 2 x z_1 - d_0 y_1, \\ pt\frac &= 2 x y_1 - 4\beta z_1.
\end

A choice of the parameter $d_0=\dfrac$ has been applied to be consistent with the choice of the other parameters. See details in.

Simulations

Julia simulation

using Plots
# define the Lorenz attractor
@kwdef mutable struct Lorenz
dt::Float64 = 0.02
σ::Float64 = 10
ρ::Float64 = 28
β::Float64 = 8/3
x::Float64 = 2
y::Float64 = 1
z::Float64 = 1
end

function step!(l::Lorenz)
dx = l.σ * (l.y - l.x)
dy = l.x * (l.ρ - l.z) - l.y
dz = l.x * l.y - l.β * l.z
l.x += l.dt * dx
l.y += l.dt * dy
l.z += l.dt * dz
end

attractor = Lorenz()

# initialize a 3D plot with 1 empty series
plt = plot3d(
1,
xlim = (-30, 30),
ylim = (-30, 30),
zlim = (0, 60),
title = "Lorenz Attractor",
marker = 2,
)

# build an animated gif by pushing new points to the plot, saving every 10th frame
@gif for i=1:1500
step!(attractor)
push!(plt, attractor.x, attractor.y, attractor.z)
end every 10

Maple simulation

deq := iff(x(t), t) = 10*(y(t) - x(t)), diff(y(t), t) = 28*x(t) - y(t) - x(t)*z(t), diff(z(t), t) = x(t)*y(t) - 8/3*z(t)
with(DEtools):
DEplot3d(deq, , t = 0 .. 100, x(0) = 10, y(0) = 10, z(0) = 10, stepsize = 0.01, x = -20 .. 20, y = -25 .. 25, z = 0 .. 50, linecolour = sin(t*Pi/3), thickness = 1, orientation = 40, 80 title = `Lorenz Chaotic Attractor`);

Maxima simulation

igma, rho, beta 0, 28, 8/3
eq: igma*(y-x), x*(rho-z)-y, x*y-beta*z
sol: rk(eq, , y, z , 0, 0 , 0, 50, 1/100$
len: length(sol)$
x: makelist(sol 2], k, len)$
y: makelist(sol 3], k, len)$
z: makelist(sol 4], k, len)$
draw3d(points_joined=true, point_type=-1, points(x, y, z), proportional_axes=xyz)$

MATLAB simulation

% Solve over time interval ,100with initial conditions ,1,1% ''f'' is set of differential equations
% ''a'' is array containing x, y, and z variables
% ''t'' is time variable

sigma = 10;
beta = 8/3;
rho = 28;
f = @(t,a) sigma*a(1) + sigma*a(2); rho*a(1) - a(2) - a(1)*a(3); -beta*a(3) + a(1)*a(2)
,a= ode45(f, 100 1 1; % Runge-Kutta 4th/5th order ODE solver
plot3(a(:,1),a(:,2),a(:,3))

Mathematica simulation

Standard way:

tend = 50;
eq = ;
init = ;
pars = ;
=
NDSolveValue ,
ParametricPlot3D

Less verbose:

lorenz = NonlinearStateSpaceModel ,
soln _= StateResponse ,
ParametricPlot3D oln[t ">.html" ;"title="oln[t">oln[t

Python simulation

import matplotlib.pyplot as plt
import numpy as np

def lorenz(xyz, *, s=10, r=28, b=2.667):
"""
Parameters
----------
xyz : array-like, shape (3,)
Point of interest in three-dimensional space.
s, r, b : float
Parameters defining the Lorenz attractor.

Returns
-------
xyz_dot : array, shape (3,)
Values of the Lorenz attractor's partial derivatives at *xyz*.
"""
x, y, z = xyz
x_dot = s*(y - x)
y_dot = r*x - y - x*z
z_dot = x*y - b*z
return np.array([x_dot, y_dot, z_dot])

dt = 0.01
num_steps = 10000

xyzs = np.empty((num_steps + 1, 3)) # Need one more for the initial values
xyzs[0] = (0., 1., 1.05) # Set initial values
# Step through "time", calculating the partial derivatives at the current point
# and using them to estimate the next point
for i in range(num_steps):
xyzs + 1= xyzs + lorenz(xyzs * dt

# Plot
ax = plt.figure().add_subplot(projection='3d')

ax.plot(*xyzs.T, lw=0.6)
ax.set_xlabel("X Axis")
ax.set_ylabel("Y Axis")
ax.set_zlabel("Z Axis")
ax.set_title("Lorenz Attractor")

plt.show()

R simulation

library(deSolve)
library(plotly)
# parameters
prm <- list(sigma = 10, rho = 28, beta = 8/3)
# initial values
varini <- c(
X = 1,
Y = 1,
Z = 1
)

Lorenz <- function (t, vars, prm)

times <- seq(from = 0, to = 100, by = 0.01)
# call ode solver
out <- ode(y = varini, times = times, func = Lorenz,
parms = prm)

# to assign color to points
gfill <- function (repArr, long)

dout <- as.data.frame(out)

dout$color <- gfill(rainbow(10), nrow(dout))

# Graphics production with Plotly:
plot_ly(
data=dout, x = ~X, y = ~Y, z = ~Z,
type = 'scatter3d', mode = 'lines',
opacity = 1, line = list(width = 6, color = ~color, reverscale = FALSE)
)

SageMath simulation

We try to solve this system of equations for $\rho = 28$, $\sigma = 10$, $\beta = \frac$, with initial conditions $y_1(0) = 0$, $y_2(0) = 0.5$, $y_3(0) = 0$.

# we solve the Lorenz system of the differential equations.
# Runge-Kutta's method y_= y_n + h*(k_1 + 2*k_2+2*k_3+k_4)/6; x_=x_n+h
# k_1=f(x_n,y_n), k_2=f(x_n+h/2, y_n+hk_1/2), k_3=f(x_n+h/2, y_n+hk_2/2), k_4=f(x_n+h, y_n+hk_3)
# differential equation
def Runge_Kutta(f,v,a,b,h,n):
tlist = +i*h for i in range(n+1) y = 0,0,0for _ in range(n+1)]
# Taking length of f (number of equations).
m=len(f)
# Number of variables in v.
vm=len(v)
if m!=vm:
return("error, number of equations is not equal with the number of variables.")
for r in range(vm):
y r]=b # making a vector and component will be a list
# main part of the algorithm
k1= for _ in range(m) k2= for _ in range(m) k3= for _ in range(m) k4= for _ in range(m) for i in range(1,n+1): # for each t_i, i=1, ... , n
# k1=h*f(t_,x_1(t_),...,x_m(t_))
for j in range(m): # for each f_, j=0, ... , m-1
k1 f subs(t

tlist -1
for r in range(vm):
k1 k1 subs(v /h1>

y -1r])
k1 h*k1 for j in range(m): # k2=h*f(t_+h/2,x_1(t_)+k1/2,...,x_m(t_+k1/2))
k2 f subs(t

tlist -1h/2)
for r in range(vm):
k2 k2 subs(v /h1>

y -1r]+k1 2)
k2 h*k2 for j in range(m): # k3=h*f(t_+h/2,x_1(t_)+k2/2,...,x_m(t_)+k2/2)
k3 f subs(t

tlist -1h/2)
for r in range(vm):
k3 k3 subs(v /h1>

y -1r]+k2 2)
k3 h*k3 for j in range(m): # k4=h*f(t_+h,x_1(t_)+k3,...,x_m(t_)+k3)
k4 f subs(t

tlist -1h)
for r in range(vm):
k4 k4 subs(v /h1>

y -1r]+k3
k4 h*k4 for j in range(m): # Now x_j(t_i)=x_j(t_)+(k1+2k2+2k3+k4)/6
y y -1j]+(k1 2*k2 2*k3 k4 /6
return(tlist,y)

# (Figure 1) Here, we plot the solutions of the Lorenz ODE system.
a=0.0 # t_0
b= .0,.50,0.0# x_1(t_0), ... , x_m(t_0)
t=var('t')
x = var('x', n=3, latex_name='x')
v= [iifor ii in range(3)">[ii.html" ;"title="[ii">[iifor ii in range(3)f= [10*(x1-x0),x0*(28-x2)-x1,x0*x1-(8/3)*x2];
n=1600
h=0.0125
tlist,y=Runge_Kutta(f,v,a,b,h,n)
#print(tlist)
#print(y)
T=point3d(y[i][0],y[i][1],y[i][2 for i in range(n)], color='red')
S=line3d(y[i][0],y[i][1],y[i][2 for i in range(n)], color='red')
show(T+S)

# (Figure 2) Here, we plot every y1, y2, and y3 in terms of time.
a=0.0 # t_0
b= .0,.50,0.0# x_1(t_0), ... , x_m(t_0)
t=var('t')
x = var('x', n=3, latex_name='x')
v= [iifor ii in range(3)">[ii.html" ;"title="[ii">[iifor ii in range(3)Lorenz= [10*(x1-x0),x0*(28-x2)-x1,x0*x1-(8/3)*x2];
n=100
h=0.1
tlist,y=Runge_Kutta(Lorenz,v,a,b,h,n)
#Runge_Kutta(f,v,0,b,h,n)
#print(tlist)
#print(y)
P1=list_plot( tlist[iy[i">.html" ;"title="tlist[i">tlist[iy 0 for i in range(n)], plotjoined=True, color='red');
P2=list_plot( tlist[iy[i">.html" ;"title="tlist[i">tlist[iy[i1">">tlist[i<_a>y[i.html" ;"title=".html" ;"title="tlist[i">tlist[iy[i">.html" ;"title="tlist[i">tlist[iy[i1 for i in range(n)], plotjoined=True, color='green');
P3=list_plot( tlist[iy[i">.html" ;"title="tlist[i">tlist[iy[i2">.html" ;"title=".html" ;"title="tlist[i">tlist[iy[i">.html" ;"title="tlist[i">tlist[iy[i2 for i in range(n)], plotjoined=True, color='yellow');
show(P1+P2+P3)

# (Figure 3) Here, we plot the y and x or equivalently y2 and y1
a=0.0 # t_0
b= .0,.50,0.0# x_1(t_0), ... , x_m(t_0)
t=var('t')
x = var('x', n=3, latex_name='x')
v= [iifor ii in range(3)">[ii.html" ;"title="[ii">[iifor ii in range(3)f= [10*(x1-x0),x0*(28-x2)-x1,x0*x1-(8/3)*x2];
n=800
h=0.025
tlist,y=Runge_Kutta(f,v,a,b,h,n)
vv=y[i][0],y[i][1 for i in range(n)];
#print(tlist)
#print(y)
T=points(vv, rgbcolor=(0.2,0.6, 0.1), pointsize=10)
S=line(vv,rgbcolor=(0.2,0.6, 0.1))
show(T+S)

# (Figure 4) Here, we plot the z and x or equivalently y3 and y1
a=0.0 # t_0
b= .0,.50,0.0# x_1(t_0), ... , x_m(t_0)
t=var('t')
x = var('x', n=3, latex_name='x')
v= [iifor ii in range(3)">[ii.html" ;"title="[ii">[iifor ii in range(3)f= [10*(x1-x0),x0*(28-x2)-x1,x0*x1-(8/3)*x2];
n=800
h=0.025
tlist,y=Runge_Kutta(f,v,a,b,h,n)
vv=y[i][0],y[i][2 for i in range(n)];
#print(tlist)
#print(y)
T=points(vv, rgbcolor=(0.2,0.6, 0.1), pointsize=10)
S=line(vv,rgbcolor=(0.2,0.6, 0.1))
show(T+S)

# (Figure 5) Here, we plot the z and x or equivalently y3 and y2
a=0.0 # t_0
b= .0,.50,0.0# x_1(t_0), ... , x_m(t_0)
t=var('t')
x = var('x', n=3, latex_name='x')
v= [iifor ii in range(3)">[ii.html" ;"title="[ii">[iifor ii in range(3)f= [10*(x1-x0),x0*(28-x2)-x1,x0*x1-(8/3)*x2];
n=800
h=0.025
tlist,y=Runge_Kutta(f,v,a,b,h,n)
vv=y[i][1],y[i][2 for i in range(n)];
#print(tlist)
#print(y)
T=points(vv, rgbcolor=(0.2,0.6, 0.1), pointsize=10)
S=line(vv,rgbcolor=(0.2,0.6, 0.1))
show(T+S)

Applications

Model for atmospheric convection

As shown in Lorenz's original paper, the Lorenz system is a reduced version of a larger system studied earlier by Barry Saltzman. The Lorenz equations are derived from the Oberbeck–Boussinesq approximation to the equations describing fluid circulation in a shallow layer of fluid, heated uniformly from below and cooled uniformly from above. This fluid circulation is known as Rayleigh–Bénard convection. The fluid is assumed to circulate in two dimensions (vertical and horizontal) with periodic rectangular boundary conditions.

The partial differential equations modeling the system's stream function and temperature are subjected to a spectral Galerkin approximation: the hydrodynamic fields are expanded in Fourier series, which are then severely truncated to a single term for the stream function and two terms for the temperature. This reduces the model equations to a set of three coupled, nonlinear ordinary differential equations. A detailed derivation may be found, for example, in nonlinear dynamics texts from , Appendix C; , Appendix D; or Shen (2016), Supplementary Materials.

Model for the nature of chaos and order in the atmosphere

The scientific community accepts that the chaotic features found in low-dimensional Lorenz models could represent features of the Earth's atmosphere, yielding the statement of “weather is chaotic.” By comparison, based on the concept of attractor coexistence within the generalized Lorenz model and the original Lorenz model, Shen and his co-authors proposed a revised view that “weather possesses both chaos and order with distinct predictability”. The revised view, which is a build-up of the conventional view, is used to suggest that “the chaotic and regular features found in theoretical Lorenz models could better represent features of the Earth's atmosphere”.

Resolution of Smale's 14th problem

Smale's 14th problem asks, 'Do the properties of the Lorenz attractor exhibit that of a strange attractor?'. The problem was answered affirmatively by Warwick Tucker in 2002. To prove this result, Tucker used rigorous numerics methods like interval arithmetic and normal forms. First, Tucker defined a cross section $\Sigma\subset \$ that is cut transversely by the flow trajectories. From this, one can define the first-return map $P$, which assigns to each $x\in\Sigma$ the point $P(x)$ where the trajectory of $x$ first intersects $\Sigma$.

Then the proof is split in three main points that are proved and imply the existence of a strange attractor. The three points are:
* There exists a region $N\subset\Sigma$ invariant under the first-return map, meaning $P(N)\subset N$.
* The return map admits a forward invariant cone field.
* Vectors inside this invariant cone field are uniformly expanded by the derivative $DP$ of the return map.

To prove the first point, we notice that the cross section $\Sigma$ is cut by two arcs formed by $P(\Sigma)$. Tucker covers the location of these two arcs by small rectangles $R_i$, the union of these rectangles gives $N$. Now, the goal is to prove that for all points in $N$, the flow will bring back the points in $\Sigma$, in $N$. To do that, we take a plan $\Sigma'$ below $\Sigma$ at a distance $h$ small, then by taking the center $c_i$ of $R_i$ and using Euler integration method, one can estimate where the flow will bring $c_i$ in $\Sigma'$ which gives us a new point $c_i'$. Then, one can estimate where the points in $\Sigma$ will be mapped in $\Sigma'$ using Taylor expansion, this gives us a new rectangle $R_i'$ centered on $c_i$. Thus we know that all points in $R_i$ will be mapped in $R_i'$. The goal is to do this method recursively until the flow comes back to $\Sigma$ and we obtain a rectangle $Rf_i$ in $\Sigma$ such that we know that $P(R_i)\subset Rf_i$. The problem is that our estimation may become imprecise after several iterations, thus what Tucker does is to split $R_i'$ into smaller rectangles $R_$ and then apply the process recursively. Another problem is that as we are applying this algorithm, the flow becomes more 'horizontal', leading to a dramatic increase in imprecision. To prevent this, the algorithm changes the orientation of the cross sections, becoming either horizontal or vertical.

Gallery

File:Lorenz system r28 s10 b2-6666.png, A solution in the Lorenz attractor plotted at high resolution in the plane.
File:Lorenz attractor.svg, A solution in the Lorenz attractor rendered as an SVG.
File:A Lorenz system.ogv, An animation showing trajectories of multiple solutions in a Lorenz system.
File:Lorenzstill-rubel.png, A solution in the Lorenz attractor rendered as a metal wire to show direction and 3D structure.
File:Lorenz.ogv, An animation showing the divergence of nearby solutions to the Lorenz system.
File:Intermittent Lorenz Attractor - Chaoscope.jpg, A visualization of the Lorenz attractor near an intermittent cycle.
File:Lorenz apparition small.gif, Two streamlines in a Lorenz system, from to ).
File:Lorenz(rho).gif, Animation of a Lorenz System with rho-dependence.
File:Lorenz Attractor Brain Dynamics Toolbox.gif, Animation of the Lorenz attractor in the Brain Dynamics Toolbox.Heitmann, S., Breakspear, M (2017-2022) Brain Dynamics Toolbox
bdtoolbox.orgdoi.org/10.5281/zenodo.5625923
/ref>

See also

* Eden's conjecture on the Lyapunov dimension
* Lorenz 96 model
* List of chaotic maps
* Takens' theorem

Notes

References

*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
* Shen, B.-W. (2015-12-21). "Nonlinear feedback in a six-dimensional Lorenz model: impact of an additional heating term". ''Nonlinear Processes in Geophysics''. 22 (6): 749–764. doi:10.5194/npg-22-749-2015. ISSN 1607-7946.
*
*
*
*
*

Further reading

*
*

External links

*
*

Lorenz attractor
by Rob Morris, Wolfram Demonstrations Project.

Lorenz equation
on planetmath.org

Synchronized Chaos and Private Communications, with Kevin Cuomo
The implementation of Lorenz attractor in an electronic circuit.

Lorenz attractor interactive animation
(you need the Adobe Shockwave plugin)


* ttps://archive.today/20121211081109/http://frank.harvard.edu/~paulh/misc/lorenz.htm Lorenz Attractor implemented in analog electronic
Lorenz Attractor interactive animation
(implemented in Ada with GTK+. Sources & executable)

Interactive web based Lorenz Attractor
made with Iodide

{{Authority control

Chaotic maps
Articles containing video clips
Articles with example Python (programming language) code
Articles with example MATLAB/Octave code
Articles with example Julia code