Time-evolving block decimation

The time-evolving block decimation (TEBD) algorithm is a numerical scheme used to simulate one-dimensional quantum many-body systems, characterized by at most nearest-neighbour interactions. It is dubbed Time-evolving Block Decimation because it dynamically identifies the relevant low-dimensional Hilbert subspaces of an exponentially larger original Hilbert space. The algorithm, based on the Matrix Product States formalism, is highly efficient when the amount of entanglement in the system is limited, a requirement fulfilled by a large class of quantum many-body systems in one dimension.

Introduction

Time-evolving block decimation (TEBD) is a numerical algorithm that can efficiently simulate the time evolution of one dimensional quantum systems having limited entanglement entropy. Naively, to time evolve a system characterized by a Hamiltonian $\hat$ one would directly exponentiate the Hamiltonian to get the time evolution operator $\hat(t)=e^$ and apply this to an initial state: $\psi(t)=\hat(t)\psi(t=0)$ However, as the number of degrees of freedom of the system grows it quickly becomes computationally infeasible to perform the associated matrix exponentiation and matrix-vector multiplication. For example, if $\psi$ represents a system of $n$ qubits then the Hilbert space in which $\psi$ resides has dimension $2^n$, meaning matrix operations are effectively intractable for all but the smallest values of $n$. TEBD presents an efficient scheme for performing time evolution by limiting itself to a much smaller subspace of the configuration space. There are several other noteworthy examples of ways to get around this exponential scaling, including quantum Monte Carlo and the density matrix renormalization group.

Guifré Vidal proposed the scheme while at the Institute for Quantum Information, Caltech. He asserts that ''"any quantum computation with pure states can be efficiently simulated with a classical computer provided the amount of entanglement involved is sufficiently restricted"''.
This happens to be the case for a wide suite of Hamiltonians characterized by local interactions, for example, Hubbard-like Hamiltonians. The method exhibits a low-degree polynomial behavior in the increase of computational time with respect to the amount of entanglement present in the system. The algorithm is based on a scheme that exploits the fact that in these one-dimensional systems the eigenvalues of the reduced density matrix on a bipartite split of the system are exponentially decaying, thus allowing one to work in a re-sized space spanned by the eigenvectors corresponding to the selected eigenvalues.

The numerical method is efficient in simulating real-time dynamics or calculations of ground states using imaginary-time evolution or isentropic interpolations between a target Hamiltonian and a Hamiltonian with an already-known ground state. The computational time scales linearly with the system size, hence many-particles systems in 1D can be investigated.

A useful feature of the TEBD algorithm is that it can be reliably employed for time evolution simulations of time-dependent Hamiltonians, describing systems that can be realized with cold atoms in optical lattices, or in systems far from equilibrium in quantum transport. From this point of view, TEBD had a certain ascendance over DMRG, a very powerful technique, but until recently not very well suited for simulating time-evolutions. With the Matrix Product States formalism being at the mathematical heart of DMRG, the TEBD scheme was adopted by the DMRG community, thus giving birth to the time dependent DMR

t-DMRG for short.

Other groups have developed similar approaches in which quantum information plays a predominant role: for example, in DMRG implementations for periodic boundary conditions

and for studying mixed-state dynamics in one-dimensional quantum lattice systems,.
/ref> Those last approaches actually provide a formalism that is more general than the original TEBD approach, as it also allows to deal with evolutions with matrix product operators; this enables the simulation of nontrivial non-infinitesimal evolutions as opposed to the TEBD case, and is a crucial ingredient to deal with higher-dimensional analogues of matrix product states.

The decomposition of state

Introducing the decomposition of State

Consider a chain of ''N'' qubits, described by the function $, \Psi \rangle \in H^$. The most natural way of describing $, \Psi \rangle$ would be using the local $M^N$-dimensional basis $, i_1,i_2,..,i_,i_N \rangle$:
$, \Psi \rangle=\sum\limits_^c_ , \rangle$
where ''M'' is the on-site dimension.

The trick of TEBD is to re-write the coefficients $c_$:
$c_=\sum\limits_^\Gamma^_\lambda^_\Gamma^_\lambda^_\Gamma^_\lambda^_\cdot..\cdot\Gamma^_\lambda^_\Gamma^_$

This form, known as a Matrix product state, simplifies the calculations greatly.

To understand why, one can look at the Schmidt decomposition of a state, which uses singular value decomposition to express a state with limited entanglement more simply.

The Schmidt decomposition

Consider the state of a bipartite system $\vert \Psi \rangle \in$. Every such state $, \rangle$ can be represented in an appropriately chosen basis as:
$\left\vert \Psi \right\rangle = \sum\limits_^ a_i \left\vert\right\rangle$
where $, \rangle=, \rangle\otimes , \rangle$ are formed with vectors $, \rangle$ that make an orthonormal basis in $H_A$ and, correspondingly, vectors $, \rangle$, which form an orthonormal basis in $$, with the coefficients $a_i$ being real and positive, $\sum\limits_^a^2_i = 1$. This is called the Schmidt decomposition (SD) of a state. In general the summation goes up to $M_=\min(\dim(),\dim())$. The Schmidt rank of a bipartite split is given by the number of non-zero Schmidt coefficients. If the Schmidt rank is one, the split is characterized by a product state. The vectors of the SD are determined up to a phase and the eigenvalues and the Schmidt rank are unique.

For example, the two-qubit state:
$, \rangle=\frac\left( , \rangle + , \rangle + , \rangle + , \rangle\right)$
has the following SD:
$\left, \right\rangle = \frac \left, \right\rangle + \frac \left, \right\rangle$
with
$, \rangle=\frac(, \rangle+, \rangle), \ \ , \rangle=\frac(, \rangle+, \rangle), \ \ , \rangle=\frac(, \rangle-, \rangle), \ \ , \rangle=\frac(, \rangle-, \rangle)$

On the other hand, the state:
$, \rangle =\frac, \rangle + \frac, \rangle- \frac, \rangle - \frac, \rangle$
is a product state:
$\left, \Phi\right\rangle = \left( \frac \left, 0_A\right\rangle - \frac \left, 1_A\right\rangle \right) \otimes \left( \left, 0_B\right\rangle + \frac \left, 1_B\right\rangle \right)$

Building the decomposition of state

At this point we know enough to try to see how we explicitly build the decomposition (let's call it ''D'').

Consider the bipartite splitting ..N/math>. The SD has the coefficients $\lambda^_$ and eigenvectors $\left, \right\rangle \left, \right\rangle$.
By expanding the $\left, \right\rangle$'s in the local basis, one can write:

$, \rangle=\sum\limits_^\Gamma^_\lambda^_, \rangle, \rangle$

The process can be decomposed in three steps, iterated for each bond (and, correspondingly, SD) in the chain:
''Step 1'': express the $, \rangle$'s in a local basis for qubit 2:
$, \rangle=\sum_, \rangle, \rangle$

The vectors $, \rangle$ are not necessarily normalized.

''Step 2'': write each vector $, \rangle$ in terms of the ''at most'' (Vidal's emphasis) $\chi$ Schmidt vectors $, \rangle$ and, correspondingly, coefficients $\lambda^_$:
$, \tau^_\rangle=\sum_\Gamma^_\lambda^_, \rangle$

''Step 3'': make the substitutions and obtain:
$, \rangle=\sum_\Gamma^_\lambda^_\Gamma^_\lambda^_, \rangle, \rangle$

Repeating the steps 1 to 3, one can construct the whole decomposition of state ''D''. The last $\Gamma$'s are a special case, like the first ones, expressing the right-hand Schmidt vectors at the $(N-1)^$ bond in terms of the local basis at the $N^$ lattice place. As shown in, it is straightforward to obtain the Schmidt decomposition at $k^$ bond, i.e. ..k +1..N/math>, from ''D''.

The Schmidt eigenvalues, are given explicitly in ''D'':

$, \rangle=\sum_\lambda^_, \rangle, \rangle$

The Schmidt eigenvectors are simply:

$, \rangle=\sum_\Gamma^_\lambda^_\cdot\cdot\Gamma^_, \rangle$
and

$, \rangle=\sum_\Gamma^_\lambda^_\cdot\cdot\lambda^_\Gamma^_, \rangle$

Rationale

Now, looking at ''D'', instead of $M^N$ initial terms, there are $^2M(N-2) + 2M + (N-1)\chi$. Apparently this is just a fancy way of rewriting the coefficients $c_$, but in fact there is more to it than that. Assuming that ''N'' is even, the Schmidt rank $\chi$ for a bipartite cut in the middle of the chain can have a maximal value of $M^$; in this case we end up with at least $M^(N-2)$ coefficients, considering only the $^2$ ones, slightly more than the initial $M^N$! The truth is that the decomposition ''D'' is useful when dealing with systems that exhibit a low degree of entanglement, which fortunately is the case with many 1D systems, where the Schmidt coefficients of the ground state decay in an exponential manner with $\alpha$:

$\lambda^_e^,\ K>0.$

Therefore, it is possible to take into account only some of the Schmidt coefficients (namely the largest ones), dropping the others and consequently normalizing again the state:

$, \rangle=\frac\cdot\sum\limits_^\lambda^_, \rangle, \rangle,$

where $\chi_c$ is the number of kept Schmidt coefficients.

Let's get away from this abstract picture and refresh ourselves with a concrete example, to emphasize the advantage of making this decomposition. Consider for instance the case of 50 fermions in a ferromagnetic chain, for the sake of simplicity. A dimension of 12, let's say, for the $\chi_c$ would be a reasonable choice, keeping the discarded eigenvalues at $0.0001$% of the total, as shown by numerical studies, meaning roughly $2^$ coefficients, as compared to the originally $2^$ ones.

Even if the Schmidt eigenvalues don't have this exponential decay, but they show an algebraic decrease, we can still use ''D'' to describe our state $\psi$. The number of coefficients to account for a faithful description of $\psi$ may be sensibly larger, but still within reach of eventual numerical simulations.

The update of the decomposition

One can proceed now to investigate the behaviour of the decomposition ''D'' when acted upon with one-qubit gates (OQG) and two-qubit gates (TQG) acting on neighbouring qubits. Instead of updating all the $M^N$ coefficients $c_$, we will restrict ourselves to a number of operations that increase in $\chi$ as a polynomial of low degree, thus saving computational time.

One-qubit gates acting on qubit ''k''

The OQGs are affecting only the qubit they are acting upon, the update of the state $, \rangle$ after a unitary operator at qubit ''k'' does not modify the Schmidt eigenvalues or vectors on the left, consequently the $\Gamma^$'s, or on the right, hence the $\Gamma^$'s. The only $\Gamma$'s that will be updated are the $\Gamma^$'s (requiring only at most $(M^2\cdot\chi^2)$ operations), as

$\Gamma^_=\sum_U^_\Gamma^_.$

Two-qubit gates acting on qubits ''k, k''+1

The changes required to update the $\Gamma$'s and the $\lambda$'s, following a unitary operation ''V'' on qubits ''k'', ''k''+1, concern only $\Gamma^$, and $\Gamma^$.
They consist of a number of $(^3)$ basic operations.

Following Vidal's original approach, $, \rangle$ can be regarded as belonging to only four subsystems:

$.\,$

The subspace ''J'' is spanned by the eigenvectors of the reduced density matrix $\rho^ = Tr_, \psi\rangle\langle\psi,$:

$\rho^=\sum_^2, \rangle\langle, =\sum_, \rangle\langle, .$

In a similar way, the subspace ''K'' is spanned by the eigenvectors of the reduced density matrix:

$\rho^=\sum_, \rangle\langle, =\sum_, \rangle\langle, .$

The subspaces $H_C$ and $H_D$ belong to the qubits ''k'' and ''k'' + 1.
Using this basis and the decomposition ''D'', $, \rangle$ can be written as:

$, \rangle=\sum\limits_^\sum\limits_^\lambda^_\Gamma^_\lambda^_\Gamma^_\lambda^_, \rangle$

Using the same reasoning as for the OQG, the applying the TQG ''V'' to qubits ''k'', ''k'' + 1 one needs only to update $\Gamma^$, $\lambda$ and $\Gamma^.$

We can write $, \rangle=V, \rangle$ as:
$, \rangle=\sum\limits_^\sum\limits_^\lambda_\Theta^_\lambda_, \rangle$
where
$\Theta^_=\sum\limits_^\sum\limits_^V^_\Gamma^_\lambda_\Gamma^_.$

To find out the new decomposition, the new $\lambda$'s at the bond ''k'' and their corresponding Schmidt eigenvectors must be computed and expressed in terms of the $$'s of the decomposition ''D''. The reduced density matrix $\rho^$ is therefore diagonalized:
$\rho^=Tr_, \rangle\langle, =\sum_\rho^_, \rangle\langle, .$

The square roots of its eigenvalues are the new $\lambda$'s.
Expressing the eigenvectors of the diagonalized matrix in the basis: $\$ the $\Gamma^$'s are obtained as well:
$, \rangle=\sum_\Gamma^_\lambda_, \rangle.$

From the left-hand eigenvectors,
$\lambda^_, \rangle=\langle, \rangle=\sum_(\Gamma^_)^\Theta^_(\lambda_)^2\lambda_, \rangle$
after expressing them in the basis $\$, the $\Gamma^$'s are:
$, \rangle=\sum_\Gamma^_\lambda_, \rangle.$

The computational cost

The dimension of the largest tensors in ''D'' is of the order $(M^2)$; when constructing the $\Theta^_$ one makes the summation over $\beta$, $\it$ and $\it$ for each $\gamma,\alpha,$, adding up to a total of $(M^4^3)$ operations. The same holds for the formation of the elements $\rho^_$, or for computing the left-hand eigenvectors $\lambda^_, \rangle$, a maximum of $(M^3^3)$, respectively $(M^2^3)$ basic operations. In the case of qubits, $M = 2$, hence its role is not very relevant for the order of magnitude of the number of basic operations, but in the case when the on-site dimension is higher than two it has a rather decisive contribution.

The numerical simulation

The numerical simulation is targeting (possibly time-dependent) Hamiltonians of a system of $N$ particles arranged in a line, which are composed of arbitrary OQGs and TQGs:

$H_N=\sum\limits_^K^_1 + \sum\limits_^K^_2.$

It is useful to decompose $H_N$ as a sum of two possibly non-commuting terms, $H_N = F + G$, where

$F \equiv \sum_(K^_1 + K^_2) = \sum_F^,$$G \equiv \sum_(K^_1 + K^_2) = \sum_G^.$

Any two-body terms commute: ^,F^0, ^,G^0
This is done to make the Suzuki–Trotter expansion (ST) of the exponential operator, named after Masuo Suzuki and Hale Trotter.

The Suzuki–Trotter expansion

The Suzuki–Trotter expansion of the first order (ST1) represents a general way of writing exponential operators:
$e^ = \lim_ \left(e^e^ \right)^n$
or, equivalently
$e^ = e^e^ + (\delta^2).$

The correction term vanishes in the limit $\delta \to 0$

For simulations of quantum dynamics it is useful to use operators that are unitary, conserving the norm (unlike power series expansions), and there's where the Trotter-Suzuki expansion comes in. In problems of quantum dynamics the unitarity of the operators in the ST expansion proves quite practical, since the error tends to concentrate in the overall phase, thus allowing us to faithfully compute expectation values and conserved quantities. Because the ST conserves the phase-space volume, it is also called a symplectic integrator.

The trick of the ST2 is to write the unitary operators $e^$ as:
e^ = ^ = ^e^e^
where $n=\frac$. The number $n$ is called the Trotter number.

Simulation of the time-evolution

The operators $e^$, $e^$ are easy to express, as:

$e^ = \prod_e^$
$e^ = \prod_e^$

since any two operators $F^$,$F^$ (respectively, $G^$,$G^$) commute for $ll'$ and an ST expansion of the first order keeps only the product of the exponentials, the approximation becoming, in this case, exact.

The time-evolution can be made according to

$, \rangle=e^e^e^, \rangle.$

For each "time-step" $\delta$, $e^$ are applied successively to all odd sites, then $e^$ to the even ones, and $e^$ again to the odd ones; this is basically a sequence of TQG's, and it has been explained above how to update the decomposition $$ when applying them.

Our goal is to make the time evolution of a state $, \rangle$ for a time T, towards the state $, \rangle$ using the n-particle Hamiltonian $H_n$.

It is rather troublesome, if at all possible, to construct the decomposition $$ for an arbitrary n-particle state, since this would mean one has to compute the Schmidt decomposition at each bond, to arrange the Schmidt eigenvalues in decreasing order and to choose the first $\chi_c$ and the appropriate Schmidt eigenvectors. Mind this would imply diagonalizing somewhat generous reduced density matrices, which, depending on the system one has to simulate, might be a task beyond our reach and patience.
Instead, one can try to do the following:

Error sources

The errors in the simulation are resulting from the Suzuki–Trotter approximation and the involved truncation of the Hilbert space.

Errors coming from the Suzuki–Trotter expansion

In the case of a Trotter approximation of $$ order, the error is of order $^$. Taking into account $n = \frac$ steps, the error after the time T is:
$\epsilon=\frac\delta^=T\delta^p$

The unapproximated state $, \rangle$ is:

$, \rangle = \sqrt, \rangle + , \rangle$

where $, \rangle$ is the state kept after the Trotter expansion and $, \rangle$ accounts for the part that is neglected when doing the expansion.

The total error scales with time $T$ as:
$\epsilon(T) = 1 -, \langle, \rangle, ^2 = 1 - 1 + \epsilon^2 = \epsilon^2$

The Trotter error is independent of the dimension of the chain.

Errors coming from the truncation of the Hilbert space

Considering the errors arising from the truncation of the Hilbert space comprised in the decomposition ''D'', they are twofold.

First, as we have seen above, the smallest contributions to the Schmidt spectrum are left away, the state being faithfully represented up to:
$\epsilon() = 1 - \prod\limits_^(1-\epsilon_n)$
where $\epsilon_n = \sum\limits_^(\lambda^_)^2$ is the sum of all the discarded eigenvalues of the reduced density matrix, at the bond $$.
The state $, \rangle$ is, at a given bond $$, described by the Schmidt decomposition:
$, \rangle = \sqrt, \rangle + \sqrt, \rangle$
where
$, \rangle = \frac\sum\limits_^\lambda^_, \rangle, \rangle$
is the state kept after the truncation and
$, \rangle = \frac\sum\limits_^\lambda^_, \rangle, \rangle$
is the state formed by the eigenfunctions corresponding to the smallest, irrelevant Schmidt coefficients, which are neglected.
Now, $\langle\psi^_, \psi_\rangle=0$ because they are spanned by vectors corresponding to orthogonal spaces. Using the same argument as for the Trotter expansion, the error after the truncation is:
$\epsilon_n = 1 - , \langle, \psi_\rangle, ^2 = \sum\limits_^(\lambda^_)^2$

After moving to the next bond, the state is, similarly:
$, \rangle = \sqrt, \rangle + \sqrt, \rangle$
The error, after the second truncation, is:
$\epsilon = 1 - , \langle, \psi'_\rangle, ^2 = 1 - (1-\epsilon_), \langle, \psi_\rangle, ^2 = 1 - (1-\epsilon_)(1-\epsilon_)$
and so on, as we move from bond to bond.

The second error source enfolded in the decomposition $D$ is more subtle and requires a little bit of calculation.

As we calculated before, the normalization constant after making the truncation at bond $l$ ( ..l +1..N is:
$R = =$

Now let us go to the bond $-1$ and calculate the norm of the right-hand Schmidt vectors $\, \,$; taking into account the full Schmidt dimension, the norm is:
$n_1 = 1 = \sum\limits_^(c_)^2(\lambda^_)^2 + \sum\limits_^(c_)^2(\lambda^_)^2 = S_1 + S_2,$

where $(c_)^2 = \sum\limits_^(\Gamma^_)^\Gamma^_$.

Taking into account the truncated space, the norm is:
$n_=\sum\limits_^ (c_)^2\cdot(^_)^2=\sum\limits_^(c_)^2\frac = \frac$

Taking the difference, $\epsilon = n_2 - n_1 = n_2 - 1$, we get:
$\epsilon = \frac - 1 \leq \frac = \frac 0\ \ as\ \$

Hence, when constructing the reduced density matrix, the trace of the matrix is multiplied by the factor:
$, \langle, \psi_\rangle, ^2 = 1 - \frac = \frac$

The total truncation error

The total truncation error, considering both sources, is upper bounded by:
$\epsilon() = 1 - \prod\limits_^(1-\epsilon_n) \prod\limits_^\frac = 1 - \prod\limits_^(1-2\epsilon_n)$

When using the Trotter expansion, we do not move from bond to bond, but between bonds of same parity; moreover, for the ST2, we make a sweep of the even ones and two for the odd. But nevertheless, the calculation presented above still holds. The error is evaluated by successively multiplying with the normalization constant, each time we build the reduced density matrix and select its relevant eigenvalues.

"Adaptive" Schmidt dimension

One thing that can save a lot of computational time without loss of accuracy is to use a different Schmidt dimension for each bond instead of a fixed one for all bonds, keeping only the necessary amount of relevant coefficients, as usual. For example, taking the first bond, in the case of qubits, the Schmidt dimension is just two. Hence, at the first bond, instead of futilely diagonalizing, let us say, 10 by 10 or 20 by 20 matrices, we can just restrict ourselves to ordinary 2 by 2 ones, thus making the algorithm generally faster. What we can do instead is set a threshold for the eigenvalues of the SD, keeping only those that are above the threshold.

TEBD also offers the possibility of straightforward parallelization due to the factorization of the exponential time-evolution operator using the Suzuki–Trotter expansion. A parallel-TEBD has the same mathematics as its non-parallelized counterpart, the only difference is in the numerical implementation.

References

{{DEFAULTSORT:Time-Evolving Block Decimation
Quantum mechanics
Computational physics