of 32
A Variational Formulation of Resolvent Analysis
Benedikt Barthel,
Salvador Gomez, and Beverley J. McKeon
Graduate Aerospace Laboratories, California Institute of Technology, Pasadena, CA 91125, USA
(Dated: September 28, 2021)
The conceptual picture underlying resolvent analysis(RA) is that the nonlinear term in the Navier-
Stokes(NS) equations acts as an intrinsic forcing to the linear dynamics, a description inspired by
control theory. The inverse of the linear operator, defined as the resolvent, is interpreted as a trans-
fer function between the forcing and the velocity response. From a theoretical point of view this is
an attractive approach since it allows for the vast mathematical machinery of control theory to be
brought to bear on the problem. However, from a practical point of view, this is not always advan-
tageous. The inversion of the linear operator inherent in the control theoretic definition obscures
the physical interpretation of the governing equations and is prohibitive to analytical manipulation,
and for large systems leads to significant computational cost and memory requirements. In this
work we suggest an alternative, inverse free, definition of the resolvent basis based on an extension
of the Courant–Fischer–Weyl min-max principle in which resolvent modes are defined as stationary
points of a constrained variational problem. This definition leads to a straightforward approach to
approximate the resolvent (response) modes of complex flows as expansions in any arbitrary basis.
The proposed method avoids matrix inversions and requires only the spectral decomposition of a
matrix of significantly reduced size as compared to the original system. To illustrate this method
and the advantages of the variational formulation we present three examples. First, we consider
streamwise constant fluctuations in turbulent channel flow where an asymptotic analysis allows us
to derive closed form expressions for the optimal resolvent modes. Second, to illustrate the cost
saving potential, and investigate the limits, of the proposed method we apply our method to both
a 2-dimensional, 3-component equilibrium solution in Couette flow and, finally, to a streamwise
developing turbulent boundary layer. For these larger systems we achieve a model reduction of up
to two orders of magnitude. Such savings have the potential to open up RA to the investigation of
larger domains and more complex flow configurations.
I. INTRODUCTION
Resolvent analysis (RA) can be used to give insight into the forced response of a linearized dynamical system.
This concept was introduced by Trefethen
et al.
[1] and Jovanovi ́c and Bamieh [2] who considered the stability and
amplification of linearly stable flows to external forcing. These ideas were later applied to turbulent flows by McKeon
and Sharma [3] who interpreted the nonlinear term in the Navier-Stokes equations (NSE) as a forcing to the linearized
system. The conceptual framework of RA is inspired by control theory (CT), such that the resolvent operator, the
inverse of the linearized operator, is interpreted as a transfer function from the forcing to the response. A singular
value decomposition (SVD) of the discretized resolvent operator provides two distinct orthonormal bases (left and right
singular modes) for both the response and the forcing, ordered by a set of gains (singular values) which quantify the
linear amplification of the system. This CT-inspired framework has proven theoretically useful since it is conceptually
straightforward and benefits from years of established mathematical machinery. However, from a practical point of
view the reliance on the inversion of the linear operator poses some difficulties. It obscures the analytical tractability
of the equations and is computationally costly for all but the simplest systems.
Early studies using RA were largely focused on wall bounded shear flows with only a single non-homogeneous spatial
dimension for which cost of the inversion and SVD of the operator is trivial [2–6]. In these cases, linearly amplified
length scales identified by RA were found to correlate with the energetically active scales observed in experiments
and simulations, and the corresponding resolvent modes capture the qualitative features of the coherent structures
observed in wall turbulence [7]. In particular, resolvent modes have been found to exhibit self similar behaviour
characteristic of the attached eddy hypothesis proposed by Townsend [5, 8, 9]. Towne
et al.
[10] have elaborated the
assumptions under which resolvent response modes correlate with spectral proper orthogonal decomposition (SPOD)
modes computed from data, illustrating that RA can predict coherent structure in the full flow field. More recently
RA has also been extended to 2D flows such as boundary layers [11, 12], the flow behind bluff bodies [13, 14], exact
coherent states (ECS) [15], and turbulent jets [16, 17]. In particular, modal analysis techniques including RA have
been used by a variety of authors to implement flow control strategies, for example, to suppress vortex shedding
bbarthel@caltech.edu.
arXiv:2109.08000v2 [physics.flu-dyn] 25 Sep 2021
2
[18], and delay flow separation [19]. For these 2D flows the computational cost and memory requirements becomes
considerable and thus the further extension to 3D flows has generally remained limited.
The community has endeavoured to address these computational challenges through innovation in novel methods
of estimating resolvent modes. One area of research has been in so called “matrix free” methods such as the work of
Martini
et al.
[20] who use the transient and steady state responses of the periodically forced linearized system and
its corresponding adjoint system to estimate the action of the resolvent operator. Another avenue of investigation
inspired by the field of data analysis has been in “equation free” methods such as Herrmann
et al.
[21] who use
dynamic mode decomposition (DMD) modes to estimate the linear dynamics of a system from a time series of data.
Others have made use of iterative Arnoldi Algorithms that replace the cost of calculating the SVD and a matrix
inverse with the cost of an LU decomposition and a few matrix multiplications [11, 16]. Furthermore, algorithms such
as randomized SVD and others have made it possible to efficiently and accurately compute singular modes of data
sets that would otherwise be prohibitively expensive [5, 22–25].
The previously cited research has focused on the CT interpretation of RA and the SVD-based definition of resolvent
modes. In this work we take an alternative approach and propose an equivalent definition based on an extension of
the Courant–Fischer–Weyl min-max principle (CFL). The CFL principle itself has been used previously by Dawson
and McKeon [26] who formulated a simplified variational problem to estimate the shape of the vorticity component
of the optimal resolvent mode in wall bounded shear flows. We believe the explicit extension from the CFL principle,
to what we coin “variational resolvent analysis” (VRA), which constitutes an alternative definition of the resolvent
basis that includes all modes, to be novel in the resolvent literature.
This new definition is based on the solutions of the Euler-Lagrange equations associated with the constrained
variation of the operator norm of the linearized dynamics. Critically, this definition does not involve the inversion of
any operator, which is useful from both a theoretical and practical sense. The inversion of large matrices is both costly
and obscures the intuitive interpretation of the underlying linear differential operator. While in general the resulting
Euler-Lagrange equations remain difficult to solve exactly, this variational formulation allows for the approximation
of resolvent modes as an expansion in any convenient basis, for example the much cheaper one-dimensional resolvent
basis in a two- or three-dimensional problem, an analytical basis such as that described by [26] or a data-driven one.
Further, it requires only the eigenvalue decomposition of a matrix of reduced size. In this paper we illustrate how
this variational definition is useful in both gaining physical insights by allowing for analytical progress in simplified
systems, and by reducing computational cost in complex systems. To illustrate the former we consider the case of
streamwise constant fluctuations in wall bounded shear flows, and to investigate the latter we perform RA around
a 2D/3C exact coherent solution. We find that we can accurately approximate the resolvent response modes and
reduce the computational complexity by an order of magnitude. Finally, the VRA formulation is applied to a
streamwise developing turbulent boundary layer, where the near wall modes can be predicted with a 97% reduction
in computational cost using resolvent modes calculated using a 1D mean flow.
The paper is organized as follows. In
§
II we derive the proposed variational definition. In
§
III we use the variational
formulation to analyze streamwise constant structures in turbulent channel flow. In
§
IV and
§
V we consider RA applied
to both streamwise periodic and streamwise developing two-dimensional, three velocity component (2D/3C) systems
to illustrate the computational cost and memory saving potential of the proposed VRA formulation. In
§
VI we analyze
the uncertainty and potential sources of error in our method. We provide discussion of the results and the outlook
for future applications in
§
VII and conclude in
§
VIII.
II. MATHEMATICAL FORMULATION
Let us consider a general forced linear system
u
∂t
Au
=
f
(1)
where
A
represents a spatial-linear differential operator and
u
(
x
,t
)
,
f
(
x
,t
)
C
. The state variables
u
and
f
are
referred to as the ‘response’ and ‘forcing’ respectively. We consider the temporal Fourier transfer of (1) and define
the spatio-temporal linear operator
L
(
ω
)
I
A
(2)
as well as the resolvent operator
H
(
ω
)
L
(
ω
)
1
(3)
3
which is classically interpreted as a transfer function from the forcing to the response.
u
=
Hf
(4)
For readability we have dropped explicit reference to the dependence on
ω
. An SVD of the resolvent
H
=
j
=1
ψ
j
σ
j
φ
H
j
(5)
results in a pair of distinct sets of basis functions for the response (
ψ
j
) and forcing (
φ
j
) and are referred to as the
resolvent ‘response modes’ and ‘forcing modes’ respectively. These are ordered by their gains
σ
j
that are ordered
in descending order, representing the
j
th largest linear gain possible. Here and throughout this work superscript
H
denotes the Hermitian adjoint, or for discrete matrices the conjugate transpose.
A. A variational definition of resolvent modes
A key contribution of this work is the observation that resolvent response modes may be equivalently defined as
the stationary points,
q
, of the operator norm of
L
under the condition that the argument
q
satisfies some norm
constraint. More explicitly, the resolvent modes of the linear operator
H
are defined as the stationary points of the
functional
J
=
Lq
2
a
(6)
subject to the constraint
q
2
b
= 1
.
(7)
We note that in general the norms
x
||
a
x
H
Q
a
x
and
x
||
b
x
H
Q
b
x
need not be the same, such as for example in
the Orr-Sommerfeld and Squire decomposition discussed in
§
III. Following the notation of Herrmann
et al.
[21] the
Cholesky factorization may be used to decompose the weight matrix
Q
a
=
F
H
a
F
a
(8)
This allows a general norm to be related to the Euclidean 2 norm. In other words, we can express any arbitrary user
defined norm as
x
||
α
=
F
α
x
||
2
(9)
where
α
is simply a label used to distinguish between different norms.
The method of Lagrange multipliers allows us to combine(6), (7) and the definition (9) to formulate a constrained
variational problem and define a Lagrangian
L
(
q
) =
F
a
Lq
||
2
2
σ
2
F
b
q
2
2
=
q
H
L
H
Q
a
Lq
σ
2
q
H
Q
b
q
.
(10)
Here
L
and
F
may be either interpreted as continuous differential operators or discrete matrices. The vanishing of
the variation with respect to the conjugate state
q
is a necessary and sufficient condition for the stationarity of (10).
The reader is referred to appendix A for a derivation of this property based on the work of [27, 28]. The resolvent
response modes of
H
=
L
1
are then defined as the solutions to the Euler-Lagrange equations given by
δ
L
δ
q
=
L
H
Q
a
Lq
σ
2
Q
b
q
= 0
.
(11)
Equation 11 constitutes an eigenvalue problem and thus has a countably infinite set of solutions which we index by
the subscript
j
.
L
H
Q
a
L
ψ
j
=
σ
2
j
Q
b
ψ
j
(12)
We have denoted the eigenvalue
σ
2
j
and the eigenfunctions
ψ
j
such that the singular values and resolvent response
modes of
H
are given by
σ
j
and
ψ
j
respectively. The resolvent forcing modes are recovered through
φ
j
=
σ
j
L
ψ
j
.
(13)
Note that the
ψ
j
are guaranteed to be orthogonal since the matrices in (12) are Hermitian, and the
φ
j
are orthogonal
w.r.t
Q
a
since
φ
H
i
Q
a
φ
j
=
σ
i
σ
j
ψ
H
i
L
H
Q
a
L
ψ
j
=
σ
i
σ
1
j
ψ
H
i
Q
b
ψ
j
=
δ
ij
.
(14)
4
B. Proof of equivalence
We will now illustrate the equivalence of (12) to the standard SVD-based definition. For simplicity we consider the
case where
x
||
a
=
x
||
b
. Again, following the notation of Herrmann
et al.
[21], the SVD of the properly weighted
resolvent operator is given by
H
F
FHF
1
=
Ψ
F
ΣΦ
H
F
.
(15)
The physical resolvent forcing and response modes are then recovered by left multiplication by
F
1
, such that
Φ
=
F
1
Φ
F
and
Ψ
=
F
1
Ψ
F
, whose columns give the individual modes
φ
j
and
ψ
j
respectively. We focus first on
the resolvent response modes
Ψ
. Beginning from the definition of the weighted resolvent we can write
H
F
H
H
F
=
Ψ
F
Σ
2
Ψ
H
F
.
(16)
Next we use (3), (8), and (15) to write the above expression in terms of the linear operator
L
,
F
(
L
1
Q
1
L
H
)
F
H
=
Ψ
F
Σ
2
Ψ
H
F
.
(17)
Taking the inverse of both sides and noting the unitary nature of
Ψ
F
we find
F
H
(
L
H
QL
)
F
1
=
Ψ
F
Σ
2
Ψ
H
F
.
(18)
Finally, we right multiply by
Ψ
F
and left multiply by
F
H
to arrive at
(
L
H
QL
)
Ψ
=
QΨΣ
2
(19)
which is equivalent to (12). Again, the resolvent forcing modes are then recovered through
Φ
=
LΨΣ
.
(20)
This establishes the equivalence of the variational and SVD-based definitions of resolvent modes. We would like to
emphasize that a consequence of this equivalence is that the completeness property of the SVD-based basis also applies
to the variational computed basis. The case where
x
||
a
6
=
x
||
b
follows similar arguments but for the sake of brevity
is not included here.
C. Resolvent Mode Estimation
In general, the Euler-Lagrange equations (12) are both analytically intractable and computationally intensive for
complex flows with multiple non-homogeneous spatial dimensions. However, the variational definition introduced
above provides a convenient way to estimate resolvent modes as an expansion in any convenient basis. Suppose we
wish to estimate the resolvent response modes of some system
ψ
(
x
), and let
q
j
(
x
) with (
j
= 1
...r
) be some known
basis defined on the same domain. We can then write the resolvent response modes as an expansion in this basis.
ψ
=
a
j
q
j
(21)
Inserting this expansion into (10) transforms the continuous vector field
q
C
into a discrete field
a
C
r
, where
a
is the vector of amplitudes
a
j
. The Euler-Lagrange equation (11) takes the form
Ma
σ
2
Qa
= 0
,
(22)
where
M
,
Q
C
r
×
r
,
M
ij
q
H
i
L
H
Q
a
Lq
j
, and
Q
ij
q
H
i
Q
b
q
j
. The eigenvectors
a
contain the amplitudes
a
j
which
optimally approximate the resolvent response modes and the
σ
are the approximate singular values. For
r
basis
elements we will have
M
,
Q
C
r
×
r
and thus we will obtain
r
eigenvalue/eigenvector pairs, representing
n
singular
mode/singular value pairs. The necessary
r
depends on both the efficiency of the model basis and the desired level of
accuracy. However, we show in the following examples that for large systems a reduction over the dimension of the
original system by up to two orders of magnitudes is possible due to the lack of matrix inversion. Throughout the
paper we use
r
to refer to the size of the reduced system (22) and
n
to refer to the size of the original system.
5
III. 1D RESOLVENT ANALYSIS: TURBULENT CHANNEL FLOW
A. The Orr-Sommerfeld Squire System
As a first example we consider the incompressible linearized NSE for streamwise constant fluctuations about a
turbulent mean in a wall bounded shear flow. This example illustrates the fundamental theory and highlights the
analytical manipulation enabled by the VRA framework. The equations are nondimensionalized using the channel
half-height and friction velocity. A Fourier transform in the homogeneous spatial directions and time results in a
system parametrized by the Reynolds number,
R
, and the wave number triplet,
k
= [
k
x
,k
z
]. Here
k
x
and
k
z
denote
the wavenumbers in streamwise and spanwise directions respectively, and
ω
again represents the temporal frequency.
We focus on streamwise constant fluctuations which are useful models of the streamwise elongated structures known
to play a crucial role in the sustenance of turbulence [29]. Therefore, for the remainder of
§
III we assume
k
x
= 0.
The forced linearized NSE can be written as
[
L
OS
0
̄
U
y
L
SQ
][
v
(
y
)
u
(
y
)
]
=
[
g
v
(
y
)
g
u
(
y
)
]
.
(23)
Here
y
[
1
,
1] and [
v,u
] are the wall-normal and streamwise velocity fluctuations about the streamwise, spanwise,
and temporal averaged mean velocity
̄
U
. The spanwise velocity is recovered through the continuity equation as
w
=
ik
1
z
v
y
. The right hand side [
g
v
,g
u
]
T
represents an unknown forcing. The relevant boundary conditions are thus
v
(
±
1) =
v
y
(
±
1) =
u
(
±
1) = 0. Note that we write (23) in terms of
u
instead of the classical formulation in terms of
the wall normal vorticity
η
=
ik
z
u
ik
x
w
, since if
k
x
= 0 then
u
η
. Note that this implies that the off-diagonal term
in (23) does not include the
ik
z
present in more classical formulations. The Orr-Sommerfeld and Squire operators in
(23) simplify to
L
OS
=
2
1
R
4
(24)
L
SQ
=
1
R
2
(25)
where
2
yy
k
2
z
. The inner product defining the kinetic energy norm is
q
i
,
q
j
KE
≡〈
v
i
v
j
+
k
2
z
v
i,y
v
j,y
+
u
i
u
j
(26)
where
f
(
y
)
〉 ≡
1
1
f
(
y
)
dy
,
q
= [
v,u
], and
q
KE
=
q
,
q
KE
. It is convenient to also define the following norm
associated with the OS operator induced by
〈·〉
OS
≡〈
v
i
v
j
+
k
2
z
v
i,y
v
j,y
(27)
which represents the contribution of
v
(and thus
w
) to the kinetic energy and where again the norm is defined as
v
OS
=
v,v
OS
. Lastly, it is numerically convenient to implement (23) as
[
2
L
OS
0
̄
U
y
L
SQ
][
v
u
]
=
[
2
g
v
g
u
]
=
[
̃
g
v
g
u
]
.
(28)
In order to compare our variational results to the direct SVD we use the definition (28) going forward.
B. The Orr-Sommerfeld and Squire Families
It is instructive to decompose the system into the Orr-Sommerfeld (OS) and Squire (SQ) families of modes as
suggested by Rosenberg and McKeon [15]. The OS family corresponds to the forced response due to
g
v
,
[
2
L
OS
0
̄
U
y
L
SQ
][
v
OS
u
OS
]
=
[
̃
g
v
0
]
(29)
which upon elimination of ̃
g
v
from the equation for
u
OS
results in a decoupled system reminiscent of the classical
OS/SQ decomposition of linear stability theory [22, 30].
2
L
OS
v
OS
= ̃
g
v
(30)
6
L
SQ
u
OS
=
̄
U
y
v
OS
(31)
The SQ family of modes, on the other hand, is the forced response to
g
u
, where by construction
v
SQ
= 0.
L
SQ
u
SQ
=
g
u
(32)
Since (32) is a normal scalar operator, the resolvent forcing and response modes are proportional to the eigenmodes
of
L
SQ
, and the singular values are equal to the inverse of the norm of the eigenvalues of
L
SQ
.
ψ
SQ
j
(
y
) =
[
0
,
sin
(
2
(
y
+ 1)
)]
(33)
φ
SQ
j
(
y
) =
[
0
,e
i
arctan
(
4
π
2
j
2
+4
k
2
z
)
sin
(
2
(
y
+ 1)
)
]
(34)
σ
SQ
j
=
(
1
16
R
2
(
π
2
j
2
+ 4
k
2
z
)
2
+
ω
2
)
1
/
2
(35)
The problem thus reduces to finding the OS family of modes associated with (29), which in accordance with
§
II,
are defined as the stationary points of the associated Lagrangian
L
(
q
OS
)
=
‖∇
2
L
OS
v
OS
||
2
OS
σ
2
q
OS
||
2
KE
(36)
where
q
OS
[
v
OS
,u
OS
] and we have made use of the fact that
g
u
= 0 to simplify the operator norm. In order to
eliminate the streamwise velocity
u
OS
we expand the solution to (31) in eigenfunctions of
L
SQ
given by (33).
u
OS
=
1
λ
SQ
n
v
OS
̄
U
y
u
SQ
n
u
SQ
n
(37)
This allows us to write the kinetic energy constraint as
q
2
KE
=
〈|
v
|
2
+
k
2
z
|
v
y
|
2
+
|
u
(
v
)
|
2
=
v
2
KE
(38)
where the third term
u
(
v
)
2
is given by the square of (37). This allows us to rewrite (36) as
L
(
v
OS
)
=
‖∇
2
L
OS
v
OS
||
2
OS
σ
2
v
OS
||
2
KE
(39)
with associated Euler-Lagrange equation
δ
δv
(
‖∇
2
L
OS
v
OS
||
2
OS
σ
2
v
OS
||
2
KE
)
= 0
.
(40)
For
k
x
= 0, the eigenfunctions of
L
OS
may also be derived analytically [2, 31]. Using standard methods they are
found to be
v
j
(
y
;
k
z
) =
A
j
[cos (
γ
j
(
y
+ 1))
cosh (
k
z
(
y
+ 1))] +
B
j
[
sin (
γ
j
(
y
+ 1))
γ
j
k
1
z
sinh (
k
z
(
y
+ 1))
]
(41)
λ
OS
j
=
1
R
(
γ
2
j
+
k
2
z
)
(42)
where
A
j
,B
j
and
γ
j
are defined in appendix B and satisfy
L
OS
v
j
=
λ
OS
j
2
v
j
and
v
i
,v
j
OS
=
δ
ij
. Expanding the
solution to (40) in the basis of OS eigenfunctions (41) such that
v
OS
=
a
m
v
m
(43)
allows us to transform the variation into an optimization over the coefficients
a
j
.
∂a
(
‖∇
2
L
OS
a
j
v
j
2
OS
σ
2
(
a
j
v
j
2
KE
1)
)
=
∂a
(
|
λ
OS
j
|
2
a
2
j
σ
2
a
i
a
j
(
δ
ij
+
U
in
U
H
nj
)
)
= 0
(44)
7
Here the quantity
U
in
represents the projection of the OS eigenfunctions onto the SQ eigenfunctions through (37).
U
in
≡−
1
λ
SQ
n
v
i
̄
U
y
u
SQ
n
(45)
Upon carrying out the above differentiation with respect to
a
we find the eigenvalue problem
Λ
OS
2
a
=
σ
2
(
I
+
UU
H
)
a
(46)
where
Λ
OS
ij
=
|
λ
OS
i
|
2
δ
ij
. The eigenvectors
a
correspond to the the coefficients which optimally represent the resolvent
response modes of the system (29) as a linear combination of the eigenbasis (41).
ψ
OS
j
= [
a
j
m
v
m
,u
(
a
j
m
v
m
)]
(47)
The singular values
σ
j
are given by the eigenvalues of (46) and the forcing modes are recovered through
φ
OS
j
= [
σ
j
2
L
OS
v
OS
j
,
0] = [
σ
j
λ
OS
m
a
j
m
v
m
,
0]
.
(48)
Together with Squire family of resolvent modes (33-35) the Orr-Sommerfeld family given by (47) and (48) fully describe
the resolvent basis. In Figures 1 we plot the real part of the variationally reconstructed Orr-Sommerfeld response and
forcing modes along side their numerically computed counterparts for the wave number triplet [
k
x
,k
z
] = [0
,
6
,
0
.
1]
and
R
= 1000. The singular values plots are plotted in 2a. For this example, the VRA model uses
r
=
N
OS
= 20
basis elements, this value is chosen to show a balance between the accuracy and model reduction capabilities of the
method. Although for this example the computational cost is trivial, the reduction in size of the relevant matrices
and avoiding the need for matrix inversion reduces the computation time by two orders of magnitude. To quantify
the convergence of our method we plot in Figure 2 the error in the VRA reconstruction of
v
,
u
, and
σ
as a function of
the number of retained OS eigenfunctions (
r
=
N
OS
) included in the variational reconstruction. The error is defined
as
e
q
=
1
1
|
q
svd
q
var
|
2
dy
(49)
where
q
=
u,v
and the subscripts
var
and
svd
denote the quantities computed using the VRA model and direct SVD
respectively. In all cases we observe monotonic convergence. In this this example the VRA model is extremely effective
at reconstructing the results of the direct SVD since our model basis exactly spans the range of
L
OS
.
C. Analytical approximation of
ψ
1
In this section we demonstrate how, under certain assumptions, the variational resolvent formulation allows for the
analytical approximation of the leading OS resolvent mode
ψ
OS
1
. Written explicitly, the Lagrangian associated with
(23) is
L
(
v
) =
(
ω
2
(
2
v
)
2
+
1
R
2
(
4
v
)
2
)
+
1
k
2
z
(
ω
2
(
2
v
y
)
2
+
1
R
2
(
4
v
y
)
2
)
1
σ
2
1
(
u
(
v
)
2
+
v
2
+
k
2
z
v
2
y
)
(50)
where
u
is the solution to
iωu
1
R
2
u
=
̄
U
y
v.
(51)
Here
u
and
v
are the streamwise and wall normal components of
ψ
OS
1
and
σ
1
is the leading OS singular value. The
associated Euler-Lagrange equation written in terms of
v
is then
1
k
2
z
(
1
R
2
10
+
ω
2
6
)
v
+
1
σ
2
1
(
(
L
1
SQ
̄
U
y
)
H
L
1
SQ
̄
U
y
v
1
k
2
z
2
v
)
= 0
(52)
with boundary conditions
v
(
±
1) =
v
y
(
±
1) =
u
(
±
1) = 0. Note that we use the the original definition (23) not the
numerical implementation (28) to derive (52). This is done to avoid the analytically cumbersome treatment of the
2
operator. The problem is now parameterized by
ω
,
R
, and
k
z
. Our analysis will consider the appropriate limits
of each in turn.
8
FIG. 1: Real part of the wall normal component
v
(a), streamwise component
u
(b), and forcing
g
v
(c) of the of the
1
st
, 3
rd
, and 5
th
, Orr-Sommerfeld family of resolvent modes. Real part (left column), imaginary part (right column).
Reference modes computed via direct SVD are shown in solid lines, VRA reconstruction using 20 basis eigenmodes
is shown in symbols.
k
z
= 6,
ω
= 0
.
1, and
R
= 1000.
FIG. 2: Orr-Sommerfeld family of singular values (a) with reference values computed via direct SVD in red, and
variational reconstruction using 20 basis eigenmodes in black. Error in variational reconstruction as a function of
basis elements in
σ
j
(b),
v
j
(c), and
u
j
(d) of
ψ
j
for
j
= 1
,
3
,
5
,
7
,
9.
k
z
= 6,
ω
= 0
.
1, and
R
= 1000 as a function of
the retained basis elements
r
=
N
OS
.
9
It has been shown that for
k
x
= 0 the most linearly amplified frequency is
ω
= 0, therefore we will consider the
limit as
ω
0. Since, in this limit (52) is regularly perturbed problem, the leading order solution may be found by
simply setting
ω
= 0. We may further simplify (52) by considering a high Reynolds number limit
R
→ ∞
. Analysis
of (29) reveals that for
ω
= 0,
σ
1
R
2
as
R
→ ∞
(see appendix C). This allows us introduce the small parameter

R
1
such that (52) and (51) take the form
1
k
2
z
10
v
+

2
̃
σ
2
1
(
1

2
(
2
̄
U
y
)
H
2
̄
U
y
v
1
k
2
z
2
v
)
= 0
(53)

2
u
0
=
̄
U
y
v
(54)
where ̃
σ
6
=
f
(
R
). We note that (54) implies that
v
u
and expand the solution in an asymptotic series.
v
=
v
1
+

2
v
2
+
O
(

3
)
u
=
u
0
+
u
1
+

2
u
2
+
O
(

3
)
(55)
The leading order solution to (53) and (54) then satisfy
1
k
2
z
10
v
1
+
1
̃
σ
2
1
(
(
2
̄
U
y
)
H
2
̄
U
y
v
1
)
= 0
(56)
2
u
0
=
̄
U
y
v
1
(57)
and the norm constraint takes the form
u
0
2
= 1
.
(58)
In this work we focus on the leading order solution, and thus to avoid notational clutter we drop the subscripts
0
and
1
moving forward.
While we have managed to eliminate the nonlinearity, the second term in (56) remains prohibitive to analytical
progress. In order to proceed we consider the
y
→−
y
symmetry of (23) which dictates that the resolvent modes come
in pairs, one of which is even about the center of the channel, and one of which is odd. If additionally, the modes
have compact support, as is generally the case, we have
ψ
1
(
y
) =
ψ
1
(
y
) =
ψ
2
(
y
) =
ψ
2
(
y
), and therefore it is
sufficient to solve for the mode shape in one half of the domain.
We assume that
v
is indeed locally supported and thus introduce the scaling
Y
=
k
z
|
y
±
1
|
under the assumption
k
z

1 and make the transformation
u
(
y
)
,v
(
y
)
U
(
Y
)
,V
(
Y
). If we formally take the limit as
k
z
→ ∞
we may
transform the domain from
y
[
1
,
1], to the “semi-infinite” half channel:
Y
[0
,
] and recover the solution in the
other half through
ψ
1
(
y
) =
ψ
1
(
y
) =
ψ
2
(
y
) =
ψ
2
(
y
).
Finally, in order to make progress we require some suitable approximation of the mean velocity profile. Since we
are working within a high Reynolds number limit we choose to assume that the mean velocity obeys a logarithmic
profile over the entirety of the semi-infinite domain. This is a reasonable assumption since in high Reynolds number
channel flow the log-law applies to a large fraction of the channel. Our approach thus implicitly assumes the support
of the resolvent modes is localized within this region where the log-law approximation is valid. The mean shear is
then given in our scaled variables by
̄
U
Y
=
k
z
(
κY
)
1
, where
κ
is the Von Karman constant. We note that the mean
shear diverges as like
Y
1
as
Y
0, however, since
V
(0) =
V
Y
(0) = 0 we have
V
(
Y
)
Y
2
as
Y
0, and thus the
right hand side of (57) remains bounded as
Y
0.
Inspection of (57) and (58) reveals that the appropriate scaling of the velocity components is given by
̃
U
(
Y
) =
k
1
/
2
z
U
(
Y
) and
̃
V
(
Y
) =
k
3
/
2
z
V
(
Y
). Additionally, we define the scaled Laplacian
̃
2
Y Y
1 such that
2
k
2
z
̃
2
,
and note that for
k
x
=
ω
= 0 and
k
z
→∞
the singular value scales as ̃
σ
1
k
3
z
(see appendix C). Thus we can write
(56) in our scaled variables as
10
̃
V
+
1
κ
2
k
4
z
γ
2
1
(
(
̃
2
Y
1
)
H
̃
2
Y
1
)
̃
V
= 0
(59)
where
γ
1
is a constant. We expand
̃
U
and
̃
V
in asymptotic series
̃
V
=
̃
V
0
+
k
4
z
̃
V
1
+
O
(
k
8
z
)
̃
U
=
̃
U
0
+
k
4
z
̃
U
1
+
O
(
k
8
z
)
(60)
10
which upon substitution into (59) allows us to eliminate the norm constraint at leading order and reduce the problem
of deriving the leading OS resolvent mode to
̃
10
̃
V
= 0
(61)
̃
2
̃
U
=
1
κY
̃
V
(62)
where we have again dropped the subscripts to avoid notational clutter. The relevant boundary conditions are
̃
V
(0) =
̃
V
Y
(0) =
̃
U
(0) =
̃
V
(
) =
̃
U
(
) = 0. The remaining constants of integration are then chosen such that
‖∇
2
L
OS
V
2
OS
is minimized and
U
2
= 1. Here we choose to minimize
‖∇
2
L
OS
V
2
OS
instead of
L
OS
V
2
OS
in
order to facilitate comparison with the numerically computed modes. However, we note that minimizing the latter
functional leads to a very similar solution. Using standard methods the solutions satisfying the boundary conditions
are found to be
V
(
Y
) =
k
3
/
2
z
R
(
a
+
bY
+
cY
2
)
Y
2
e
Y
(63)
U
(
Y
) =
k
1
/
2
z
24
κ
(
3
cY
3
+ (4
b
+ 6
c
)
Y
2
+ (6
a
+ 6
b
+ 9
c
) (
Y
+ 1)
)
Y e
Y
(64)
The three remaining constants of integration,
a,b,c
, are found by minimizing
‖∇
2
L
OS
V
2
OS
subject to the constraint
U
2
= 1. Straight forward integration results in
‖∇
2
L
OS
V
2
OS
=
1
R
2
‖∇
2
V
2
OS
= 4
k
6
z
R
4
(
6
a
2
+ 9
b
2
+ 36
bc
+ 72
c
2
)
(65)
and
U
2
=
1
κ
2
(
7
32
a
2
+
1
128
(112
b
+ 228
c
)
a
+
31
32
b
2
+
351
64
bc
+
1089
128
c
2
)
= 1
.
(66)
Minimizing (65) subject to (66) results in the eigenvalue problem
12 0
0
0 18 36
0 36 144
a
b
c
=
1
σ
2
1
(
R
4
4
κ
2
k
6
z
)
7
/
16
7
/
8
9
/
4
7
/
8 31
/
16 351
/
64
9
/
4 351
/
64 1089
/
64
a
b
c
.
(67)
Assuming
κ
= 0
.
4 the minimizing solution that satisfies the norm constraint is found to be
[
a,b,c
] = [0
.
1283
,
0
.
1066
,
0
.
0431]
1
2
.
(68)
The leading singular value is
σ
1
=
‖∇
2
L
OS
1
OS
=
R
2
2
k
3
z
.
(69)
The wall normal component
g
v
of the optimal resolvent forcing mode
φ
OS
1
is recovered through
2
g
v
=
σ
1
L
OS
v
(70)
subject to the boundary conditions
g
v
(
±
1) = 0. Using (69) and letting
g
v
(
y
)
G
V
(
Y
) this takes the form
̃
2
G
v
(
Y
) =
σ
1
L
OS
v
=
R
2
k
z
̃
4
V
(
Y
)
.
(71)
The solution satisfying the boundary condition
G
V
(0) = 0 is found to be
G
V
(
Y
) =
k
1
/
2
z
(
4
cY
3
+ (3
b
6
c
)
Y
2
+ (2
a
3
b
)
Y
)
e
Y
.
(72)
11
FIG. 3: Optimal resolvent modes:
v
(a),
u
(b),
g
v
(c) and singular value (d) for
k
x
= 0,
ω
= 0
,R
= 10
,
000 and a
range of
k
z
. Numerically calculated modes shown in colored lines, analytically derived modes are shown in the black
open circles. From light to dark, colors indicate increasing
k
z
from 6 to 100.
The solutions (63), (64), and (72) with optimal coefficients (68) are plotted in Figure 3 alongside numerically
computed resolvent modes for
R
= 10
,
000 and
ω
= 0 over a range of
k
z
. Note that for
k
x
= 0, and
ω
0 the
symmetries of (28) result in numerical resolvent modes with constant arbitrary phase, which for ease of comparison
we set to zero. With the exception of the
u
component for the smallest wave number (
k
z
= 6), the derived scaling laws
lead to reasonable collapse in both the numerically computed resolvent response and forcing modes. As
k
z
1 the
assumption of local support in
y
is no longer valid. In this limit
ψ
1
tends to have significant support at the channel
center.
For the response modes the analytically-derived mode accurately predicts the shape, amplitude, and localization
of the numerically computed modes. The analytical prediction of the wall normal velocity is most accurate for the
largest wave numbers, tending to slightly over predict the amplitude of the smaller wave number modes. This is
most likely due to the fact that the amplitude of
v
is smaller by a factor of
R
= 10
,
000 and is thus susceptible to
some numerical uncertainty since it does not meaningfully contribute to the norm. The streamwise velocity more
closely obeys the derived scaling laws, and thus the analytical model accurately predicts the shape of the numerically
computed modes for all
k
z
>
6.
The prediction of the forcing mode is slightly less accurate. While we capture the location and amplitude of the
peak, the model underpredicts the true mode closer to the wall. The discrepancy in the forcing despite accurate
reconstruction of the response is due to the sensitivity of the action of linear operator
f
=
L
OS
v
to perturbations in
the argument
v
. This is discussed in detail in
§
VI.
Finally, in Figure 3 we also plot the numerically computed leading singular values along side the analytical prediction
(69). While the analytically obtained value of
σ
1
slightly under-predicts the true singular values for the smaller values
of
k
z
, the numerical singular values do converge to the analytical prediction with increasing
k
z
, consistent with the
assumption made in our model that
k
z

1. This under prediction is consistent with the fact that the true singular
value represents the global maximum gain.
12
IV. 2D RESOLVENT ANALYSIS: PERIODIC MEAN FLOW
In this section we use VRA to efficiently and accurately compute resolvent modes about a 2D/3C mean flow. We
consider the equilibrium solution EQ1 found in plane Couette flow by Nagata [32]. The data was obtained from the
open-source database
channelflow.org
[33, 34]. In this case the flow has two non-homogeneous spatial dimensions, the
wall normal direction
y
[
1
,
1] and the spanwise direction
z
[
L
z
/
2
,L
z
/
2] with
L
z
= 0
.
8
π
. The spanwise periodic
EQ1 solution is shown in Figure 4. The 2D/3C resolvent modes computed about this flow are then parameterized
by the streamwise wavenumber and frequency pair, [
k
x
]. We choose as our modeling basis the local 1D resolvent
modes about the mean flow
̄
U
(
y
) given by the spanwise average of the EQ1 solution:
q
j
(
y,z
) =
ψ
1
D
j
(
y
;
k
z
,k
x
,c
)
e
ik
z
z
.
In other words, we seek to approximate the 2D/3C resolvent modes from the 1D resolvent basis as
ψ
2
D
(
y,z
;
k
x
,c
) =
a
j
q
j
(
y,z
)
.
(73)
The expansion coefficients
a
j
are found by solving the eigenvalue problem
Ma
σ
2
Qa
= 0
(74)
where
M
i,j
=
L
2
D
q
i
,
L
2
D
q
j
, and
Q
i,j
=
q
i
,q
j
. The operator
L
2
D
is the NS operator, in velocity-vorticity form,
linearized about the 2D/3C mean flow, the details of which are discussed in Rosenberg and McKeon [35]. The operator
is discretized in
N
y
= 33 Chebychev points in the wall normal direction, and
N
z
= 32 linearly spaced points in the
spanwise direction, for a total of
N
2
D
= 2
×
N
y
×
N
z
= 2112 degrees of freedom.
The 1D resolvent modes are computed for the same
k
x
as the 2D modes, and a range of
N
c
= 3 linearly spaced
wavespeeds 0
.
8
c
c
1
D
1
.
2
c
where
c
=
ω/k
x
. We use a range of
c
1
D
since the 2D mode is expected to be localized
near but not necessarily exactly at the critical layer where
c
=
̄
U
(
y
). To account for the variation in
z
we include a
range of
N
k
z
= 11 spanwise wavenumbers
k
z
= [
5
...
0
...
5]
×
2
π/L
z
. We found that increasing the number of retained
harmonics beyond this range did not meaningfully change the results. At each wave number triplet [
k
x
,k
z
,c
] we
include
N
SV D
= 8 resolvent modes, resulting in a total of
r
=
N
c
×
N
k
z
×
N
SV D
= 254 degrees of freedom. These
values were chosen to demonstrate a balance between accuracy and the cost saving potential of the proposed method
(The reader is referred to Appendix D for an illustration of some representative basis elements). Once
L
2
D
is known,
the construction of the matrices
M
and
Q
takes approximately 0.5 seconds and the associated eigendecomposition
takes approximately 0.01 seconds on a personal laptop. Meanwhile, the inversion and direct truncated SVD of the
original system takes approximately 5 seconds using the built in Matlab functions
mldivide
() and
svds
().
In Figures 5 and 6 we compare the real part of the first four resolvent response modes of the variational reconstruction
and the modes computed directly through the SVD of the 2D resolvent for
k
x
= 0
.
5 and
c
= 0
.
75 and
R
= 400. The
variational approach very accurately reconstructs the true response modes considering the significant reduction in
computational complexity.
In Figures 7 and 8 we plot resolvent forcing modes computed from the response modes through
φ
j
=
σ
j
L
2
D
ψ
j
.
Interestingly we find that while the
g
v
component is reproduced accurately the
g
η
component shows significant
discrepancy. While the qualitative shape of the
η
component of the forcing mode is predicted by the VRA model, the
mode is contaminated by higher harmonics. This contamination observed in the VRA reconstruction of the forcing
modes,
φ
j
, despite the accurate reconstruction of the response modes,
ψ
j
, is due to the directional amplification of
the resolvent operator or equivalently, a sensitivity of the action of the linear operator
L
2
D
q
, to perturbations in the
input
q
. This phenomenon is discussed in detail in
§
VI.
Additionally, in Figure 9a we compare the variationally computed singular values with the true values computed via
direct SVD. The singular values are estimated relatively accurately, with our model tending to slightly underestimate
the leading singular values. As before, the true singular values represent the optimal gains and the predicted singular
values are bounded above by the true values. For this example there is no significant separation of singular values, in
other words the resolvent operator is not low rank, and yet our method still accurately predicts the singular values
and resolvent response modes.
In order to quantify the convergence properties of the proposed method, for this example we fix
c
1
D
=
c
2
D
, include
k
z
= [
5
...
0
...
5]
×
2
π/L
z
such that
N
c
= 1 and
N
k
z
= 11 and compute the error as a function of the number of
retained singular modes
N
SV D
. The error is based on the kinetic energy norm and is defined as
e
1
2
L
z
L
z
0
1
1
|
ψ
2
D
svd
ψ
2
D
vra
|
2
dydz
(75)
where
ψ
= [
u,v,w
]. The error is plotted in Figure 9 alongside the relative error in singular values for two values of
the wave speed,
c
= 0
.
75 and
c
= 0. The former corresponds to the example plotted in Figures 5 through 9a where
there is no significant singular value separation. The latter case corresponds to a case where the 2D/3C resolvent is
13
FIG. 4: Exact coherent state EQ1 at
R
= 400 used to compute 2D/3C resolvent modes. Clockwise from top left:
U
(
y,z
),
V
(
y,z
),
W
(
y,z
), and spanwise average
̄
U
(
y
) used to compute the 1D basis modes.
more low rank, (
σ
1
2
6). In both cases our method is not only able to accurately approximate the leading singular
mode and value but also a large range of suboptimal modes and singular values. Interestingly, we see that our method
is more accurate in the case where there is less singular value separation. Furthermore, for the low rank case, (
c
= 0)
the largest error in singular value is for
σ
1
. Again, these findings are a result of the directional nature of the resolvent
operator and are discussed in detail in
§
VI.