Weak convergence (Hilbert space)

In mathematics, weak convergence is a type of convergence of a sequence of points in a Hilbert space (and, more generally, in a Banach space).

Definition

A sequence of points $(x\_n)$ in a Hilbert space "H", with "n" an integer, is said to converge weakly to a point "x" in "H" if

:$langle\; x\_n,y\; angle\; o\; langle\; x,y\; angle$

for all "y" in "H". Here, $langle\; cdot,\; cdot\; angle$ is understood to be the scalar product on the Hilbert space. The notation

:$x\_n\; ightharpoonup\; x$

is sometimes used to denote this kind of convergence.

Weak topology

Weak convergence is in contrast to strong convergence or convergence in the norm, which is defined by

:$Vert\; x\_n\; -x\; Vert\; o\; 0$

where $Vert\; x\; Vert\; =\; sqrt\; \{langle\; x,x\; angle\}$ is the norm of "x".

The notion of weak convergence defines a topology on "H" and this is called the weak topology on "H". In other words, the weak topology is the topology generated by the bounded functionals on "H". It follows from Schwarz inequality that the weak topology is weaker than the norm topology. Therefore convergence in norm implies weak convergence while the converse is not true in general. However, if $langle\; x\_n,\; x\; angle\; o\; langle\; x,\; x\; angle$ and $|\; x\_n\; |\; o\; |x|$, then we have $|\; x\_n\; -\; x\; |\; o\; 0$ as $n\; o\; infty$.

On the level of operators, a bounded operator "T" is also continuous in the weak topology: If "x_n" → "x" weakly, then for all "y"

:$langle\; Tx\_n,\; y\; angle\; =\; langle\; x\_n,\; T^*\; y\; angle\; ightarrow\; langle\; x,\; T^*y\; angle\; =\; langle\; Tx,\; y\; angle.$

Properties

*Since every closed and bounded set is weakly relatively compact (under the weak topology, its closure is compact), every bounded sequence $x\_n$ in a Hilbert space "H" contains a weakly convergent subsequence. Note that closed and bounded sets are not in general weakly compact in Hilbert spaces (consider the set consisting of an orthonormal basis in an infinitely dimensional Hilbert space which is closed and bounded but not weakly compact since it doesn't contain 0). However, bounded and weakly closed sets are weakly compact so as a consequence every convex bounded closed set is weakly compact.

*As a consequence of the principle of uniform boundedness, every weakly convergent sequence is bounded.

*If $x\_n$ converges weakly to "x", then

:$Vert\; xVert\; le\; liminf\_\{n\; oinfty\}\; Vert\; x\_n\; Vert,$

and this inequality is strict whenever the convergence is not strong. For example, infinite orthonormal sequences converge weakly to zero, as demonstrated below.

*If $x\_n$ converges weakly to "x" and we have the additional assumption that lim ||"x_n"|| = ||"x"||, then "x_n" converges to "x" strongly:

:$langle\; x\; -\; x\_n,\; x\; -\; x\_n\; angle\; =\; langle\; x,\; x\; angle\; +\; langle\; x\_n,\; x\_n\; angle\; -\; langle\; x\_n,\; x\; angle\; -\; langle\; x,\; x\_n\; angle\; ightarrow\; 0.$

Weak convergence of orthonormal sequences

Consider a sequence $e\_n$ which was constructed to be orthonormal, that is,

:$langle\; e\_n,\; e\_m\; angle\; =\; delta\_\{mn\}$

where $delta\_\{mn\}$ equals one if "m" = "n" and zero otherwise. We claim that if the sequence is infinite, then it converges weakly to zero. A simple proof is as follows. For "x" ∈ "H", we have

:$sum\_n\; |\; langle\; e\_n,\; x\; angle\; |^2\; leq\; |\; x\; |^2$

where equality holds when {"e"_"n"} is a Hilbert space basis. Therefore

:$|\; langle\; e\_n,\; x\; angle\; |^2\; ightarrow\; 0$

i.e.

:$langle\; e\_n,\; x\; angle\; ightarrow\; 0\; .$

Banach-Saks theorem

The Banach-Saks theorem states that every bounded sequence $x\_n$ contains a subsequence $x\_\{n\_k\}$ and a point "x" such that

:$frac\{1\}\{N\}sum\_\{k=1\}^N\; x\_\{n\_k\}$

converges strongly to "x" as "N" goes to infinity.

Generalizations

The definition of weak convergence can be extended to Banach spaces. A sequence of points $(x\_n)$ in a Banach space "B" is said to converge weakly to a point "x" in "B" if

:$f(x\_n)\; o\; f(x)$

for any scalar-valued bounded linear operator $f$ defined on $B$, that is, for any $f$ in the dual space $B\text{'}.$ If $B$ is a Hilbert space, then, by the Riesz representation theorem, any such $f$ has the form

:$f(x)=langle\; x,y\; angle$

for some $y$ in $B$, so one obtains the Hilbert space definition of weak convergence.