Math 202A: Review Lecture 3

After setting up the dichotomy between the classical computational category \mathbf{FSet} and the quantum computational category \mathbf{FHil}, we started to compare the two. This comparison begins with matrices: matrices over B=\{0,1\} suffice to encode both objects and morphisms in \mathbf{FSet}, whereas matrices over \mathbb{C} are needed to encode objects and morphisms in \mathbf{FHil} but the encoding works the same way. Change of ordering in the one-hot encoding of a finite set X is implemented by left multiplication by permutation matrices, whereas change of orthonormal basis in a finite-dimensional Hilbert space is implemented by left multiplication by unitary matrices; in this sense, unitary matrices are the quantum generalization of permutation matrices. Change of ordering in the source and target sets of \mathrm{Hom}(X,Y) corresponds to left and right multiplying the matrix encoding of morphisms by permutation matrices, while change of ordered orthonormal bases in the source and target spaces of \mathrm{Hom}(V,W) corresponds to left and right multiplying the matrix encoding of morphisms by unitary matrices.

A more interesting line of investigation is to consider the extent to which \mathrm{Hom}(V,W) can be enriched beyond \mathrm{Hom}(X,Y), i.e. made into something more than a set. First, the existence of a vector space structure on \mathrm{Hom}(V,W) is very straightforward, and in fact a special case of the fact that the set of functions from any set into a vector space is again a vector space under the pointwise operations.

It is also true that \mathrm{Hom}(V,W) is finite-dimensional. Let X \subset V and Y \subset W be orthonormal bases, which is the same thing as saying V is isomorphic to \mathcal{F}(X) and W is isomorphic to \mathcal{F}(Y). What we showed is that \mathrm{Hom}(V,W) is isomorphic to \mathcal{F}(Y \times X). Indeed, for each (y,x) \in Y \times X, define a corresponding elementary transformation E_{yx} \in \mathrm{Hom}(V,W) by

E_{yx}v = y\langle x,v\rangle, \quad v \in V.

We proved that \{E_{yx} \colon (y,x) \in X\} is a basis of \mathrm{Hom}(V,W), and indeed that for any A \in \mathrm{Hom}(V,W) we have

A = \sum\limits_{y \in Y}\sum\limits_{x \in X} \langle y,Ax\rangle E_{yx}.

This is a good way to present the information contained in the matrix of A relative to the orthonormal bases X \subset V and Y \subset W without having to choose orderings just to write things in an array.

The elementary basis E_{yx} of \mathrm{Hom}(V,W) relative to a pair of orthonormal bases X \subset V and Y \subset W also gives us a convenient way to analyze topological properties of arbitrary morphisms A \in \mathrm{Hom}(V,W). Indeed, for any v \in V we have that

\|E_{yx}v\|=\|y\langle x,v\rangle\|=\|y\||\langle x,v\rangle| \leq \|y\|\|x\|\|v\| = \|v\|,

where the inequality is Cauchy-Schwarz and we used the fact that x \in X and y \in Y are unit vectors. Thus, each morphism in the elementary basis \{E_{yx} \colon (y,x) \in Y \times X\} of \mathrm{Hom}(V,W) is a contractive mapping. Thus for an arbitrary morphism A \in \mathrm{Hom}(V,W),

A=\sum\limits_{y \in Y}\sum\limits_{x \in X} \alpha_{yx}E_{yx},

the triangle inequality gives us

\|Av\| \leq \|A\|_1 \|v\|, \quad v \in V,

where

\|A\|_1 \leq \sum\limits_{y \in Y}\sum\limits_{x \in X} |\alpha_{yx}|

is a norm on \mathrm{Hom}(V,W), specifically the 1-norm relative to the elementary basis E_{yx} of \mathrm{Hom}(V,W), which is itself defined relative to the orthonormal bases X \subset V and Y \subset W. This points us to a much better norm on \mathrm{Hom}(V,W), since the above tells us that every A \in \mathrm{Hom}(V,W) is not just continuous but Lipschitz, with Lipschitz constant bounded by \|A\|_1.

Definition 3.1. The operator norm \|A\| of A \in \mathrm{Hom}(V,W) is by definition its Lipshitz constant.

One of the many virtues of the operator norm is that it is basis independent: to define it we only need to know that all morphisms in \mathrm{Home}(V,W) are Lipschitz functions. Definition 3.1 does not care that we used orthonormal bases of V and W to establish Lipschitz continuity of linear transformations. On the other hand, one could argue that a demerit of the operator norm is that it is not induced by a scalar product.

Problem 3.1. Prove that there is no scalar product on \mathrm{Hom}(V,W) such that \|A\|=\sqrt{\langle A,A\rangle} coincides with the operator norm.

On the other hand, it is completely straightforward to promote \mathrm{Hom}(V,W) to a Hilbert space: we simply equip it with the scalar product in which \{E_{yx} \colon (y,x) \in Y \times X\} forms an orthonormal basis. This is the Frobenius scalar product on \mathrm{Hom}(V,W), and it is given explicitly as follows: for any A,B \in \mathrm{Hom}(V,W) we have

\langle A,B \rangle = \sum\limits_{y \in Y}\sum\limits_{x \in X} \overline{\langle y,Ax\rangle}\langle y,Bx\rangle.

Problem 3.2. Show that for any A,B \in \mathrm{Hom}(V,W) we have

\langle A,B \rangle = \sum\limits_{x \in X} \langle Ax,Bx\rangle.

The norm \|\cdot\|_2\| on \mathrm{Hom}(V,W) obtained from the Frobenius scalar product is called the Frobenius norm, and denoted

\|A\|_2 = \sum\limits_{y \in Y}\sum\limits_{x \in X} |\langle y,Ax\rangle|^2 = \sum\limits_{x \in X} \|Ax\|^2.

The problem with the above is that we don’t know whether we have built the Frobenius scalar product or a Frobenius scalar product: if we had performed this construction using two different orthonormal bases X^\prime \subset V and Y^\prime \subset W, would we have arrived at the same Hermitian form on \mathrm{Hom}(V,W)? We would like to know whether \|\cdot\|_2 is basis independent, like the operator norm \|\cdot\|, or whether it is basis dependent, like \|\cdot\|_1.

The answer is that the Frobenius scalar product is basis independent. A morphism U \in \mathrm{Hom}(V,W) such that \|Uv\|=\|v\| for every v \in V is called an isometry. Polarization shows that norm preservation is the same as scalar product preservation: U \in \mathrm{Hom}(V,W) is an isometry if and only if

\langle Uv_1,Uv_2 \rangle = \langle v_1,v_2 \rangle, \quad v_1,v_2 \in V.

Furthermore, every isometry is injective, so that an isometry in \mathrm{End}(V) is automatically an automorphism. Isometric automorphisms of V are also referred to as unitary operators. That’s right, there are two names for the same thing. While it might be better practice to never ever override general categorical terminology in category-specific settings, this is just one of many things about the world that could be improved. Even worse, if V and W are possibly different finite-dimensional Hilbert spaces with \dim V=\dim W, then again an isometry U \in \mathrm{Hom}(V,W) is automatically an isomorphism, and such isometric isomorphisms are also often called unitary transformations. Saints preserve us. The reason for this abuse of terminology is that the matrix of an isometric isomorphism U \in \mathrm{Hom}(V,W) is a unitary matrix even when the spaces V,W are not the same, just like the matrix of set isomorphism f \in \mathrm{Hom}(X,Y) is a permutation matrix even when X and Y are distinct sets.

Problem 3.3. Show that U \in \mathrm{End}(V) is a unitary operator if and only if the image \{Ux \colon x \in X\} of an orthonormal basis X \subset V under U is an orthonormal basis of V.

Problem 3.2 already removes the dependence of the Frobenius scalar product on a choice of orthonormal basis in the target space. Thus what is left to check is that for any orthonormal basis X \subset V and any unitary operator U \in \mathrm{End}(V) we have

\sum\limits_{x \in X} \langle AUx,AUx \rangle = \sum\limits_{x \in X} \langle Ax,Ax \rangle.

In other words, thanks to polarization, we only need to check that the Frobenius norm is unitarily invariant. We have

\left\langle AUx, AUx \right\rangle = \sum\limits_{y \in X}\sum\limits_{z \in X} \overline{\langle y,Ux\rangle}\langle z,Ux\rangle \langle Ay,Az\rangle.

Thus,

\sum\limits_{x \in X} \langle AUx,AUx \rangle = \sum\limits_{y,z \in X} \langle Ay,Az\rangle \sum\limits_{x \in X} \overline{\langle y,Ux\rangle}\langle z,Ux\rangle,

and to finish it remains only to establish the following, which is a consequence of Problem 3.3.

Problem 3.4. For any unitary operator U \in \mathrm{End}(V) and any orthonormal basis X \subset V, we have

\sum\limits_{x \in X} \overline{\langle y,Ux\rangle}\langle z,Ux\rangle=\delta_{yz}, \quad y,z \in X.

In the lectures I presented a different proof of unitary invariance of the Frobenius scalar product on \mathrm{Hom}(V,W) which was inductive in the dimension of W. The reason for doing this was that in the base case, \dim W=1, we are dealing with the dual space of V and this leads to a discussion of vectors and covectors (Riesz duality). However, I did not do a very good job with this discussion and therefore have decided to leave it out of the exam topics.

Leave a Reply