Math 202A: Review Lecture 4

The next stage in our comparison of the classical computational category \mathbf{FSet} and the quantum computational category focused on contrasting \mathrm{Hom}(X,Y) with \mathrm{Hom}(V,W) = \mathrm{Hom}(\mathcal{F}(X),\mathcal{F}(Y)). We have seen already that

|\mathrm{Hom}(X,Y)|= |Y|^{|X|},

which is a polynomial function of |Y| and an exponential function of |X|. Of course, the cardinality of \mathrm{Hom}(V,W) is infinite, but its quantum cardinality,

\dim \mathrm{Hom}(V,W) = |X||Y|,

is a linear function of |X| and a linear function of |Y|.

We now consider subobjects canonically associated to morphisms in \mathbf{FSet} and \mathbf{FHil}.

Associated to a morphism f \in \mathrm{Hom}(X,Y) is its image,

\mathrm{Im}(f) = \{f(x) \colon x \in X\},

which is a subset of the target Y. The cardinality of \mathrm{Im}(f) may be called the rank of the set function f. The rank of f is bounded by the cardinality of its source X, and we have \mathrm{rank}(f)=|X| if and only if f is injective. The rank of f is also bounded by the cardinality of its target Y, and we have \mathrm{rank}(f)=|Y| if and only if f is surjective. Thus,

\mathrm{rank}(f) \leq \min\left( |X|,|Y|\right).

A morphism f \in \mathrm{Hom}(X,Y) is said to have full rank if

\mathrm{rank}(f) = \min\left(|X|,|Y|\right).

In particular, a full rank function is either injective or surjective, but we cannot say which without knowing which of |X|,|Y| is larger. On the other hand, the concept of rank itself is an elementary combinatorial notion, and one can find an explicit formula for the number of rank r morphisms in \mathrm{Hom}(X,Y) in terms of Stirling numbers. Using this formula, one can show that the set of full rank morphisms in \mathrm{Hom}(X,Y) is small in comparison to the total cardinality |Y|^{|X|}.

Associated to a morphism A \in \mathrm{Hom}(V,W) is its image,

\mathrm{Im}(A) = \{f(v) \colon v \in V\},

which is a subspace of the target space W. The rank of the linear transformation A is the dimension of \mathrm{Im}(A). The rank of A is bounded by the dimension of V, and this bound is achieved if and only if A is injective. The rank of A is bounded by the dimension of W, and this bound is achieved if and only if A is surjective. Thus,

\mathrm{rank}(A) \leq \min(\dim V,\dim W).

A morphism A \in \mathrm{Hom}(V,W) is said to have full rank if this upper bound is achieved, and just like in the classical situation this means either that A is injective or surjective, but we cannot determine which without more information. What is very different in the quantum world is that a generic morphism in \mathrm{Hom}(V,W) has full rank.

Theorem 4.1. The set \mathrm{Hom}(V,W)_\text{f} of full rank morphisms in \mathrm{Hom}(V,W) is open and dense in the norm topology.

Note that we have two norms on \mathrm{Hom}(V,W), the operator norm and the Frobenius norm, and we did not specify which is being used in Theorem 4.1. This is because these two norms generate the same topology, as do all norms on a finite-dimensional vector space.

Theorem 4.1 is another way to motivate the long journey we took towards the Singular Value Decomposition. The first step on this journey is to recognize that the there is a second subobject associated to A \in \mathrm{Hom}(V,W) which has no classical counterpart, namely the kernel

\mathrm{Ker}(A)=\{v \in V \colon Av=0_W\},

which is a subspace of V. The dimension of \mathrm{Ker}(A) is called the nullity of A and denoted \mathrm{null}(A).

For an arbitrary morphism A \in \mathrm{Hom}(V,W), we have two affiliated spaces: \mathrm{Ker}(A) \leq V and \mathrm{Im}(A) \leq W. Consider the associated orthogonal decompositions,

V= \mathrm{Ker}(A)^\perp \oplus \quad\text{and}\quad W = \mathrm{Im}(A) \oplus \mathrm{Im}(A)^\perp.

The rank-nullity theorem says that the restriction of A to \mathrm{Ker}(A)^\perp is an isomorphism onto \mathrm{Im}(A). This result is purely algebraic, and does not involve in the Hilbert space structure on V and W. The Singular Value Decomposition may be viewed as a remarkable refinement of the rank-nullity theorem which uses the geometric structure of Hilbert space to achieve a much more precise description of morphisms in \mathbf{FHil}.

A nice observation we made is that one can guess what this mysterious enhanced decomposition looks like for morphisms A \in \mathrm{Hom}(V,W)=\mathrm{Hom}(\mathcal{F}(X),\mathcal{F}(Y)) which are quantizations of set maps, i.e. the case where A = \mathcal{F}(f) for f \in \mathrm{Hom}(X,Y). In this case, using purely combinatorial reasoning, one can construct an orthonormal basis for \mathrm{Ker}(A)^\perp and an orthonormal basis for \mathrm{Im}(A) such that the restriction of A to an isomorphism \mathrm{Ker}(A)^\perp \to \mathrm{Im}(A) has a very explicit description in terms of the combinatorial statistics of the underlying set function f. It is useful to review this combinatorial “bare hands” special case of the SVD for quantized set functions before starting down the geometric road to developing it for arbitrary morphisms in \mathrm{Hom}(V,W).

Leave a Reply