We have so far reviewed abstract algebras, function algebras, and endomorphism algebras. We now come to the convolution algebra of a finite group
. As a vector space, this is not just isomorphic but literally equal to
. However, the two are quite different as algebras, and to emphasize this we will write
for the elementary function corresponding to
rather than
Then, the convolution product of two elementary functions in
is
where is the group product. This is not at all the same as the point wise product rule
. Extending the above bilinearly, we get that the convolution of any two functions
in is
or equivalently
In particular, the multiplicative identity in is
where
is the group identity.
Conjugation is also defined differently in then in
: it is defined by anti linearly extending the rule
so that
In particular, the elementary basis of
consists of unitary elements, so it is definitely not a Fourier basis. Nevertheless, we have the following important result.
Theorem C1. If is abelian, then
and
are isomorphic algebras.
The converse of Theorem C1 is also true, since any algebra isomorphic to a function algebra must be commutative and it is easy to show that is commutative precisely when
is abelian.
Theorem C1 means that the convolution algebra contains a “hidden” Fourier basis. The construction of this hidden Fourier basis and the corresponding Fourier transform is a sacred part of applied algebra, the theory of the Discrete Fourier Transform (DFT), and you must be DTF with the DFT.
The construction of the hidden Fourier basis in leverages the structure of the underlying abelian group
. Namely, a multiplicative character of
is a group homomorphism
where is the unit circle in the complex plane. The set of all multiplicative characters is denoted
and called the dual group of
when equipped with point wise multiplication.
Theorem C2. The dual group is indeed a group, and it is isomorphic to
.
This result can be proved directly, but to use it efficiently my preference is to consider a third group isomorphic to both
and
which may be thought of as simultaneously parameterizing both of them. To construct
first recall that every finite abelian group is isomorphic to a product of cyclic groups, so we may without loss in generality assume that
where is a cyclic group of order
with generator
Let
so that explicitly
and parameterize by
as
At the same time, points of parameterize
.
Theorem C3. The set of multiplicative characters of
is given explicitly by the functions
where is the principal
th root of unity.
Now introduce the scalar product on in which
is an orthonormal basis. Explicitly, we have
Consider the functions in defined by
where
Theorem C4. The functions satisfy the scalar product orthogonality relation
Since is an orthogonal set in
, it is linearly independent, and since it has cardinality
it is a basis of
, called the character basis of
. Up to normalization, the character basis of
is a Fourier basis. More precisely, define
We then have the following
Theorem C5. The functions are a Fourier basis of
.
We can now take an arbitrary function , expand it in the Fourier basis,
and from the general theory of abstract algebras we immediately have that the map is an algebra isomorphism
Since
is isomorphic to
, simply because
and the function algebras of any two finite sets of the same cardinality are isomorphic, Theorem C1 is proved.
The Fourier transform on the convolution algebra of a finite abelian group has been studied extensively and is widely used. The following dual formulas frequently appear.
Theorem C6. Formula for the Fourier transform of ,
Recovery of a function from its Fourier transform,
There is also an important reciprocal relationship between and
which says that if one is highly concentrated, the other cannot be.
Theorem C7. For any nonzero function , we have
Also important and useful is the simultaneous implementation of the Fourier and Wedderburn transforms on the convolution algebra of a finite abelian group
. The Wedderburn transform takes an arbitrary function
and maps it to the linear operator
defined by
Writing for the Fourier basis of
, the general relationship between the Fourier transform and the Wedderburn transform says that the operator
belongs to the diagonal subalgebra
of
, and moreover that
What is important here is that we have explicit formulas both for the eigenfunctions and the eigenvalues
in terms of the multiplicative characters
of the underlying groups
, which are in turn explicitly describable in terms of roots of unity corresponding to the decomposition of
into a product of cyclic groups. You should be able to implement this architecture for various groups, e.g. the discrete circle
or the discrete hypercube