Frame of a vector space
||It has been suggested that Frame (signal processing) be merged into this article. (Discuss) Proposed since January 2015.|
In linear algebra, a frame of a vector space V with an inner product can be seen as a generalization of the idea of a basis to sets which may be linearly dependent. Frames were introduced by Duffin and Schaeffer in their study on nonharmonic Fourier series. They remained obscure until Mallat, Daubechies, and others used them to analyze wavelets in the 1980s. Some practical uses of frames today include robust coding and design and analysis of filter banks.
The key issue related to the construction of a frame appears when we have a sequence of vectors , with each and we want to express an arbitrary element as a linear combination of the vectors :
and want to determine the coefficients . If the set does not span , then such coefficients do not exist for every such . If spans and also is linearly independent, this set forms a basis of , and the coefficients are uniquely determined by : they are the coordinates of relative to this basis. If, however, spans but is not linearly independent, the question of how to determine the coefficients becomes less apparent, in particular if is of infinite dimension.
Given that spans and is linearly dependent, a strategy is to remove vectors from the set until it becomes linearly independent and forms a basis. There are some problems with this plan:
- By removing vectors arbitrarily from the set, it may lose its possibility to span before it becomes linearly independent.
- Even if it is possible to devise a specific way to remove vectors from the set until it becomes a basis, this approach may become infeasible in practice if the set is large or infinite.
- In some applications, it may be an advantage to use more vectors than necessary to represent . This means that we want to find the coefficients without removing elements in . The coefficients will no longer be uniquely determined by . Therefore, the vector can be represented as a linear combination of in more than one way.
In 1952, Duffin and Schaeffer gave a solution to this problem, by describing a condition on the set that makes it possible to compute the coefficients in a simple way. More precisely, a frame is a set of elements of V which satisfy the so-called frame condition:
- There exist two real numbers, A and B such that and
- This means that the constants A and B can be chosen independently of v: they only depend on the set .
The numbers A and B are called lower and upper frame bounds respectively. Note that the frame bounds A and B are not unique because numbers less than A and greater than B are also considered frame bounds. The optimal upper bound is the infimum of all upper bounds. Likewise, the optimal lower bound is the supremum of all lower bounds. The optimal bounds are in fact frame bounds as well.
We say that a frame is overcomplete or redundant if it is not a basis. Intuitively, we can think of a frame as an "overcomplete" basis.
It can be shown that the frame condition entails the existence of a set of dual frame vectors with the property that
for any . This implies that a frame together with its dual frame has the same property as a basis and its dual basis in terms of reconstructing a vector from scalar products.
Relation to bases
If the set is a frame of V, it spans V. Otherwise there would exist at least one non-zero which would be orthogonal to all . If we insert into the frame condition, we obtain
therefore , which is a violation of the initial assumptions on the lower frame bound.
If a set of vectors spans V, this is not a sufficient condition for calling the set a frame. As an example, consider with the dot product, and the infinite set given by
This set spans V but since , we cannot choose . Consequently, the set is not a frame.
Types of frames
A frame is tight if the frame bounds and are equal. This means that the frame obeys a generalized Parseval's identity. For example, the union of orthonormal bases of a vector space forms a tight frame with . If , then a frame is either called normalized or Parseval. However, some of the literature refers to a frame for which for all where is a constant independent of (see uniform below) as a normalized frame.
A frame is uniform if each element has the same norm: for all where is a constant independent of . A uniform normalized tight frame with is an orthonormal basis.
The frame condition is both sufficient and necessary for allowing the construction of a dual or conjugate frame, , relative to the original frame, . The duality of this frame implies that
is satisfied for all . In order to construct a dual frame, we first need the linear mapping: defined as
The linear mapping is called the frame operator of the frame .
From this definition of and linearity in the first argument of the inner product, it follows that
which can be inserted into the frame condition to get
The properties of can be summarised as follows:
- The frame operator is self-adjoint, positive definite, and has positive upper and lower bounds.
- The inverse of exists and it, too, is self-adjoint, positive definite, and has positive upper and lower bounds.
The dual frame is defined by mapping each element of the frame with :
To see that this makes sense, let be arbitrary and set
It is then the case that
which proves that
Alternatively, we can set
By inserting the above definition of and applying known properties of and its inverse, we get
which shows that
The numbers are called frame coefficients. This derivation of a dual frame is a summary of Section 3 in the article by Duffin and Schaeffer. They use the term conjugate frame for what here is called a dual frame.
Note that the dual frame is called the canonical dual of because it acts similarly as a dual to its basis.
When the frame is overcomplete, a vector can be written as a linear combination of in more than one way. That is, there exist different choice of coefficients such that . This allows us some freedom for the choice of coefficients other than . It is necessary that the frame is overcomplete for other such coefficients to exist. If so, then there exist frames for which
for all . We call a dual frame of .
- Christensen, Ole (2003). An Introduction to Frames and Riesz Bases. Applied and Numerical Harmonic Analysis. Birkhäuser. doi:10.1007/978-0-8176-8224-8. MR 1946982.
- Duffin, Richard James; Schaeffer, Albert Charles (1952). "A class of nonharmonic Fourier series". Trans. Amer. Math. Soc. 72 (2): 341–366. doi:10.2307/1990760. JSTOR 1990760. MR 0047179.