The Setting
Take finite index sets and , and consider complex square matrices indexed by together with complex rectangular matrices. For a complex square matrix indexed by , the quantity can vary as passes through rank changes. The question is whether this function of is Fréchet differentiable everywhere and how its gradient and differences are controlled entrywise.
Definitions
The real trace of a complex square matrix indexed by a finite set is the real number given by the real part of the trace of .✦ The real Hilbert-Schmidt inner product of two complex square matrices and indexed by a finite set is the real number given by the real trace of .✦
The matrix energy of a complex square matrix indexed by a finite set is the real number (1)✦ where is the square root of ; on positive semidefinite matrices , this agrees with . The Gram energy gradient of complex square matrices and indexed by a finite set is the continuous real-linear functional acting on each complex square matrix indexed by by (2)✦
The segment matrix associated with complex square matrices and indexed by a finite set and a real scalar is the complex square matrix indexed by given by (3)✦
The row norm at row index of a complex rectangular matrix with rows indexed by a finite set and columns indexed by a finite set is the real number (4)✦ The column norm at column index of a complex rectangular matrix over finite sets and is the real number (5)✦
The Claim
Theorem 1. Let and be finite sets. For every complex square matrix indexed by , the map on complex square matrices indexed by is Fréchet differentiable at with Fréchet derivative (6)✦ For any complex square matrices and indexed by and any real number , the function is differentiable at with derivative (7)✦ Whenever complex square matrices , , and indexed by satisfy and for all , the energy difference satisfies (8)✦ For every complex rectangular matrix and all indices and , the entry of satisfies (9)✦
In the paper, the result reads: for finite rectangular complex matrices of the same size, with and , , and for every rectangular matrix and entry , . Rather than an integral formula on rectangular matrices, the theorem gives the Fréchet and segment derivatives (6) and (7) and the jump bound (8) for complex square matrices, and states (9) for rectangular matrices.
What Is Checked
The differentiability claims (6) and (7) are stated over all complex square matrices indexed by a finite set and every real number , while (8) is stated over complex square matrices , , and satisfying and entrywise. The entrywise gradient bound (9) is stated over all complex rectangular matrices indexed by finite sets and and all indices and .
The real trace is additive and homogeneous under real scalars, defining a continuous real-linear functional on complex square matrices indexed by a finite set .✦