Linear algebra II: inner products and Hilbert spaces
An arrow in the plane is two numbers. An arrow in space is three. Now imagine an arrow with a number for every point along a line: infinitely many components, one for each place. That object is a function, and treating functions as arrows is half of quantum mechanics.
Everything you can do with ordinary arrows, measuring lengths, finding angles, projecting one onto another, choosing perpendicular axes, works for functions too. The space where these function-arrows live is called a Hilbert space, and the state of every quantum system is an arrow in one.
Lengths, angles and shadows
The inner product multiplies two arrows component by component and adds up. It gives lengths, , and angles, because . Set the angle between the arrows to 50 °. The amber shadow is the projection of one onto the other.
Since a cosine never exceeds one, . That is the Cauchy–Schwarz inequality, and it holds in every inner-product space, including spaces of functions. In Part One it will turn into Heisenberg’s uncertainty relation.
A function is an arrow
Sample a function at 8 points and you have an ordinary arrow with that many components. Take more and more samples, weight each by the spacing, and the sum in the inner product becomes an integral:
The bar over means complex conjugate; it makes a positive length even when is complex. Functions whose squared length is finite form the space called .
Projecting onto perpendicular axes
The sine waves on the interval from 0 to 1 are perpendicular to each other in this sense: their inner products are zero. So they are a set of axes, and the shadow of a function on each axis is a Fourier coefficient.
Project the parabola onto the first 1 axes. The first coefficient is , the even ones are exactly zero by symmetry, and the leftover error only ever shrinks. Projecting onto more axes always gives the best approximation from those axes, which is why expanding in perpendicular functions is so powerful.
Making axes perpendicular
The simple functions are not perpendicular on the interval from −1 to 1. The Gram–Schmidt process fixes that: take each one in turn and subtract its shadows on the axes you already have. .
Out come , , , . Up to scaling these are the Legendre polynomials, which will describe the shapes of atomic orbitals. They were not invented; they fell out of making the axes perpendicular.
The two kinds of matrix that matter
A Hermitian matrix equals its own conjugate transpose, . Its eigenvalues are always real, and its eigenvectors are perpendicular. That is the spectral theorem, and it is why measurable quantities in quantum mechanics are Hermitian: real outcomes, with states that cleanly exclude one another.
A unitary matrix keeps every length and angle the same, . It is a rotation of Hilbert space, and it is how quantum states change in time: probabilities, which are squared lengths, always add up to one.
Combining systems multiplies dimensions
One qubit lives in a two-dimensional space. Two qubits do not live in 2 + 2 dimensions but in 2 × 2 = 4, because every pair of possibilities gets its own axis. This product of spaces is the tensor product, written .
With 3 qubits the state needs 8 complex numbers. At 300 qubits that is about , more than the roughly atoms in the observable universe. This growth is the whole reason quantum computers are interesting, and why simulating them on ordinary computers fails.
States you cannot normalize
A particle with exactly one momentum is described by the wave , which stretches forever with the same size everywhere. Its squared length, , is infinite, so it is not really in . Physicists use such states anyway, normalized with the Dirac delta, , as an idealization. Real particles are wave packets, sums of many such waves, like the bell-shaped pulse on the plate, and those have finite length.
What you now have
Functions as vectors, inner products, projections, Gram–Schmidt, Hermitian and unitary operators, the spectral theorem, and tensor products. This is the stage on which quantum mechanics is played.
· · ·
Three questions to carry with you.
And one to work out. How many complex numbers describe the state of 10 qubits?
Sources: S. Axler, Linear Algebra Done Right. N. Young, An Introduction to Hilbert Space. Checked by code: Gram–Schmidt of 1, x, x², x³ on [−1, 1]; sine coefficients of x(1−x) = 8/(n³π³) for odd n; 2³⁰⁰ ≈ 2.0×10⁹⁰.