When you multiply a vector by a matrix, the vector usually changes direction. But for most matrices there are a few special directions that stay put: vectors along them only get stretched or shrunk. Those vectors are eigenvectors , and the stretch factors are eigenvalues . They make it easy to find high powers of a matrix, which is exactly what you need to predict where a population, a market share or a system ends up in the long run.
A non-zero vector v ⃗ \vec{v} v is an eigenvector of a square matrix A A A if multiplying by A A A just scales it:
A v ⃗ = λ v ⃗ A\vec{v} = \lambda\vec{v} A v = λ v
The number λ \lambda λ (Greek “lambda”) is the eigenvalue that goes with v ⃗ \vec{v} v . For example, with A = ( 4 1 2 3 ) A = \begin{pmatrix} 4 & 1 \\ 2 & 3 \end{pmatrix} A = ( 4 2 1 3 ) :
A ( 1 1 ) = ( 5 5 ) = 5 ( 1 1 ) , A ( 1 − 2 ) = ( 2 − 4 ) = 2 ( 1 − 2 ) A\begin{pmatrix} 1 \\ 1 \end{pmatrix} = \begin{pmatrix} 5 \\ 5 \end{pmatrix} = 5\begin{pmatrix} 1 \\ 1 \end{pmatrix}, \qquad A\begin{pmatrix} 1 \\ -2 \end{pmatrix} = \begin{pmatrix} 2 \\ -4 \end{pmatrix} = 2\begin{pmatrix} 1 \\ -2 \end{pmatrix} A ( 1 1 ) = ( 5 5 ) = 5 ( 1 1 ) , A ( 1 − 2 ) = ( 2 − 4 ) = 2 ( 1 − 2 )
So ( 1 1 ) \begin{pmatrix} 1 \\ 1 \end{pmatrix} ( 1 1 ) is an eigenvector with eigenvalue 5 5 5 , and ( 1 − 2 ) \begin{pmatrix} 1 \\ -2 \end{pmatrix} ( 1 − 2 ) is an eigenvector with eigenvalue 2 2 2 . But A ( 1 0 ) = ( 4 2 ) A\begin{pmatrix} 1 \\ 0 \end{pmatrix} = \begin{pmatrix} 4 \\ 2 \end{pmatrix} A ( 1 0 ) = ( 4 2 ) points in a new direction, so ( 1 0 ) \begin{pmatrix} 1 \\ 0 \end{pmatrix} ( 1 0 ) is not an eigenvector.
Eigenvectors keep their direction
2
4
6
−4
−2
2
4
6
A(1, 1) = (5, 5)
(1, 1)
A(1, −2) = (2, −4)
(1, −2)
A(1, 0) = (4, 2)
(1, 0)
Eigenvectors of A A A (blue, with their images in orange) stay on their own lines; ( 1 , 0 ) (1, 0) ( 1 , 0 ) (green) gets turned to ( 4 , 2 ) (4, 2) ( 4 , 2 ) .
Any non-zero multiple of an eigenvector is also an eigenvector with the same eigenvalue: ( 3 3 ) \begin{pmatrix} 3 \\ 3 \end{pmatrix} ( 3 3 ) works just as well as ( 1 1 ) \begin{pmatrix} 1 \\ 1 \end{pmatrix} ( 1 1 ) . So an eigenvector is really a direction , and you can choose any convenient one.
Rewrite A v ⃗ = λ v ⃗ A\vec{v} = \lambda\vec{v} A v = λ v as ( A − λ I ) v ⃗ = 0 ⃗ (A - \lambda I)\vec{v} = \vec{0} ( A − λ I ) v = 0 . For a non-zero v ⃗ \vec{v} v to satisfy this, A − λ I A - \lambda I A − λ I must be singular, so
det ( A − λ I ) = 0 \det(A - \lambda I) = 0 det ( A − λ I ) = 0
For A = ( a b c d ) A = \begin{pmatrix} a & b \\ c & d \end{pmatrix} A = ( a c b d ) :
det ( a − λ b c d − λ ) = ( a − λ ) ( d − λ ) − b c \det\begin{pmatrix} a - \lambda & b \\ c & d - \lambda \end{pmatrix} = (a - \lambda)(d - \lambda) - bc det ( a − λ c b d − λ ) = ( a − λ ) ( d − λ ) − b c
This quadratic in λ \lambda λ is the characteristic polynomial . Setting it to 0 0 0 gives the characteristic equation , and its roots are the eigenvalues. Expanding gives a handy shortcut:
λ 2 − ( a + d ) λ + ( a d − b c ) = 0 \lambda^2 - (a + d)\lambda + (ad - bc) = 0 λ 2 − ( a + d ) λ + ( a d − b c ) = 0
that is, λ 2 − ( sum of the leading diagonal ) λ + det A = 0 \lambda^2 - (\text{sum of the leading diagonal})\lambda + \det A = 0 λ 2 − ( sum of the leading diagonal ) λ + det A = 0 .
For each eigenvalue λ \lambda λ , solve ( A − λ I ) v ⃗ = 0 ⃗ (A - \lambda I)\vec{v} = \vec{0} ( A − λ I ) v = 0 . Because A − λ I A - \lambda I A − λ I is singular, its two rows give the same equation, so you get a direction rather than a single vector. Pick a simple vector in that direction.
This is the one place in the course where you work with a matrix that has no inverse: you can’t solve ( A − λ I ) v ⃗ = 0 ⃗ (A - \lambda I)\vec{v} = \vec{0} ( A − λ I ) v = 0 with an inverse matrix.
If a 2 × 2 2 \times 2 2 × 2 matrix A A A has two distinct real eigenvalues λ 1 \lambda_1 λ 1 and λ 2 \lambda_2 λ 2 with eigenvectors v ⃗ 1 \vec{v}_1 v 1 and v ⃗ 2 \vec{v}_2 v 2 , put the eigenvectors in the columns of P P P and the eigenvalues, in the same order, on the diagonal of D D D :
P = ( v ⃗ 1 v ⃗ 2 ) , D = ( λ 1 0 0 λ 2 ) , A = P D P − 1 P = \begin{pmatrix} \vec{v}_1 & \vec{v}_2 \end{pmatrix}, \qquad D = \begin{pmatrix} \lambda_1 & 0 \\ 0 & \lambda_2 \end{pmatrix}, \qquad A = PDP^{-1} P = ( v 1 v 2 ) , D = ( λ 1 0 0 λ 2 ) , A = P D P − 1
Writing A A A like this is diagonalization . It makes powers easy, because the P − 1 P P^{-1}P P − 1 P pairs in the middle cancel:
A n = ( P D P − 1 ) ( P D P − 1 ) ⋯ ( P D P − 1 ) = P D n P − 1 , D n = ( λ 1 n 0 0 λ 2 n ) A^n = (PDP^{-1})(PDP^{-1})\cdots(PDP^{-1}) = PD^nP^{-1}, \qquad D^n = \begin{pmatrix} \lambda_1^n & 0 \\ 0 & \lambda_2^n \end{pmatrix} A n = ( P D P − 1 ) ( P D P − 1 ) ⋯ ( P D P − 1 ) = P D n P − 1 , D n = ( λ 1 n 0 0 λ 2 n )
If x ⃗ n = A n x ⃗ 0 \vec{x}_n = A^n\vec{x}_0 x n = A n x 0 describes a system after n n n steps, the eigenvalues control what happens:
An eigenvalue with ∣ λ ∣ < 1 |\lambda| \lt 1 ∣ λ ∣ < 1 gives a term λ n → 0 \lambda^n \to 0 λ n → 0 : that part dies away.
An eigenvalue λ = 1 \lambda = 1 λ = 1 gives a term that stays the same: that’s the steady state .
An eigenvalue with ∣ λ ∣ > 1 |\lambda| \gt 1 ∣ λ ∣ > 1 gives a term that grows.
For a population moving between two places (a transition matrix whose columns add to 1 1 1 ), one eigenvalue is always 1 1 1 , and its eigenvector gives the long-term split. This links to Markov chains , and eigenvalues also describe the solutions of coupled differential equations in phase portraits .
Your GDC can find eigenvalues and eigenvectors for you, and can check P D P − 1 PDP^{-1} P D P − 1 and A n A^n A n . You should also be able to do 2 × 2 2 \times 2 2 × 2 matrices by hand.
Let B = ( 3 2 1 4 ) B = \begin{pmatrix} 3 & 2 \\ 1 & 4 \end{pmatrix} B = ( 3 1 2 4 ) . Decide whether each vector is an eigenvector of B B B , and if so, give its eigenvalue.
(a) ( 2 − 1 ) (b) ( 1 2 ) \text{(a) } \begin{pmatrix} 2 \\ -1 \end{pmatrix} \qquad \text{(b) } \begin{pmatrix} 1 \\ 2 \end{pmatrix} (a) ( 2 − 1 ) (b) ( 1 2 )
Solution.
(a) B ( 2 − 1 ) = ( 6 − 2 2 − 4 ) = ( 4 − 2 ) = 2 ( 2 − 1 ) B\begin{pmatrix} 2 \\ -1 \end{pmatrix} = \begin{pmatrix} 6 - 2 \\ 2 - 4 \end{pmatrix} = \begin{pmatrix} 4 \\ -2 \end{pmatrix} = 2\begin{pmatrix} 2 \\ -1 \end{pmatrix} B ( 2 − 1 ) = ( 6 − 2 2 − 4 ) = ( 4 − 2 ) = 2 ( 2 − 1 ) . Yes: it’s an eigenvector with eigenvalue 2 2 2 .
(b) B ( 1 2 ) = ( 3 + 4 1 + 8 ) = ( 7 9 ) B\begin{pmatrix} 1 \\ 2 \end{pmatrix} = \begin{pmatrix} 3 + 4 \\ 1 + 8 \end{pmatrix} = \begin{pmatrix} 7 \\ 9 \end{pmatrix} B ( 1 2 ) = ( 3 + 4 1 + 8 ) = ( 7 9 ) . Is this a multiple of ( 1 2 ) \begin{pmatrix} 1 \\ 2 \end{pmatrix} ( 1 2 ) ? It would need 7 = λ 7 = \lambda 7 = λ and 9 = 2 λ 9 = 2\lambda 9 = 2 λ , which can’t both be true. So no, it’s not an eigenvector.
Find the eigenvalues and corresponding eigenvectors of A = ( 4 1 2 3 ) A = \begin{pmatrix} 4 & 1 \\ 2 & 3 \end{pmatrix} A = ( 4 2 1 3 ) .
Solution. The characteristic equation:
det ( A − λ I ) = ( 4 − λ ) ( 3 − λ ) − 1 ( 2 ) = 0 λ 2 − 7 λ + 10 = 0 ( λ − 5 ) ( λ − 2 ) = 0 \begin{aligned}
\det(A - \lambda I) = (4 - \lambda)(3 - \lambda) - 1(2) &= 0 \\
\lambda^2 - 7\lambda + 10 &= 0 \\
(\lambda - 5)(\lambda - 2) &= 0
\end{aligned} det ( A − λ I ) = ( 4 − λ ) ( 3 − λ ) − 1 ( 2 ) λ 2 − 7 λ + 10 ( λ − 5 ) ( λ − 2 ) = 0 = 0 = 0
The eigenvalues are λ = 5 \lambda = 5 λ = 5 and λ = 2 \lambda = 2 λ = 2 . (Shortcut check: sum of the diagonal = 7 = 7 = 7 , det A = 12 − 2 = 10 \det A = 12 - 2 = 10 det A = 12 − 2 = 10 .)
For λ = 5 \lambda = 5 λ = 5 : A − 5 I = ( − 1 1 2 − 2 ) A - 5I = \begin{pmatrix} -1 & 1 \\ 2 & -2 \end{pmatrix} A − 5 I = ( − 1 2 1 − 2 ) . With v ⃗ = ( x y ) \vec{v} = \begin{pmatrix} x \\ y \end{pmatrix} v = ( x y ) , the first row gives − x + y = 0 -x + y = 0 − x + y = 0 , so y = x y = x y = x . (The second row, 2 x − 2 y = 0 2x - 2y = 0 2 x − 2 y = 0 , says the same thing.) Take v ⃗ 1 = ( 1 1 ) \vec{v}_1 = \begin{pmatrix} 1 \\ 1 \end{pmatrix} v 1 = ( 1 1 ) .
For λ = 2 \lambda = 2 λ = 2 : A − 2 I = ( 2 1 2 1 ) A - 2I = \begin{pmatrix} 2 & 1 \\ 2 & 1 \end{pmatrix} A − 2 I = ( 2 2 1 1 ) . Both rows give 2 x + y = 0 2x + y = 0 2 x + y = 0 , so y = − 2 x y = -2x y = − 2 x . Take v ⃗ 2 = ( 1 − 2 ) \vec{v}_2 = \begin{pmatrix} 1 \\ -2 \end{pmatrix} v 2 = ( 1 − 2 ) .
Check: A ( 1 − 2 ) = ( 4 − 2 2 − 6 ) = ( 2 − 4 ) = 2 ( 1 − 2 ) A\begin{pmatrix} 1 \\ -2 \end{pmatrix} = \begin{pmatrix} 4 - 2 \\ 2 - 6 \end{pmatrix} = \begin{pmatrix} 2 \\ -4 \end{pmatrix} = 2\begin{pmatrix} 1 \\ -2 \end{pmatrix} A ( 1 − 2 ) = ( 4 − 2 2 − 6 ) = ( 2 − 4 ) = 2 ( 1 − 2 ) ✓.
For A = ( 4 1 2 3 ) A = \begin{pmatrix} 4 & 1 \\ 2 & 3 \end{pmatrix} A = ( 4 2 1 3 ) from Example 2:
(a) Write A A A in the form P D P − 1 PDP^{-1} P D P − 1 .
(b) Find an expression for A n A^n A n , and use it to find A 3 A^3 A 3 .
Solution.
(a) Put the eigenvectors in the columns of P P P , and the eigenvalues in the same order in D D D :
P = ( 1 1 1 − 2 ) , D = ( 5 0 0 2 ) P = \begin{pmatrix} 1 & 1 \\ 1 & -2 \end{pmatrix}, \qquad D = \begin{pmatrix} 5 & 0 \\ 0 & 2 \end{pmatrix} P = ( 1 1 1 − 2 ) , D = ( 5 0 0 2 )
det P = − 2 − 1 = − 3 \det P = -2 - 1 = -3 det P = − 2 − 1 = − 3 , so
P − 1 = 1 − 3 ( − 2 − 1 − 1 1 ) = 1 3 ( 2 1 1 − 1 ) P^{-1} = \frac{1}{-3}\begin{pmatrix} -2 & -1 \\ -1 & 1 \end{pmatrix} = \frac{1}{3}\begin{pmatrix} 2 & 1 \\ 1 & -1 \end{pmatrix} P − 1 = − 3 1 ( − 2 − 1 − 1 1 ) = 3 1 ( 2 1 1 − 1 )
(b)
A n = P D n P − 1 = ( 1 1 1 − 2 ) ( 5 n 0 0 2 n ) 1 3 ( 2 1 1 − 1 ) = 1 3 ( 5 n 2 n 5 n − 2 ⋅ 2 n ) ( 2 1 1 − 1 ) = 1 3 ( 2 ⋅ 5 n + 2 n 5 n − 2 n 2 ⋅ 5 n − 2 ⋅ 2 n 5 n + 2 ⋅ 2 n ) \begin{aligned}
A^n = PD^nP^{-1} &= \begin{pmatrix} 1 & 1 \\ 1 & -2 \end{pmatrix}\begin{pmatrix} 5^n & 0 \\ 0 & 2^n \end{pmatrix}\frac{1}{3}\begin{pmatrix} 2 & 1 \\ 1 & -1 \end{pmatrix} \\
&= \frac{1}{3}\begin{pmatrix} 5^n & 2^n \\ 5^n & -2 \cdot 2^n \end{pmatrix}\begin{pmatrix} 2 & 1 \\ 1 & -1 \end{pmatrix} \\
&= \frac{1}{3}\begin{pmatrix} 2 \cdot 5^n + 2^n & 5^n - 2^n \\ 2 \cdot 5^n - 2 \cdot 2^n & 5^n + 2 \cdot 2^n \end{pmatrix}
\end{aligned} A n = P D n P − 1 = ( 1 1 1 − 2 ) ( 5 n 0 0 2 n ) 3 1 ( 2 1 1 − 1 ) = 3 1 ( 5 n 5 n 2 n − 2 ⋅ 2 n ) ( 2 1 1 − 1 ) = 3 1 ( 2 ⋅ 5 n + 2 n 2 ⋅ 5 n − 2 ⋅ 2 n 5 n − 2 n 5 n + 2 ⋅ 2 n )
For n = 3 n = 3 n = 3 , with 5 3 = 125 5^3 = 125 5 3 = 125 and 2 3 = 8 2^3 = 8 2 3 = 8 :
A 3 = 1 3 ( 258 117 234 141 ) = ( 86 39 78 47 ) A^3 = \frac{1}{3}\begin{pmatrix} 258 & 117 \\ 234 & 141 \end{pmatrix} = \begin{pmatrix} 86 & 39 \\ 78 & 47 \end{pmatrix} A 3 = 3 1 ( 258 234 117 141 ) = ( 86 78 39 47 )
Check: calculating A 3 A^3 A 3 directly on a GDC gives the same matrix. ✓
Each year, 10 % 10\% 10% of the people in town A A A move to town B B B , and 20 % 20\% 20% of the people in town B B B move to town A A A . Everyone else stays. At the start, 5000 5000 5000 people live in A A A and 7000 7000 7000 in B B B . Assume the total stays the same.
(a) Write down the matrix M M M with ( a n + 1 b n + 1 ) = M ( a n b n ) \begin{pmatrix} a_{n+1} \\ b_{n+1} \end{pmatrix} = M\begin{pmatrix} a_n \\ b_n \end{pmatrix} ( a n + 1 b n + 1 ) = M ( a n b n ) .
(b) Find the eigenvalues and eigenvectors of M M M .
(c) Find expressions for a n a_n a n and b n b_n b n , and describe the long-term populations.
Solution.
(a) Next year, town A A A keeps 90 % 90\% 90% of its people and gains 20 % 20\% 20% of B B B ‘s: a n + 1 = 0.9 a n + 0.2 b n a_{n+1} = 0.9a_n + 0.2b_n a n + 1 = 0.9 a n + 0.2 b n . Similarly b n + 1 = 0.1 a n + 0.8 b n b_{n+1} = 0.1a_n + 0.8b_n b n + 1 = 0.1 a n + 0.8 b n .
M = ( 0.9 0.2 0.1 0.8 ) M = \begin{pmatrix} 0.9 & 0.2 \\ 0.1 & 0.8 \end{pmatrix} M = ( 0.9 0.1 0.2 0.8 )
(b) λ 2 − 1.7 λ + ( 0.72 − 0.02 ) = 0 \lambda^2 - 1.7\lambda + (0.72 - 0.02) = 0 λ 2 − 1.7 λ + ( 0.72 − 0.02 ) = 0 , that is, λ 2 − 1.7 λ + 0.7 = 0 \lambda^2 - 1.7\lambda + 0.7 = 0 λ 2 − 1.7 λ + 0.7 = 0 , which factors as ( λ − 1 ) ( λ − 0.7 ) = 0 (\lambda - 1)(\lambda - 0.7) = 0 ( λ − 1 ) ( λ − 0.7 ) = 0 . So λ = 1 \lambda = 1 λ = 1 or λ = 0.7 \lambda = 0.7 λ = 0.7 .
For λ = 1 \lambda = 1 λ = 1 : M − I = ( − 0.1 0.2 0.1 − 0.2 ) M - I = \begin{pmatrix} -0.1 & 0.2 \\ 0.1 & -0.2 \end{pmatrix} M − I = ( − 0.1 0.1 0.2 − 0.2 ) gives − 0.1 x + 0.2 y = 0 -0.1x + 0.2y = 0 − 0.1 x + 0.2 y = 0 , so x = 2 y x = 2y x = 2 y : v ⃗ 1 = ( 2 1 ) \vec{v}_1 = \begin{pmatrix} 2 \\ 1 \end{pmatrix} v 1 = ( 2 1 ) .
For λ = 0.7 \lambda = 0.7 λ = 0.7 : M − 0.7 I = ( 0.2 0.2 0.1 0.1 ) M - 0.7I = \begin{pmatrix} 0.2 & 0.2 \\ 0.1 & 0.1 \end{pmatrix} M − 0.7 I = ( 0.2 0.1 0.2 0.1 ) gives x + y = 0 x + y = 0 x + y = 0 : v ⃗ 2 = ( 1 − 1 ) \vec{v}_2 = \begin{pmatrix} 1 \\ -1 \end{pmatrix} v 2 = ( 1 − 1 ) .
(c) With P = ( 2 1 1 − 1 ) P = \begin{pmatrix} 2 & 1 \\ 1 & -1 \end{pmatrix} P = ( 2 1 1 − 1 ) , D = ( 1 0 0 0.7 ) D = \begin{pmatrix} 1 & 0 \\ 0 & 0.7 \end{pmatrix} D = ( 1 0 0 0.7 ) and P − 1 = 1 3 ( 1 1 1 − 2 ) P^{-1} = \dfrac{1}{3}\begin{pmatrix} 1 & 1 \\ 1 & -2 \end{pmatrix} P − 1 = 3 1 ( 1 1 1 − 2 ) :
( a n b n ) = P D n P − 1 ( 5000 7000 ) = ( 2 1 1 − 1 ) ( 1 0 0 0.7 n ) ( 4000 − 3000 ) = ( 2 1 1 − 1 ) ( 4000 − 3000 ( 0.7 ) n ) = ( 8000 − 3000 ( 0.7 ) n 4000 + 3000 ( 0.7 ) n ) \begin{aligned}
\begin{pmatrix} a_n \\ b_n \end{pmatrix} = PD^nP^{-1}\begin{pmatrix} 5000 \\ 7000 \end{pmatrix} &= \begin{pmatrix} 2 & 1 \\ 1 & -1 \end{pmatrix}\begin{pmatrix} 1 & 0 \\ 0 & 0.7^n \end{pmatrix}\begin{pmatrix} 4000 \\ -3000 \end{pmatrix} \\
&= \begin{pmatrix} 2 & 1 \\ 1 & -1 \end{pmatrix}\begin{pmatrix} 4000 \\ -3000(0.7)^n \end{pmatrix} = \begin{pmatrix} 8000 - 3000(0.7)^n \\ 4000 + 3000(0.7)^n \end{pmatrix}
\end{aligned} ( a n b n ) = P D n P − 1 ( 5000 7000 ) = ( 2 1 1 − 1 ) ( 1 0 0 0. 7 n ) ( 4000 − 3000 ) = ( 2 1 1 − 1 ) ( 4000 − 3000 ( 0.7 ) n ) = ( 8000 − 3000 ( 0.7 ) n 4000 + 3000 ( 0.7 ) n )
As n → ∞ n \to \infty n → ∞ , 0.7 n → 0 0.7^n \to 0 0. 7 n → 0 , so the populations approach 8000 8000 8000 in town A A A and 4000 4000 4000 in town B B B . That’s the eigenvector ( 2 1 ) \begin{pmatrix} 2 \\ 1 \end{pmatrix} ( 2 1 ) scaled to the total of 12 000 12\,000 12 000 .
Check after one year: a 1 = 8000 − 3000 ( 0.7 ) = 5900 a_1 = 8000 - 3000(0.7) = 5900 a 1 = 8000 − 3000 ( 0.7 ) = 5900 , and directly 0.9 ( 5000 ) + 0.2 ( 7000 ) = 5900 0.9(5000) + 0.2(7000) = 5900 0.9 ( 5000 ) + 0.2 ( 7000 ) = 5900 ✓.
Accepting the zero vector as an eigenvector. A 0 ⃗ = λ 0 ⃗ A\vec{0} = \lambda\vec{0} A 0 = λ 0 for every λ \lambda λ , so it tells you nothing. Eigenvectors must be non-zero.
Subtracting λ from every entry. A − λ I A - \lambda I A − λ I subtracts λ \lambda λ only from the leading diagonal. The other entries stay the same.
Expecting a single answer for an eigenvector. The equations from ( A − λ I ) v ⃗ = 0 ⃗ (A - \lambda I)\vec{v} = \vec{0} ( A − λ I ) v = 0 always reduce to one relation like y = − 2 x y = -2x y = − 2 x . Any non-zero vector satisfying it is correct, so ( 1 − 2 ) \begin{pmatrix} 1 \\ -2 \end{pmatrix} ( 1 − 2 ) and ( − 3 6 ) \begin{pmatrix} -3 \\ 6 \end{pmatrix} ( − 3 6 ) are both fine.
Mismatching the orders in P and D. The eigenvalue in column 1 1 1 of D D D must belong to the eigenvector in column 1 1 1 of P P P . Swap one without the other and P D P − 1 PDP^{-1} P D P − 1 is no longer A A A .
Writing Aⁿ = PⁿDⁿ(P⁻¹)ⁿ or PⁿDⁿP⁻¹. Only D D D gets the power: A n = P D n P − 1 A^n = PD^nP^{-1} A n = P D n P − 1 . That’s the whole point of diagonalizing.
Raising a non-diagonal matrix to a power entry by entry. D n D^n D n is found by raising each diagonal entry to the power n n n , but this only works because D D D is diagonal. For any other matrix, A n A^n A n is not found entry by entry.
1. (Warm-up) Show that ( 1 1 ) \begin{pmatrix} 1 \\ 1 \end{pmatrix} ( 1 1 ) is an eigenvector of ( 3 2 1 4 ) \begin{pmatrix} 3 & 2 \\ 1 & 4 \end{pmatrix} ( 3 1 2 4 ) , and state its eigenvalue.
Solution ( 3 2 1 4 ) ( 1 1 ) = ( 5 5 ) = 5 ( 1 1 ) \begin{pmatrix} 3 & 2 \\ 1 & 4 \end{pmatrix}\begin{pmatrix} 1 \\ 1 \end{pmatrix} = \begin{pmatrix} 5 \\ 5 \end{pmatrix} = 5\begin{pmatrix} 1 \\ 1 \end{pmatrix} ( 3 1 2 4 ) ( 1 1 ) = ( 5 5 ) = 5 ( 1 1 ) It’s an eigenvector with eigenvalue 5 5 5 .
2. (Warm-up) Find the characteristic polynomial and the eigenvalues of C = ( 5 − 2 1 2 ) C = \begin{pmatrix} 5 & -2 \\ 1 & 2 \end{pmatrix} C = ( 5 1 − 2 2 ) .
Solution det ( C − λ I ) = ( 5 − λ ) ( 2 − λ ) − ( − 2 ) ( 1 ) = λ 2 − 7 λ + 10 + 2 = λ 2 − 7 λ + 12 \det(C - \lambda I) = (5 - \lambda)(2 - \lambda) - (-2)(1) = \lambda^2 - 7\lambda + 10 + 2 = \lambda^2 - 7\lambda + 12 det ( C − λ I ) = ( 5 − λ ) ( 2 − λ ) − ( − 2 ) ( 1 ) = λ 2 − 7 λ + 10 + 2 = λ 2 − 7 λ + 12 λ 2 − 7 λ + 12 = ( λ − 3 ) ( λ − 4 ) = 0 \lambda^2 - 7\lambda + 12 = (\lambda - 3)(\lambda - 4) = 0 λ 2 − 7 λ + 12 = ( λ − 3 ) ( λ − 4 ) = 0 , so the eigenvalues are 3 3 3 and 4 4 4 .
3. (Warm-up) Find the eigenvalues of T = ( 3 0 5 − 1 ) T = \begin{pmatrix} 3 & 0 \\ 5 & -1 \end{pmatrix} T = ( 3 5 0 − 1 ) . What do you notice?
Solution det ( T − λ I ) = ( 3 − λ ) ( − 1 − λ ) − 0 ( 5 ) = 0 \det(T - \lambda I) = (3 - \lambda)(-1 - \lambda) - 0(5) = 0 det ( T − λ I ) = ( 3 − λ ) ( − 1 − λ ) − 0 ( 5 ) = 0 So λ = 3 \lambda = 3 λ = 3 or λ = − 1 \lambda = -1 λ = − 1 . These are just the entries on the leading diagonal: when one of the off-diagonal entries is 0 0 0 , the eigenvalues are the diagonal entries.
4. (Core) Find an eigenvector for each eigenvalue of C = ( 5 − 2 1 2 ) C = \begin{pmatrix} 5 & -2 \\ 1 & 2 \end{pmatrix} C = ( 5 1 − 2 2 ) from question 2.
Solution λ = 3 \lambda = 3 λ = 3 : C − 3 I = ( 2 − 2 1 − 1 ) C - 3I = \begin{pmatrix} 2 & -2 \\ 1 & -1 \end{pmatrix} C − 3 I = ( 2 1 − 2 − 1 ) , giving x − y = 0 x - y = 0 x − y = 0 . Eigenvector ( 1 1 ) \begin{pmatrix} 1 \\ 1 \end{pmatrix} ( 1 1 ) .
λ = 4 \lambda = 4 λ = 4 : C − 4 I = ( 1 − 2 1 − 2 ) C - 4I = \begin{pmatrix} 1 & -2 \\ 1 & -2 \end{pmatrix} C − 4 I = ( 1 1 − 2 − 2 ) , giving x = 2 y x = 2y x = 2 y . Eigenvector ( 2 1 ) \begin{pmatrix} 2 \\ 1 \end{pmatrix} ( 2 1 ) .
Check: C ( 2 1 ) = ( 10 − 2 2 + 2 ) = ( 8 4 ) = 4 ( 2 1 ) C\begin{pmatrix} 2 \\ 1 \end{pmatrix} = \begin{pmatrix} 10 - 2 \\ 2 + 2 \end{pmatrix} = \begin{pmatrix} 8 \\ 4 \end{pmatrix} = 4\begin{pmatrix} 2 \\ 1 \end{pmatrix} C ( 2 1 ) = ( 10 − 2 2 + 2 ) = ( 8 4 ) = 4 ( 2 1 ) ✓.
5. (Core) For C = ( 5 − 2 1 2 ) C = \begin{pmatrix} 5 & -2 \\ 1 & 2 \end{pmatrix} C = ( 5 1 − 2 2 ) :
(a) Write C = P D P − 1 C = PDP^{-1} C = P D P − 1 , giving P P P , D D D and P − 1 P^{-1} P − 1 .
(b) Use C 5 = P D 5 P − 1 C^5 = PD^5P^{-1} C 5 = P D 5 P − 1 to find C 5 C^5 C 5 .
Solution (a) Using question 4:
P = ( 1 2 1 1 ) , D = ( 3 0 0 4 ) , P − 1 = 1 − 1 ( 1 − 2 − 1 1 ) = ( − 1 2 1 − 1 ) P = \begin{pmatrix} 1 & 2 \\ 1 & 1 \end{pmatrix}, \qquad D = \begin{pmatrix} 3 & 0 \\ 0 & 4 \end{pmatrix}, \qquad P^{-1} = \frac{1}{-1}\begin{pmatrix} 1 & -2 \\ -1 & 1 \end{pmatrix} = \begin{pmatrix} -1 & 2 \\ 1 & -1 \end{pmatrix} P = ( 1 1 2 1 ) , D = ( 3 0 0 4 ) , P − 1 = − 1 1 ( 1 − 1 − 2 1 ) = ( − 1 1 2 − 1 ) (b) 3 5 = 243 3^5 = 243 3 5 = 243 and 4 5 = 1024 4^5 = 1024 4 5 = 1024 .
C 5 = ( 1 2 1 1 ) ( 243 0 0 1024 ) ( − 1 2 1 − 1 ) = ( 243 2048 243 1024 ) ( − 1 2 1 − 1 ) = ( − 243 + 2048 486 − 2048 − 243 + 1024 486 − 1024 ) = ( 1805 − 1562 781 − 538 ) \begin{aligned}
C^5 &= \begin{pmatrix} 1 & 2 \\ 1 & 1 \end{pmatrix}\begin{pmatrix} 243 & 0 \\ 0 & 1024 \end{pmatrix}\begin{pmatrix} -1 & 2 \\ 1 & -1 \end{pmatrix} \\
&= \begin{pmatrix} 243 & 2048 \\ 243 & 1024 \end{pmatrix}\begin{pmatrix} -1 & 2 \\ 1 & -1 \end{pmatrix} \\
&= \begin{pmatrix} -243 + 2048 & 486 - 2048 \\ -243 + 1024 & 486 - 1024 \end{pmatrix} = \begin{pmatrix} 1805 & -1562 \\ 781 & -538 \end{pmatrix}
\end{aligned} C 5 = ( 1 1 2 1 ) ( 243 0 0 1024 ) ( − 1 1 2 − 1 ) = ( 243 243 2048 1024 ) ( − 1 1 2 − 1 ) = ( − 243 + 2048 − 243 + 1024 486 − 2048 486 − 1024 ) = ( 1805 781 − 1562 − 538 ) A GDC calculation of C 5 C^5 C 5 agrees.
6. (Core) A matrix A A A has eigenvalue 3 3 3 with eigenvector ( 2 1 ) \begin{pmatrix} 2 \\ 1 \end{pmatrix} ( 2 1 ) and eigenvalue − 1 -1 − 1 with eigenvector ( 1 1 ) \begin{pmatrix} 1 \\ 1 \end{pmatrix} ( 1 1 ) . Find A A A .
Solution A = P D P − 1 A = PDP^{-1} A = P D P − 1 with P = ( 2 1 1 1 ) P = \begin{pmatrix} 2 & 1 \\ 1 & 1 \end{pmatrix} P = ( 2 1 1 1 ) and D = ( 3 0 0 − 1 ) D = \begin{pmatrix} 3 & 0 \\ 0 & -1 \end{pmatrix} D = ( 3 0 0 − 1 ) . det P = 2 − 1 = 1 \det P = 2 - 1 = 1 det P = 2 − 1 = 1 , so P − 1 = ( 1 − 1 − 1 2 ) P^{-1} = \begin{pmatrix} 1 & -1 \\ -1 & 2 \end{pmatrix} P − 1 = ( 1 − 1 − 1 2 ) .
A = ( 6 − 1 3 − 1 ) ( 1 − 1 − 1 2 ) = ( 6 + 1 − 6 − 2 3 + 1 − 3 − 2 ) = ( 7 − 8 4 − 5 ) A = \begin{pmatrix} 6 & -1 \\ 3 & -1 \end{pmatrix}\begin{pmatrix} 1 & -1 \\ -1 & 2 \end{pmatrix} = \begin{pmatrix} 6 + 1 & -6 - 2 \\ 3 + 1 & -3 - 2 \end{pmatrix} = \begin{pmatrix} 7 & -8 \\ 4 & -5 \end{pmatrix} A = ( 6 3 − 1 − 1 ) ( 1 − 1 − 1 2 ) = ( 6 + 1 3 + 1 − 6 − 2 − 3 − 2 ) = ( 7 4 − 8 − 5 ) (Here P D = ( 6 − 1 3 − 1 ) PD = \begin{pmatrix} 6 & -1 \\ 3 & -1 \end{pmatrix} P D = ( 6 3 − 1 − 1 ) .) Check: A ( 2 1 ) = ( 14 − 8 8 − 5 ) = ( 6 3 ) = 3 ( 2 1 ) A\begin{pmatrix} 2 \\ 1 \end{pmatrix} = \begin{pmatrix} 14 - 8 \\ 8 - 5 \end{pmatrix} = \begin{pmatrix} 6 \\ 3 \end{pmatrix} = 3\begin{pmatrix} 2 \\ 1 \end{pmatrix} A ( 2 1 ) = ( 14 − 8 8 − 5 ) = ( 6 3 ) = 3 ( 2 1 ) ✓.
7. (Core) A town has two gyms with 1000 1000 1000 members between them. Each month, 15 % 15\% 15% of Gym A A A ‘s members switch to Gym B B B , and 5 % 5\% 5% of Gym B B B ‘s members switch to Gym A A A . At the start, Gym A A A has 600 600 600 members and Gym B B B has 400 400 400 .
(a) Write down the matrix G G G such that ( a n + 1 b n + 1 ) = G ( a n b n ) \begin{pmatrix} a_{n+1} \\ b_{n+1} \end{pmatrix} = G\begin{pmatrix} a_n \\ b_n \end{pmatrix} ( a n + 1 b n + 1 ) = G ( a n b n ) .
(b) Find the eigenvalues of G G G and an eigenvector for each.
(c) Find expressions for a n a_n a n and b n b_n b n , and the long-term number of members at each gym.
Solution (a)
G = ( 0.85 0.05 0.15 0.95 ) G = \begin{pmatrix} 0.85 & 0.05 \\ 0.15 & 0.95 \end{pmatrix} G = ( 0.85 0.15 0.05 0.95 ) (b) λ 2 − 1.8 λ + ( 0.8075 − 0.0075 ) = λ 2 − 1.8 λ + 0.8 = ( λ − 1 ) ( λ − 0.8 ) = 0 \lambda^2 - 1.8\lambda + (0.8075 - 0.0075) = \lambda^2 - 1.8\lambda + 0.8 = (\lambda - 1)(\lambda - 0.8) = 0 λ 2 − 1.8 λ + ( 0.8075 − 0.0075 ) = λ 2 − 1.8 λ + 0.8 = ( λ − 1 ) ( λ − 0.8 ) = 0 , so λ = 1 \lambda = 1 λ = 1 or 0.8 0.8 0.8 .
λ = 1 \lambda = 1 λ = 1 : − 0.15 x + 0.05 y = 0 -0.15x + 0.05y = 0 − 0.15 x + 0.05 y = 0 , so y = 3 x y = 3x y = 3 x : eigenvector ( 1 3 ) \begin{pmatrix} 1 \\ 3 \end{pmatrix} ( 1 3 ) .
λ = 0.8 \lambda = 0.8 λ = 0.8 : 0.05 x + 0.05 y = 0 0.05x + 0.05y = 0 0.05 x + 0.05 y = 0 , so y = − x y = -x y = − x : eigenvector ( 1 − 1 ) \begin{pmatrix} 1 \\ -1 \end{pmatrix} ( 1 − 1 ) .
(c) P = ( 1 1 3 − 1 ) P = \begin{pmatrix} 1 & 1 \\ 3 & -1 \end{pmatrix} P = ( 1 3 1 − 1 ) , det P = − 4 \det P = -4 det P = − 4 , P − 1 = 1 4 ( 1 1 3 − 1 ) P^{-1} = \dfrac{1}{4}\begin{pmatrix} 1 & 1 \\ 3 & -1 \end{pmatrix} P − 1 = 4 1 ( 1 3 1 − 1 ) , and P − 1 ( 600 400 ) = ( 250 350 ) P^{-1}\begin{pmatrix} 600 \\ 400 \end{pmatrix} = \begin{pmatrix} 250 \\ 350 \end{pmatrix} P − 1 ( 600 400 ) = ( 250 350 ) .
( a n b n ) = ( 1 1 3 − 1 ) ( 250 350 ( 0.8 ) n ) = ( 250 + 350 ( 0.8 ) n 750 − 350 ( 0.8 ) n ) \begin{pmatrix} a_n \\ b_n \end{pmatrix} = \begin{pmatrix} 1 & 1 \\ 3 & -1 \end{pmatrix}\begin{pmatrix} 250 \\ 350(0.8)^n \end{pmatrix} = \begin{pmatrix} 250 + 350(0.8)^n \\ 750 - 350(0.8)^n \end{pmatrix} ( a n b n ) = ( 1 3 1 − 1 ) ( 250 350 ( 0.8 ) n ) = ( 250 + 350 ( 0.8 ) n 750 − 350 ( 0.8 ) n ) As n → ∞ n \to \infty n → ∞ , 0.8 n → 0 0.8^n \to 0 0. 8 n → 0 : in the long run Gym A A A has about 250 250 250 members and Gym B B B about 750 750 750 .
Check: a 1 = 250 + 280 = 530 a_1 = 250 + 280 = 530 a 1 = 250 + 280 = 530 , and directly 0.85 ( 600 ) + 0.05 ( 400 ) = 510 + 20 = 530 0.85(600) + 0.05(400) = 510 + 20 = 530 0.85 ( 600 ) + 0.05 ( 400 ) = 510 + 20 = 530 ✓.
8. (Challenge) Let M = ( 0.7 0.6 0.3 0.4 ) M = \begin{pmatrix} 0.7 & 0.6 \\ 0.3 & 0.4 \end{pmatrix} M = ( 0.7 0.3 0.6 0.4 ) .
(a) Show that the eigenvalues of M M M are 1 1 1 and 0.1 0.1 0.1 , and find an eigenvector for each.
(b) Find M n M^n M n in terms of n n n .
(c) Find the matrix that M n M^n M n approaches as n → ∞ n \to \infty n → ∞ , and explain what its columns tell you.
Solution (a) λ 2 − 1.1 λ + ( 0.28 − 0.18 ) = λ 2 − 1.1 λ + 0.1 = ( λ − 1 ) ( λ − 0.1 ) = 0 \lambda^2 - 1.1\lambda + (0.28 - 0.18) = \lambda^2 - 1.1\lambda + 0.1 = (\lambda - 1)(\lambda - 0.1) = 0 λ 2 − 1.1 λ + ( 0.28 − 0.18 ) = λ 2 − 1.1 λ + 0.1 = ( λ − 1 ) ( λ − 0.1 ) = 0 . ✓
λ = 1 \lambda = 1 λ = 1 : − 0.3 x + 0.6 y = 0 -0.3x + 0.6y = 0 − 0.3 x + 0.6 y = 0 , so x = 2 y x = 2y x = 2 y : ( 2 1 ) \begin{pmatrix} 2 \\ 1 \end{pmatrix} ( 2 1 ) . λ = 0.1 \lambda = 0.1 λ = 0.1 : 0.6 x + 0.6 y = 0 0.6x + 0.6y = 0 0.6 x + 0.6 y = 0 : ( 1 − 1 ) \begin{pmatrix} 1 \\ -1 \end{pmatrix} ( 1 − 1 ) .
(b) P = ( 2 1 1 − 1 ) P = \begin{pmatrix} 2 & 1 \\ 1 & -1 \end{pmatrix} P = ( 2 1 1 − 1 ) , P − 1 = 1 3 ( 1 1 1 − 2 ) P^{-1} = \dfrac{1}{3}\begin{pmatrix} 1 & 1 \\ 1 & -2 \end{pmatrix} P − 1 = 3 1 ( 1 1 1 − 2 ) .
M n = ( 2 1 1 − 1 ) ( 1 0 0 0.1 n ) 1 3 ( 1 1 1 − 2 ) = 1 3 ( 2 0.1 n 1 − 0.1 n ) ( 1 1 1 − 2 ) = 1 3 ( 2 + 0.1 n 2 − 2 ( 0.1 ) n 1 − 0.1 n 1 + 2 ( 0.1 ) n ) \begin{aligned}
M^n &= \begin{pmatrix} 2 & 1 \\ 1 & -1 \end{pmatrix}\begin{pmatrix} 1 & 0 \\ 0 & 0.1^n \end{pmatrix}\frac{1}{3}\begin{pmatrix} 1 & 1 \\ 1 & -2 \end{pmatrix} \\
&= \frac{1}{3}\begin{pmatrix} 2 & 0.1^n \\ 1 & -0.1^n \end{pmatrix}\begin{pmatrix} 1 & 1 \\ 1 & -2 \end{pmatrix} = \frac{1}{3}\begin{pmatrix} 2 + 0.1^n & 2 - 2(0.1)^n \\ 1 - 0.1^n & 1 + 2(0.1)^n \end{pmatrix}
\end{aligned} M n = ( 2 1 1 − 1 ) ( 1 0 0 0. 1 n ) 3 1 ( 1 1 1 − 2 ) = 3 1 ( 2 1 0. 1 n − 0. 1 n ) ( 1 1 1 − 2 ) = 3 1 ( 2 + 0. 1 n 1 − 0. 1 n 2 − 2 ( 0.1 ) n 1 + 2 ( 0.1 ) n ) Check n = 1 n = 1 n = 1 : 1 3 ( 2.1 1.8 0.9 1.2 ) = ( 0.7 0.6 0.3 0.4 ) \dfrac{1}{3}\begin{pmatrix} 2.1 & 1.8 \\ 0.9 & 1.2 \end{pmatrix} = \begin{pmatrix} 0.7 & 0.6 \\ 0.3 & 0.4 \end{pmatrix} 3 1 ( 2.1 0.9 1.8 1.2 ) = ( 0.7 0.3 0.6 0.4 ) ✓.
(c) As n → ∞ n \to \infty n → ∞ , 0.1 n → 0 0.1^n \to 0 0. 1 n → 0 :
M n → 1 3 ( 2 2 1 1 ) = ( 2 3 2 3 1 3 1 3 ) M^n \to \frac{1}{3}\begin{pmatrix} 2 & 2 \\ 1 & 1 \end{pmatrix} = \begin{pmatrix} \frac{2}{3} & \frac{2}{3} \\ \frac{1}{3} & \frac{1}{3} \end{pmatrix} M n → 3 1 ( 2 1 2 1 ) = ( 3 2 3 1 3 2 3 1 ) Both columns are the same: whatever the starting split, the long-term split is 2 3 \dfrac{2}{3} 3 2 and 1 3 \dfrac{1}{3} 3 1 , the eigenvector ( 2 1 ) \begin{pmatrix} 2 \\ 1 \end{pmatrix} ( 2 1 ) scaled so its entries add to 1 1 1 .
9. (Challenge) The matrix A = ( 1 k 2 3 ) A = \begin{pmatrix} 1 & k \\ 2 & 3 \end{pmatrix} A = ( 1 2 k 3 ) has an eigenvalue of 5 5 5 .
(a) Find k k k .
(b) Find the other eigenvalue, and an eigenvector for each eigenvalue.
Solution (a) 5 5 5 is a root of det ( A − λ I ) = 0 \det(A - \lambda I) = 0 det ( A − λ I ) = 0 :
det ( 1 − 5 k 2 3 − 5 ) = ( − 4 ) ( − 2 ) − 2 k = 8 − 2 k = 0 ⇒ k = 4 \det\begin{pmatrix} 1 - 5 & k \\ 2 & 3 - 5 \end{pmatrix} = (-4)(-2) - 2k = 8 - 2k = 0 \quad\Rightarrow\quad k = 4 det ( 1 − 5 2 k 3 − 5 ) = ( − 4 ) ( − 2 ) − 2 k = 8 − 2 k = 0 ⇒ k = 4 (b) With k = 4 k = 4 k = 4 : λ 2 − 4 λ + ( 3 − 8 ) = λ 2 − 4 λ − 5 = ( λ − 5 ) ( λ + 1 ) = 0 \lambda^2 - 4\lambda + (3 - 8) = \lambda^2 - 4\lambda - 5 = (\lambda - 5)(\lambda + 1) = 0 λ 2 − 4 λ + ( 3 − 8 ) = λ 2 − 4 λ − 5 = ( λ − 5 ) ( λ + 1 ) = 0 . The other eigenvalue is − 1 -1 − 1 . (The two eigenvalues add to the sum of the diagonal, 1 + 3 = 4 1 + 3 = 4 1 + 3 = 4 .)
λ = 5 \lambda = 5 λ = 5 : A − 5 I = ( − 4 4 2 − 2 ) A - 5I = \begin{pmatrix} -4 & 4 \\ 2 & -2 \end{pmatrix} A − 5 I = ( − 4 2 4 − 2 ) , so y = x y = x y = x : eigenvector ( 1 1 ) \begin{pmatrix} 1 \\ 1 \end{pmatrix} ( 1 1 ) .
λ = − 1 \lambda = -1 λ = − 1 : A + I = ( 2 4 2 4 ) A + I = \begin{pmatrix} 2 & 4 \\ 2 & 4 \end{pmatrix} A + I = ( 2 2 4 4 ) , so x = − 2 y x = -2y x = − 2 y : eigenvector ( − 2 1 ) \begin{pmatrix} -2 \\ 1 \end{pmatrix} ( − 2 1 ) .
Check: A ( − 2 1 ) = ( − 2 + 4 − 4 + 3 ) = ( 2 − 1 ) = − 1 ( − 2 1 ) A\begin{pmatrix} -2 \\ 1 \end{pmatrix} = \begin{pmatrix} -2 + 4 \\ -4 + 3 \end{pmatrix} = \begin{pmatrix} 2 \\ -1 \end{pmatrix} = -1\begin{pmatrix} -2 \\ 1 \end{pmatrix} A ( − 2 1 ) = ( − 2 + 4 − 4 + 3 ) = ( 2 − 1 ) = − 1 ( − 2 1 ) ✓.