Skip to main content

Section3.6The Rank Theorem

Objectives
  1. Learn to understand and use the rank theorem.
  2. Picture: the rank theorem.
  3. Theorem: rank theorem.
  4. Vocabulary: rank, nullity.

In this section we present the rank theorem, which is the culmination of all of the work we have done so far.

The reader may have observed a relationship between the column space and the null space of a matrix. In this example in Section 3.3, the column space and the null space of a 3 × 2 matrix are both lines, in R 2 and R 3 , respectively:

Nul ( A ) Col ( A ) A = C 111111 D

In this example in Section 3.1, the null space of the 2 × 3 matrix A 1 12 22 4 B is a plane in R 3 , and the column space the line in R 2 spanned by A 1 2 B :

Col ( A ) Nul ( A ) A = E 1 12 22 4 F

In this example in Section 3.1, the null space of a 3 × 3 matrix is a line in R 3 , and the column space is a plane in R 3 :

Col ( A ) Nul ( A ) A = C 10 1011110 D

In all examples, the dimension of the column space plus the dimension of the null space is equal to the number of columns of the matrix. This is the content of the rank theorem.

Definition

The rank of a matrix A , written rank ( A ) , is the dimension of the column space Col ( A ) .

The nullity of a matrix A , written nullity ( A ) , is the dimension of the null space Nul ( A ) .

The rank of a matrix A gives us important information about the solutions to Ax = b . Recall from this note in Section 2.4 that Ax = b is consistent exactly when b is in the span of the columns of A , in other words when b is in the column space of A . Thus, rank ( A ) is the dimension of the set of b with the property that Ax = b is consistent.

We know that the rank of A is equal to the number of pivot columns (see this theorem in Section 3.4), and the nullity of A is equal to the number of free variables (see this theorem in Section 3.4), which is the number of columns without pivots. To summarize:

rank ( A )= dimCol ( A )= thenumberofcolumnswithpivotsnullity ( A )= dimNul ( A )= thenumberoffreevariables = thenumberofcolumnswithoutpivots

Clearly

#(columnswithpivots) + #(columnswithoutpivots) = #(columns),

so we have proved the following theorem.

In other words, for any consistent system of linear equations,

(dimofcolumnspan) + (dimofsolutionset) = (numberofvariables).

The rank theorem theorem is really the culmination of this chapter, as it gives a strong relationship between the null space of a matrix (the solution set of Ax = 0 ) with the column space (the set of vectors b making Ax = b consistent), our two primary objects of interest. The more freedom we have in choosing x the less freedom we have in choosing b and vice versa.

The rank theorem is a prime example of how we use the theory of linear algebra to say something qualitative about a system of equations without ever solving it. This is, in essence, the power of the subject.