Gilbert Strang on the Four Fundamental Subspaces of Linear Algebra

This podcast segment features Gilbert Strang discussing his favorite topic to teach in linear algebra: the four fundamental subspaces. He begins by defining a matrix as a rectangle of numbers with 'n columns' and 'M rows' and a vector as a 'column of numbers,' contrasting this abstract view with a physicist's common visualization of a vector as an 'arrow in space.' Strang emphasizes that the core operations of linear algebra—adding vectors and multiplying them by a scalar—are fundamental, and mastering them is key to understanding the field, even in high-dimensional spaces.

The discussion delves into the inherent challenge of visualizing concepts like a 10-dimensional vector, a common hurdle in advanced mathematics and theoretical physics, such as string theory. Strang admits he doesn't have a clear mental image for such high dimensions but highlights the beauty of linear algebra in its ability to extend seamlessly to 'ten dimensions with no problem.' He encourages students to think of abstract concepts like a 'flat surface in ten dimensions' (a plane) even without direct visualization, focusing on the underlying mathematical rules and operations that remain consistent across dimensions.

Strang then introduces the first two of the four fundamental subspaces: the column space, which comprises all possible linear combinations of a matrix's columns, forming a 'vector space' or 'flat surface,' and the row space, similarly formed by combinations of the matrix's rows. He acknowledges the difficulty of drawing these on a blackboard but uses analogies like a 'piece of paper in 3D' to aid understanding. The other two subspaces are described as being 'perpendicular to those,' with the null space explicitly mentioned as perpendicular to the column space.

These four subspaces, the column space, row space, null space, and left null space (implied as the fourth perpendicular space), fit together to form a 'beautiful picture of a matrix.' Strang notes that this fundamental idea, though not mathematically complex, is basic to linear algebra and emerged relatively early in mathematical history, around 1806. The segment underscores the power of abstract mathematical frameworks to reveal profound truths about the world, even when those truths defy direct human perception or visualization, showcasing the elegance and interconnectedness of mathematical structures.

it's both a powerful and a beautiful a subfield of mathematics

the four fundamental subspaces which are of course known before long before my name for them

for me it's a column of numbers

if you know how to do those you've got linear algebra

there's this beautiful thing about math if you look string theory and all these theories which are really fundamentally derived through math yeah but are very difficult to visualize it

the beauty of linear algebra is that is that it goes on to ten dimensions with no problem

my imagination is just seeing like a piece of paper in 3d

the other two spaces are perpendicular to those

those four fit together and the in a beautiful picture of a matrix

it's not a difficult idea comes comes pretty early in 1806 and it's basic