Lec 1 | MIT 18.06 Linear Algebra, Spring 2005
TL;DR
This lecture introduces linear algebra by focusing on solving systems of linear equations (Ax=b), presenting the Row Picture, Column Picture, and Matrix form, and emphasizing the geometric interpretation of column vector combinations.
Key insights
The fundamental problem of linear algebra is solving systems of linear equations.
- The lecture introduces three ways to view this problem: the Row picture, the Column picture, and the Matrix form.
- The Row picture visualizes each equation as a geometric object (line in 2D, plane in 3D) and the solution is the intersection.
- The Column picture views the equation as a linear combination of column vectors, aiming to produce the right-hand side vector.
- The Matrix form (Ax=b) is a concise algebraic representation of the system.
The Column Picture offers a powerful geometric interpretation of matrix-vector multiplication and system solvability.
- Ax=b asks for a linear combination of the columns of A that equals b.
- The set of all possible linear combinations of the columns of A determines the possible right-hand sides (b) for which a solution exists.
- If the columns span the entire space (e.g., R^3 for a 3x3 matrix), then a solution exists for every b.
- If the columns are linearly dependent (e.g., one column is a combination of others), they lie in a lower-dimensional subspace, limiting the achievable 'b' vectors.
The solvability of Ax=b depends on the properties of the matrix A and its columns.
- A 'good' matrix (non-singular, invertible) allows for a solution for any right-hand side vector b.
- A 'bad' or 'singular' matrix occurs when columns are linearly dependent, meaning they don't span the full space, and only certain 'b' vectors are reachable.
- The concept of linear independence of columns is crucial for determining if the system is solvable for all possible right-hand sides.
Matrix-vector multiplication (Ax) can be understood in two primary ways: as a linear combination of columns or as a dot product of rows with the vector.
- The 'column' interpretation is often more insightful for understanding the structure of the solution space.
- The 'row' interpretation (dot products) is computationally direct and forms the basis for elimination methods.
- Both perspectives are valid and lead to the same result.
Key moments
- 00:00Introduction to MIT's 18.06 Linear Algebra course by Professor Gilbert Strang, mentioning the textbook and course webpage.
- 01:05The fundamental problem of linear algebra: solving systems of linear equations, starting with n equations and n unknowns.
- 01:40Introduction to the Row Picture: visualizing one equation at a time, using lines meeting in a 2D example.
- 01:55Introduction to the Column Picture: viewing the system as a linear combination of column vectors.
- 02:13Introduction to the Matrix form (Ax=b) using a 2x2 example: 2x-y=0 and -x+2y=3.
- 04:20Detailed explanation and visualization of the Row Picture for the 2x2 example, showing two lines intersecting at the solution (1,2).
- 08:43Explanation of the Column Picture for the 2x2 example, representing the equation as a linear combination of column vectors to achieve the right-hand side vector b.
- 14:15Discussion on the crucial concept of linear combinations of columns and the question of whether all possible right-hand sides 'b' can be formed.
- 15:40Introduction to a 3x3 example with three equations and three unknowns, and its matrix form.
- 17:00Explanation of the Row Picture for the 3x3 case: each equation represents a plane, and the solution is the intersection point of these planes.
- 20:30Explanation of the Column Picture for the 3x3 case, involving linear combinations of three column vectors to form the right-hand side vector b.
- 29:50Discussion on when Ax=b is solvable for every b, relating it to the linear independence of the columns of A (non-singular/invertible matrices).
- 35:00Explanation of matrix-vector multiplication (Ax) as a linear combination of the columns of A, using a numerical example.
- 37:30Alternative method for matrix-vector multiplication: using dot products of rows with the vector.
- 38:00Concluding remarks about the systematic method (elimination) to find solutions, to be covered in the next lecture.