Differences between revisions 17 and 26 (spanning 9 versions)
Revision 17 as of 2024-06-06 02:58:56
Size: 4140
Comment: Content
Revision 26 as of 2026-01-20 18:09:20
Size: 4368
Comment: Note about rank
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Matrix Inversion = = Invertibility =
Line 3: Line 3:
For some matrices '''''A''''', the '''inverse matrix''' ('''''A'''^-1^'') is a matrix which can be multiplied by the original matrix to produce the [[LinearAlgebra/SpecialMatrices#Identity_Matrix|identity matrix]]. The calculation of an inverse matrix, if it exists, is called '''inversion'''. '''Invertibility''' is a property of square matrices. If a matrix is invertible, there is an inverse matrix that it can be multiplied by to produce the [[LinearAlgebra/SpecialMatrices#Identity_Matrix|identity matrix]]. The calculation of an inverse matrix is '''inversion'''.
Line 13: Line 13:
An inverse matrix satisfies the equation '''''AA'''^-1^ = '''I'''''. A matrix '''''A''''' is invertible if there is a matrix '''''A'''^-1^'' which satisfies '''''AA'''^-1^ = '''A'''^-1^'''A''' = '''I'''''.
Line 15: Line 15:
Not all matrices have a real inverse. Such matrices are [[LinearAlgebra/MatrixProperties#Interible|non-invertible]]. If a matrix cannot be inverted, it is '''singular''' and '''degenerate''' and '''non-invertible'''.
Line 17: Line 17:
Calculation of the [[LinearAlgebra/Determinants|determinant]] is the common test for invertibility. if ''|'''A'''| != 0'', then '''''A''''' is invertible. Conversely, if ''|'''A'''| = 0'', then '''''A''''' is non-invertible. Only square matrices can be invertible. However, a non-square matrix can separably have distinct '''left inverse''' and '''right inverse''' matrices. Generally, if ''m < n'', then a matrix with shape ''m'' by ''n'' and rank of ''m'' can have a right inverse; a matrix with shape ''n'' by ''m'' and rank of ''m'' can have a left inverse.
Line 19: Line 19:
Only square matrices can be invertible. However, a non-square matrix can separably have distinct '''left inverse''' and '''right inverse''' matrices. Generally, if ''a < b'', then a matrix with shape ''a'' by ''b'' and rank of ''a'' can have a right inverse; a matrix with shape ''b'' by ''a'' and rank of ''a'' can have a left inverse. By contrast, an invertible square matrix has a true inverse that works on either side: '''''AA'''^-1^ = '''A'''^-1^'''A''' = '''I'''''.

=== Properties ===

By definition, '''''AA'''^-1^ = '''A'''^-1^'''A''' = '''I'''''.

An invertible matrix is square and is full [[LinearAlgebra/Rank|rank]].

An invertible matrix has only one vector in the [[LinearAlgebra/NullSpace|null space]]: the zero vector. If any basis vector of a matrix is a linear transformation of another, then the matrix does not have [[LinearAlgebra/Basis|basis]] and must be non-invertible.

For [[LinearAlgebra/Orthogonality#Matrices|orthogonal matrices]] (such as [[LinearAlgebra/SpecialMatrices#Permutation_Matrices|permutation matrices]]), the inverse is also the [[LinearAlgebra/Transposition|transpose]]: '''''Q'''^-1^ = '''Q'''^T^''.
Line 25: Line 35:
== Properties == == Test with Determinant ==
Line 27: Line 37:
The core principle of inversions is that a matrix '''''A''''' can be canceled out from a larger system: ''x'''AA'''^-1^ = x''.

An invertible matrix has only one vector in the [[LinearAlgebra/NullSpaces|null space]]: the zero vector. If any basis vector of a matrix is a linear transformation of another, then the matrix does not have [[LinearAlgebra/Basis|basis]] and must be non-invertible.

For [[LinearAlgebra/Orthogonality#Matrices|orthogonal matrices]] (such as [[LinearAlgebra/SpecialMatrices#Permutation_Matrices|permutation matrices]]), the inverse is also the [[LinearAlgebra/MatrixTransposition|transpose]]: '''''Q'''^-1^ = '''Q'''^T^''.
The [[LinearAlgebra/Determinant|determinant]] is the most common test for invertibility. If ''|'''A'''| != 0'', then '''''A''''' is invertible. If ''|'''A'''| = 0'', then '''''A''''' is non-invertible.
Line 37: Line 43:
== Calculation == == Calculation with Determinant ==

Consider the ''2 x 2'' case:

{{{
┌ ┐
│ a b │
│ c d │
└ ┘
}}}

The inverse matrix is

{{{
  1 ┌ ┐
―――――― │ d -b │
Det(A) │ -c a │
       └ ┘
}}}

----



== Calculation with Elimination ==
Line 73: Line 103:
== Determinant and Cofactor Matrix == == Calculation with Determinants and Cofactor Matrices ==
Line 75: Line 105:
Given the [[LinearAlgebra/Determinants|determinant]] of '''''A''''', it can also be simple to compute '''''A'''^-1^'' as ''(1/|'''A'''|)'''C'''^T^''. '''''C''''' is the cofactor matrix, where ''c,,i j,,'' is the cofactor of ''a,,i j,,''. Given the [[LinearAlgebra/Determinant|determinant]] of '''''A''''', it can also be simple to compute '''''A'''^-1^'' as ''(1/|'''A'''|)'''C'''^T^''. '''''C''''' is the cofactor matrix, where ''c,,i j,,'' is the cofactor of ''a,,i j,,''.

Invertibility

Invertibility is a property of square matrices. If a matrix is invertible, there is an inverse matrix that it can be multiplied by to produce the identity matrix. The calculation of an inverse matrix is inversion.


Definition

A matrix A is invertible if there is a matrix A-1 which satisfies AA-1 = A-1A = I.

If a matrix cannot be inverted, it is singular and degenerate and non-invertible.

Only square matrices can be invertible. However, a non-square matrix can separably have distinct left inverse and right inverse matrices. Generally, if m < n, then a matrix with shape m by n and rank of m can have a right inverse; a matrix with shape n by m and rank of m can have a left inverse.

Properties

By definition, AA-1 = A-1A = I.

An invertible matrix is square and is full rank.

An invertible matrix has only one vector in the null space: the zero vector. If any basis vector of a matrix is a linear transformation of another, then the matrix does not have basis and must be non-invertible.

For orthogonal matrices (such as permutation matrices), the inverse is also the transpose: Q-1 = QT.


Test with Determinant

The determinant is the most common test for invertibility. If |A| != 0, then A is invertible. If |A| = 0, then A is non-invertible.


Calculation with Determinant

Consider the 2 x 2 case:

┌     ┐
│ a b │
│ c d │
└     ┘

The inverse matrix is

  1    ┌      ┐
―――――― │ d -b │
Det(A) │ -c a │
       └      ┘


Calculation with Elimination

Because AA-1 = I, applying elimination and backwards elimination on A augmented with an identity matrix (I) will create A-1 in the augmentation.

┌            ┐
│ [1] 3 │ 1 0│
│  2  7 │ 0 1│
└            ┘
┌               ┐
│ [1]  3  │  1 0│
│  0  [1] │ -2 1│
└               ┘
┌             ┐
│ 1  3  │  1 0│
│ 0 [1] │ -2 1│
└             ┘
┌                ┐
│ [1]  0  │  7 -3│
│  0  [1] │ -2  1│
└                ┘

A-1 is:

┌      ┐
│  7 -3│
│ -2  1│
└      ┘


Calculation with Determinants and Cofactor Matrices

Given the determinant of A, it can also be simple to compute A-1 as (1/|A|)CT. C is the cofactor matrix, where ci j is the cofactor of ai j.

For example, given a 2 x 2 A like:

┌    ┐
│ a b│
│ c d│
└    ┘

The cofactor matrix C is:

┌      ┐
│  d -c│
│ -b  a│
└      ┘

But this must be transposed to CT:

┌      ┐
│  d -b│
│ -c  a│
└      ┘

And then A^-1 is:

┌                               ┐
│  (1/det A) * d  (1/det A) * -b│
│ (1/det A) * -c   (1/det A) * a│
└                               ┘

The above example fits into this formula. The elimination and backwards elimination prove that the determinant of that A is 1. The more fundamental formula ad - bc expands to 1 * 7 - 2 * 3 which also reveals a determinant of 1. As such, (1/|A|) is trivially 1. So simply plug the given (a, b, c, d) into the transposed cofactor matrix to find the inverse.


CategoryRicottone

LinearAlgebra/Invertibility (last edited 2026-01-20 18:09:20 by DominicRicottone)