Differences between revisions 1 and 9 (spanning 8 versions)
Revision 1 as of 2021-09-14 15:49:24
Size: 1019
Comment:
Revision 9 as of 2024-01-30 15:45:39
Size: 3408
Comment: Diagonals
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:

These '''special matrices''' are core concepts to linear algebra.

<<TableOfContents>>

----

Line 5: Line 13:
The '''identity matrix''' multiplied by matrix A returns matrix A. The '''identity matrix''' is a diagonal line of ones in a square matrix of zeros.
Line 7: Line 15:
This matrix is simply a diagonal line of 1s in a matrix of 0s. Any matrix '''''A''''' multiplied by the (appropriately sized) identity matrix returns matrix '''''A'''''.
Line 10: Line 18:
┌ ┐
│ 1 0 0│
│ 0 1 0│
│ 0 0 1│
└ ┘
julia> using LinearAlgebra

julia> Matrix{Int8}(I,3,3)
3×3 Matrix{Int8}:
 1 0 0
 0 1 0
 0 0 1
Line 16: Line 26:

----
Line 19: Line 31:
== Permutation Matrix == == Permutation Matrices ==
Line 21: Line 33:
The '''permutation matrix''' multiplied by matrix A returns matrix C which is a mirrored transformation of A.

This matrix is simply a diagonal line of 1s in a matrix of 0s, but going the opposite direction as compared to an identity matrix
A '''permutation matrix''' is a square matrix of zeros with a one in each row. Multiplying a permutation matrix by some matrix '''''A''''' ('''''PA''''') results in a row-exchanged '''''A'''''. Multiplying some matrix '''''A''''' by a permutation matrix ('''''AP''''') results in a column-exhanged '''''A'''''.
Line 26: Line 36:
┌ ┐
│ 0 0 1│
│ 0 1 0│
│ 1 0 0│
└ ┘
julia> P = Matrix{Int8}(I,3,3)[:,[3,2,1]]
3×3 Matrix{Int8}:
 0 0 1
 0 1 0
 1 0 0

julia> A = [1 2 3; 4 5 6; 7 8 9]
3×3 Matrix{Int64}:
 1 2 3
 4 5 6
 7 8 9

julia> P * A
3×3 Matrix{Int64}:
 7 8 9
 4 5 6
 1 2 3

julia> A * P
3×3 Matrix{Int64}:
 3 2 1
 6 5 4
 9 8 7
Line 33: Line 61:
Note that a permutation matrix can mirror either the rows or columns of matrix A, depending simply on the order. The transpose permutation matrix is the same as the inverse permutation matrix: '''''P'''^T^ = '''P'''^-1^''.

The transpose permutation matrix multiplied by the permutation matrix is the same as the identity matrix: '''''P'''^T^'''P''' = '''I'''''



=== Counting Permutations ===

For 3 by 3 matrices, there are 6 possible permutation matrices. They are often denoted based on the rows they exchange, such as '''''P''',,2 3,,''.
Line 36: Line 72:
┌ ┐┌ ┐ ┌ ┐
│ 0 1│| 1 2| | 3 4|
│ 1 0│| 3 4|=| 1 2|
└ ┘└ ┘ └ ┘
┌ ┐ ┌ ┐ ┌ ┐ ┌ ┐ ┌ ┐ ┌ ┐
│ 1 0 0│ │ 1 0 0│ │ 0 1 0│ │ 0 1 0│ │ 0 0 1│ │ 0 0 1│
│ 0 1 0│ │ 0 0 1│ │ 1 0 0│ │ 0 0 1│ │ 1 0 0│ │ 0 1 0│
│ 0 0 1│ │ 0 1 0│ │ 0 0 1│ │ 1 0 0│ │ 0 1 0│ │ 1 0 0│
└ ┘ └ ┘ └ ┘ └ ┘ └ ┘ └ ┘
(identity matrix) P P (and so on...)
                     2,3 1,2
}}}
Line 41: Line 81:
┌ ┐┌ ┐ ┌ ┐
| 1 2|│ 0 1│ | 2 1|
| 3 4|│ 1 0│=| 4 3|
└ ┘└ ┘ └ ┘
}}}
For any ''n'' by ''n'' matrix, there are ''n''! possible permutation matrices.

----



== Upper Triangular Matrices ==

If a square matrix has only zeros below the diagonal, it is an '''upper triangular matrix'''.

[[LinearAlgebra/Elimination|Gauss-Jordan elimination]] results in a '''row echelon form''' of '''''A''''' which, if '''''A''''' is square, is also upper triangular.

[[LinearAlgebra/Orthonormalization|Gram-Schmidt orthonormalization]] is characterized as '''''A = QR''''' where '''''R''''' is upper triangular.

----



== Lower Triangular Matrices ==

If a square matrix has only zeros above the diagonal, it is a '''lower triangular matrix'''.

If [[LinearAlgebra/Elimination|Gauss-Jordan elimination]] is continued into backwards elimination, it results in a '''reduced row echelon form''' of '''''A'''''. If '''''A''''' is square, it will be both upper and lower triangular.

----



== Diagonal Matrices ==

A '''diagonal matrix''' is a diagonal line of numbers in a square matrix of zeros.

The columns of a diagonal matrix are its [[LinearAlgebra/EigenvaluesAndEigenvectors|eigenvectors]], and the numbers in the diagonal are the [[LinearAlgebra/EigenvaluesAndEigenvectors|eigenvalues]].

Special Matrices

These special matrices are core concepts to linear algebra.


Identity Matrix

The identity matrix is a diagonal line of ones in a square matrix of zeros.

Any matrix A multiplied by the (appropriately sized) identity matrix returns matrix A.

julia> using LinearAlgebra

julia> Matrix{Int8}(I,3,3)
3×3 Matrix{Int8}:
 1  0  0
 0  1  0
 0  0  1


Permutation Matrices

A permutation matrix is a square matrix of zeros with a one in each row. Multiplying a permutation matrix by some matrix A (PA) results in a row-exchanged A. Multiplying some matrix A by a permutation matrix (AP) results in a column-exhanged A.

julia> P = Matrix{Int8}(I,3,3)[:,[3,2,1]]
3×3 Matrix{Int8}:
 0  0  1
 0  1  0
 1  0  0

julia> A = [1 2 3; 4 5 6; 7 8 9]
3×3 Matrix{Int64}:
 1  2  3
 4  5  6
 7  8  9

julia> P * A
3×3 Matrix{Int64}:
 7  8  9
 4  5  6
 1  2  3

julia> A * P
3×3 Matrix{Int64}:
 3  2  1
 6  5  4
 9  8  7

The transpose permutation matrix is the same as the inverse permutation matrix: PT = P-1.

The transpose permutation matrix multiplied by the permutation matrix is the same as the identity matrix: PTP = I

Counting Permutations

For 3 by 3 matrices, there are 6 possible permutation matrices. They are often denoted based on the rows they exchange, such as P2 3.

┌      ┐          ┌      ┐ ┌      ┐ ┌      ┐ ┌      ┐ ┌      ┐
│ 1 0 0│          │ 1 0 0│ │ 0 1 0│ │ 0 1 0│ │ 0 0 1│ │ 0 0 1│
│ 0 1 0│          │ 0 0 1│ │ 1 0 0│ │ 0 0 1│ │ 1 0 0│ │ 0 1 0│
│ 0 0 1│          │ 0 1 0│ │ 0 0 1│ │ 1 0 0│ │ 0 1 0│ │ 1 0 0│
└      ┘          └      ┘ └      ┘ └      ┘ └      ┘ └      ┘
(identity matrix)   P        P        (and so on...)
                     2,3      1,2

For any n by n matrix, there are n! possible permutation matrices.


Upper Triangular Matrices

If a square matrix has only zeros below the diagonal, it is an upper triangular matrix.

Gauss-Jordan elimination results in a row echelon form of A which, if A is square, is also upper triangular.

Gram-Schmidt orthonormalization is characterized as A = QR where R is upper triangular.


Lower Triangular Matrices

If a square matrix has only zeros above the diagonal, it is a lower triangular matrix.

If Gauss-Jordan elimination is continued into backwards elimination, it results in a reduced row echelon form of A. If A is square, it will be both upper and lower triangular.


Diagonal Matrices

A diagonal matrix is a diagonal line of numbers in a square matrix of zeros.

The columns of a diagonal matrix are its eigenvectors, and the numbers in the diagonal are the eigenvalues.


CategoryRicottone

LinearAlgebra/SpecialMatrices (last edited 2024-01-30 15:45:39 by DominicRicottone)