|
Size: 1826
Comment: Fixed style: matrices are bold, vectors are not
|
Size: 2380
Comment: Reorganized
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 2: | Line 2: |
'''Orthogonality''' is an important property for relating two vectors, or two subspaces, or a vector and a plane. |
|
| Line 9: | Line 11: |
| == Test == | == Vectors == |
| Line 11: | Line 13: |
| The test for orthogonality of two vectors is ''x^T^y = 0''. | The concept of '''orthogonality''' is a generalization of '''perpendicularity''' in 2-dimensional space. |
| Line 13: | Line 15: |
| The Pythagorean theorem specifies that for two sides of a right triangle, ''x'' and ''y'', the hypotenuse ''z'' is characterized by ''x^2^ + y^2^ = z^2^''. | The Pythagorean theorem specifies that the sides of a right triangle are characterized by ''x^2^ + y^2^ = z^2^''. |
| Line 17: | Line 19: |
| For a similar reason, the total length of the hypotenuse can be thought of as the sum of the other two vectors. Instead of characterizing a vector ''z'', we can use ''(x+y)^T^(x+y)''. For example, if ''x'' is ''[1 2 3]'' and ''y'' is ''[2 -1 0]'', it should be understood that ''z'' is ''[3 1 3]''. | For a similar reason, the total length of the hypotenuse can be thought of as the sum of the other two vectors: ''x+y''. Continuing with the example for ''x'', if ''y'' were ''[2 -1 0]'', then ''z'' would be ''[3 1 3]''. Note that the squared length can be written as ''(x+y)^T^(x+y)''. |
| Line 19: | Line 21: |
| If the vectors ''x'' and ''y'' are perpendicular, or '''orthogonal''', then the Pythagorean theorem should hold. ''x^T^x + y^T^y = (x+y)^T^(x+y)''. This expands to ''x^T^x + y^T^y = x^T^x + y^T^y + x^T^y + y^T^x''. By cancelling out common terms, this simplifies to ''0 = x^T^y + y^T^x''. | If the vectors ''x'' and ''y'' are perpendicular then the Pythagorean theorem should hold: ''x^T^x + y^T^y = (x+y)^T^(x+y)''. This expands to ''x^T^x + y^T^y = x^T^x + y^T^y + x^T^y + y^T^x''. By cancelling out common terms, this simplifies to ''0 = x^T^y + y^T^x''. |
| Line 22: | Line 24: |
The test for orthogonality of two vectors is ''x^T^y = 0''. |
|
| Line 27: | Line 31: |
| == Application == | == Subspaces == |
| Line 31: | Line 35: |
| The [[LinearAlgebra/NullSpaces|null space]] of '''''A''''' (a.k.a. ''N('''A''')'') is orthogonal to the row space of '''''A''''' (a.k.a. ''R('''A''')''). The [[LinearAlgebra/NullSpaces|null space]] of '''''A'''^T^'' (a.k.a. ''N('''A'''^T^)'') is orthogonal to the column space of '''''A''''' (a.k.a. ''C('''A''')''). | ---- == Matrices == The [[LinearAlgebra/NullSpaces|null space]] of a matrix '''''A''''' contains the vectors that are not in the row space. These vectors cancel out; they are not a linear combination of the rows; if the row space is a plane, then these vectors are not on that plane. The null space of '''''A''''' (a.k.a. ''N('''A''')'') is '''orthogonal''' to the row space of '''''A''''' (a.k.a. ''R('''A''')''). The null space of '''''A'''^T^'' (a.k.a. ''N('''A'''^T^)'') is orthogonal to the column space of '''''A''''' (a.k.a. ''C('''A''')''). Commonly this means that the row and column spaces are planes while the null spaces of '''''A''''' and '''''A'''^T^'' are vectors, but that isn't always true. |
Orthogonality
Orthogonality is an important property for relating two vectors, or two subspaces, or a vector and a plane.
Contents
Vectors
The concept of orthogonality is a generalization of perpendicularity in 2-dimensional space.
The Pythagorean theorem specifies that the sides of a right triangle are characterized by x2 + y2 = z2.
For a vector x, the total length can be thought of as the sum of each components' absolute value. If x is [1 2 3], the length is 6. The squared length can be thought of as the sum of each components' square. For the same x, this is 14. This can be generalized as xTx.
For a similar reason, the total length of the hypotenuse can be thought of as the sum of the other two vectors: x+y. Continuing with the example for x, if y were [2 -1 0], then z would be [3 1 3]. Note that the squared length can be written as (x+y)T(x+y).
If the vectors x and y are perpendicular then the Pythagorean theorem should hold: xTx + yTy = (x+y)T(x+y). This expands to xTx + yTy = xTx + yTy + xTy + yTx. By cancelling out common terms, this simplifies to 0 = xTy + yTx.
It must be understood that the last two terms are the same value. Therefore, this further simplifies to 0 = 2xTy and finally to 0 = xTy.
The test for orthogonality of two vectors is xTy = 0.
Subspaces
For a subspace S to be orthogonal to a subspace T, every vector in S must be orthogonal to every vector in T.
Matrices
The null space of a matrix A contains the vectors that are not in the row space. These vectors cancel out; they are not a linear combination of the rows; if the row space is a plane, then these vectors are not on that plane.
The null space of A (a.k.a. N(A)) is orthogonal to the row space of A (a.k.a. R(A)). The null space of AT (a.k.a. N(AT)) is orthogonal to the column space of A (a.k.a. C(A)). Commonly this means that the row and column spaces are planes while the null spaces of A and AT are vectors, but that isn't always true.