Polar decomposition of real matrices
$begingroup$
Can we decompose real matrices in a way that is analogous to polar decomposition in the complex case?
What I mean is: given an invertible real matrix $M$, can we always write:
$$
M = OP,
$$
maybe uniquely, where $O$ is orthogonal, and $P$ is symmetric positive-definite?
Thanks.
linear-algebra matrix-decomposition
$endgroup$
add a comment |
$begingroup$
Can we decompose real matrices in a way that is analogous to polar decomposition in the complex case?
What I mean is: given an invertible real matrix $M$, can we always write:
$$
M = OP,
$$
maybe uniquely, where $O$ is orthogonal, and $P$ is symmetric positive-definite?
Thanks.
linear-algebra matrix-decomposition
$endgroup$
$begingroup$
en.wikipedia.org/wiki/Polar_decomposition
$endgroup$
– Bill Cook
Sep 29 '15 at 11:56
$begingroup$
@BillCook More or less... oh wait, I forgot symmetry!
$endgroup$
– geodude
Sep 29 '15 at 11:57
$begingroup$
The answer is yes. This is a consequence of the spectral theorem, whereby $M^TM$ can be orthogonally diagonalized.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 14:37
$begingroup$
@Omnomnomnom Wow. Can you explain more? (Or make it into an answer?)
$endgroup$
– geodude
Sep 29 '15 at 14:39
add a comment |
$begingroup$
Can we decompose real matrices in a way that is analogous to polar decomposition in the complex case?
What I mean is: given an invertible real matrix $M$, can we always write:
$$
M = OP,
$$
maybe uniquely, where $O$ is orthogonal, and $P$ is symmetric positive-definite?
Thanks.
linear-algebra matrix-decomposition
$endgroup$
Can we decompose real matrices in a way that is analogous to polar decomposition in the complex case?
What I mean is: given an invertible real matrix $M$, can we always write:
$$
M = OP,
$$
maybe uniquely, where $O$ is orthogonal, and $P$ is symmetric positive-definite?
Thanks.
linear-algebra matrix-decomposition
linear-algebra matrix-decomposition
edited Sep 29 '15 at 11:58
geodude
asked Sep 29 '15 at 11:52


geodudegeodude
4,1261343
4,1261343
$begingroup$
en.wikipedia.org/wiki/Polar_decomposition
$endgroup$
– Bill Cook
Sep 29 '15 at 11:56
$begingroup$
@BillCook More or less... oh wait, I forgot symmetry!
$endgroup$
– geodude
Sep 29 '15 at 11:57
$begingroup$
The answer is yes. This is a consequence of the spectral theorem, whereby $M^TM$ can be orthogonally diagonalized.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 14:37
$begingroup$
@Omnomnomnom Wow. Can you explain more? (Or make it into an answer?)
$endgroup$
– geodude
Sep 29 '15 at 14:39
add a comment |
$begingroup$
en.wikipedia.org/wiki/Polar_decomposition
$endgroup$
– Bill Cook
Sep 29 '15 at 11:56
$begingroup$
@BillCook More or less... oh wait, I forgot symmetry!
$endgroup$
– geodude
Sep 29 '15 at 11:57
$begingroup$
The answer is yes. This is a consequence of the spectral theorem, whereby $M^TM$ can be orthogonally diagonalized.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 14:37
$begingroup$
@Omnomnomnom Wow. Can you explain more? (Or make it into an answer?)
$endgroup$
– geodude
Sep 29 '15 at 14:39
$begingroup$
en.wikipedia.org/wiki/Polar_decomposition
$endgroup$
– Bill Cook
Sep 29 '15 at 11:56
$begingroup$
en.wikipedia.org/wiki/Polar_decomposition
$endgroup$
– Bill Cook
Sep 29 '15 at 11:56
$begingroup$
@BillCook More or less... oh wait, I forgot symmetry!
$endgroup$
– geodude
Sep 29 '15 at 11:57
$begingroup$
@BillCook More or less... oh wait, I forgot symmetry!
$endgroup$
– geodude
Sep 29 '15 at 11:57
$begingroup$
The answer is yes. This is a consequence of the spectral theorem, whereby $M^TM$ can be orthogonally diagonalized.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 14:37
$begingroup$
The answer is yes. This is a consequence of the spectral theorem, whereby $M^TM$ can be orthogonally diagonalized.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 14:37
$begingroup$
@Omnomnomnom Wow. Can you explain more? (Or make it into an answer?)
$endgroup$
– geodude
Sep 29 '15 at 14:39
$begingroup$
@Omnomnomnom Wow. Can you explain more? (Or make it into an answer?)
$endgroup$
– geodude
Sep 29 '15 at 14:39
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
The answer is yes. In fact, we don't need the spectral theorem to prove it.
Suppose that $M$ is a real invertible matrix. Then $M^TM$ is positive definite and has the unique positive semidefinite square root $P = sqrt{M^TM}$. Now, note that $P$ has the property $|Px| = |Mx|$ for all vectors $x$.
If $M$ is invertible, then $P$ is invertible as well, and we have $M = (MP^{-1})P$. We note that $MP^{-1}$ is orthogonal since for all $y = Px$, we have
$$
|MP^{-1}y| = |y|
$$
Thus, we have a polar decomposition with $O =( MP^{-1})$ .
We note that this decomposition is unique. In particular, suppose $M = OP$ for orthogonal $O$ and positive $P$. then
$$
M^TM = PO^TOP = P^2
$$
And so, by the uniqueness of positive definite square roots, $P$ is uniquely determined. Then we can rearrange $M = OP$ to find $O = MP^{-1}$ is also unique determined.
Things get a bit trickier when $M$ is not invertible, but we can still guarantee a (non-unique) polar decomposition.
$endgroup$
$begingroup$
This can also be derived easily from the singular value decomposition.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 15:01
$begingroup$
Wait...how do you prove that $PM^{-1}P=M$?
$endgroup$
– geodude
Sep 30 '15 at 12:36
$begingroup$
I think I meant to write $MP^{-1}$... the proof is pretty much the same, though. The only other thing we need to show is that $M$ invertible $iff$ $M^TM$ invertible $iff$ $P$ invertible, which isn't too hard.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:10
$begingroup$
See my latest edit.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:12
$begingroup$
Oh yeah, like this it works! Thanks.
$endgroup$
– geodude
Sep 30 '15 at 13:29
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f1456320%2fpolar-decomposition-of-real-matrices%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
The answer is yes. In fact, we don't need the spectral theorem to prove it.
Suppose that $M$ is a real invertible matrix. Then $M^TM$ is positive definite and has the unique positive semidefinite square root $P = sqrt{M^TM}$. Now, note that $P$ has the property $|Px| = |Mx|$ for all vectors $x$.
If $M$ is invertible, then $P$ is invertible as well, and we have $M = (MP^{-1})P$. We note that $MP^{-1}$ is orthogonal since for all $y = Px$, we have
$$
|MP^{-1}y| = |y|
$$
Thus, we have a polar decomposition with $O =( MP^{-1})$ .
We note that this decomposition is unique. In particular, suppose $M = OP$ for orthogonal $O$ and positive $P$. then
$$
M^TM = PO^TOP = P^2
$$
And so, by the uniqueness of positive definite square roots, $P$ is uniquely determined. Then we can rearrange $M = OP$ to find $O = MP^{-1}$ is also unique determined.
Things get a bit trickier when $M$ is not invertible, but we can still guarantee a (non-unique) polar decomposition.
$endgroup$
$begingroup$
This can also be derived easily from the singular value decomposition.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 15:01
$begingroup$
Wait...how do you prove that $PM^{-1}P=M$?
$endgroup$
– geodude
Sep 30 '15 at 12:36
$begingroup$
I think I meant to write $MP^{-1}$... the proof is pretty much the same, though. The only other thing we need to show is that $M$ invertible $iff$ $M^TM$ invertible $iff$ $P$ invertible, which isn't too hard.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:10
$begingroup$
See my latest edit.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:12
$begingroup$
Oh yeah, like this it works! Thanks.
$endgroup$
– geodude
Sep 30 '15 at 13:29
add a comment |
$begingroup$
The answer is yes. In fact, we don't need the spectral theorem to prove it.
Suppose that $M$ is a real invertible matrix. Then $M^TM$ is positive definite and has the unique positive semidefinite square root $P = sqrt{M^TM}$. Now, note that $P$ has the property $|Px| = |Mx|$ for all vectors $x$.
If $M$ is invertible, then $P$ is invertible as well, and we have $M = (MP^{-1})P$. We note that $MP^{-1}$ is orthogonal since for all $y = Px$, we have
$$
|MP^{-1}y| = |y|
$$
Thus, we have a polar decomposition with $O =( MP^{-1})$ .
We note that this decomposition is unique. In particular, suppose $M = OP$ for orthogonal $O$ and positive $P$. then
$$
M^TM = PO^TOP = P^2
$$
And so, by the uniqueness of positive definite square roots, $P$ is uniquely determined. Then we can rearrange $M = OP$ to find $O = MP^{-1}$ is also unique determined.
Things get a bit trickier when $M$ is not invertible, but we can still guarantee a (non-unique) polar decomposition.
$endgroup$
$begingroup$
This can also be derived easily from the singular value decomposition.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 15:01
$begingroup$
Wait...how do you prove that $PM^{-1}P=M$?
$endgroup$
– geodude
Sep 30 '15 at 12:36
$begingroup$
I think I meant to write $MP^{-1}$... the proof is pretty much the same, though. The only other thing we need to show is that $M$ invertible $iff$ $M^TM$ invertible $iff$ $P$ invertible, which isn't too hard.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:10
$begingroup$
See my latest edit.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:12
$begingroup$
Oh yeah, like this it works! Thanks.
$endgroup$
– geodude
Sep 30 '15 at 13:29
add a comment |
$begingroup$
The answer is yes. In fact, we don't need the spectral theorem to prove it.
Suppose that $M$ is a real invertible matrix. Then $M^TM$ is positive definite and has the unique positive semidefinite square root $P = sqrt{M^TM}$. Now, note that $P$ has the property $|Px| = |Mx|$ for all vectors $x$.
If $M$ is invertible, then $P$ is invertible as well, and we have $M = (MP^{-1})P$. We note that $MP^{-1}$ is orthogonal since for all $y = Px$, we have
$$
|MP^{-1}y| = |y|
$$
Thus, we have a polar decomposition with $O =( MP^{-1})$ .
We note that this decomposition is unique. In particular, suppose $M = OP$ for orthogonal $O$ and positive $P$. then
$$
M^TM = PO^TOP = P^2
$$
And so, by the uniqueness of positive definite square roots, $P$ is uniquely determined. Then we can rearrange $M = OP$ to find $O = MP^{-1}$ is also unique determined.
Things get a bit trickier when $M$ is not invertible, but we can still guarantee a (non-unique) polar decomposition.
$endgroup$
The answer is yes. In fact, we don't need the spectral theorem to prove it.
Suppose that $M$ is a real invertible matrix. Then $M^TM$ is positive definite and has the unique positive semidefinite square root $P = sqrt{M^TM}$. Now, note that $P$ has the property $|Px| = |Mx|$ for all vectors $x$.
If $M$ is invertible, then $P$ is invertible as well, and we have $M = (MP^{-1})P$. We note that $MP^{-1}$ is orthogonal since for all $y = Px$, we have
$$
|MP^{-1}y| = |y|
$$
Thus, we have a polar decomposition with $O =( MP^{-1})$ .
We note that this decomposition is unique. In particular, suppose $M = OP$ for orthogonal $O$ and positive $P$. then
$$
M^TM = PO^TOP = P^2
$$
And so, by the uniqueness of positive definite square roots, $P$ is uniquely determined. Then we can rearrange $M = OP$ to find $O = MP^{-1}$ is also unique determined.
Things get a bit trickier when $M$ is not invertible, but we can still guarantee a (non-unique) polar decomposition.
edited Jan 16 at 16:08


SRJ
1,8081620
1,8081620
answered Sep 29 '15 at 15:00
OmnomnomnomOmnomnomnom
128k791184
128k791184
$begingroup$
This can also be derived easily from the singular value decomposition.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 15:01
$begingroup$
Wait...how do you prove that $PM^{-1}P=M$?
$endgroup$
– geodude
Sep 30 '15 at 12:36
$begingroup$
I think I meant to write $MP^{-1}$... the proof is pretty much the same, though. The only other thing we need to show is that $M$ invertible $iff$ $M^TM$ invertible $iff$ $P$ invertible, which isn't too hard.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:10
$begingroup$
See my latest edit.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:12
$begingroup$
Oh yeah, like this it works! Thanks.
$endgroup$
– geodude
Sep 30 '15 at 13:29
add a comment |
$begingroup$
This can also be derived easily from the singular value decomposition.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 15:01
$begingroup$
Wait...how do you prove that $PM^{-1}P=M$?
$endgroup$
– geodude
Sep 30 '15 at 12:36
$begingroup$
I think I meant to write $MP^{-1}$... the proof is pretty much the same, though. The only other thing we need to show is that $M$ invertible $iff$ $M^TM$ invertible $iff$ $P$ invertible, which isn't too hard.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:10
$begingroup$
See my latest edit.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:12
$begingroup$
Oh yeah, like this it works! Thanks.
$endgroup$
– geodude
Sep 30 '15 at 13:29
$begingroup$
This can also be derived easily from the singular value decomposition.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 15:01
$begingroup$
This can also be derived easily from the singular value decomposition.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 15:01
$begingroup$
Wait...how do you prove that $PM^{-1}P=M$?
$endgroup$
– geodude
Sep 30 '15 at 12:36
$begingroup$
Wait...how do you prove that $PM^{-1}P=M$?
$endgroup$
– geodude
Sep 30 '15 at 12:36
$begingroup$
I think I meant to write $MP^{-1}$... the proof is pretty much the same, though. The only other thing we need to show is that $M$ invertible $iff$ $M^TM$ invertible $iff$ $P$ invertible, which isn't too hard.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:10
$begingroup$
I think I meant to write $MP^{-1}$... the proof is pretty much the same, though. The only other thing we need to show is that $M$ invertible $iff$ $M^TM$ invertible $iff$ $P$ invertible, which isn't too hard.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:10
$begingroup$
See my latest edit.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:12
$begingroup$
See my latest edit.
$endgroup$
– Omnomnomnom
Sep 30 '15 at 13:12
$begingroup$
Oh yeah, like this it works! Thanks.
$endgroup$
– geodude
Sep 30 '15 at 13:29
$begingroup$
Oh yeah, like this it works! Thanks.
$endgroup$
– geodude
Sep 30 '15 at 13:29
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f1456320%2fpolar-decomposition-of-real-matrices%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
en.wikipedia.org/wiki/Polar_decomposition
$endgroup$
– Bill Cook
Sep 29 '15 at 11:56
$begingroup$
@BillCook More or less... oh wait, I forgot symmetry!
$endgroup$
– geodude
Sep 29 '15 at 11:57
$begingroup$
The answer is yes. This is a consequence of the spectral theorem, whereby $M^TM$ can be orthogonally diagonalized.
$endgroup$
– Omnomnomnom
Sep 29 '15 at 14:37
$begingroup$
@Omnomnomnom Wow. Can you explain more? (Or make it into an answer?)
$endgroup$
– geodude
Sep 29 '15 at 14:39