What are the conditions on $text{tr}(AB) leq text{tr(A)} text{tr(B)}$ to be true?
$begingroup$
Let $A$ and $B$ be two arbitrary matrix with proper dimension for multiplication.
Consider this trace inequlaty which is trace of multiplication of two matrices versus their individual traces
$$text{tr}(AB) leq text{tr(A)} text{tr(B)}$$
1- Do we have result for rectangular matrix that satisfy this inequality?
2- If they were square matrices what are the conditions?
3- Is there any specific name for this inequality?
linear-algebra matrices trace
$endgroup$
add a comment |
$begingroup$
Let $A$ and $B$ be two arbitrary matrix with proper dimension for multiplication.
Consider this trace inequlaty which is trace of multiplication of two matrices versus their individual traces
$$text{tr}(AB) leq text{tr(A)} text{tr(B)}$$
1- Do we have result for rectangular matrix that satisfy this inequality?
2- If they were square matrices what are the conditions?
3- Is there any specific name for this inequality?
linear-algebra matrices trace
$endgroup$
2
$begingroup$
How do you define the trace of a matrix which is not a square? In case you take $A=B$ this equivalent to $$sum_{i=1}^n lambda_i^2 leq left(sum_{i=1}^n lambda_i right)^2$$
$endgroup$
– Severin Schraven
Jan 4 at 17:39
$begingroup$
If we have a $mtimes n$-matrix, and $k:=min(m,n)$, the definition $$tr(A)=sum_{j=1}^k a_{jj}$$ would make sense.
$endgroup$
– Peter
Jan 4 at 17:43
$begingroup$
@Peter You are right, I was thinking about something which is coordinate-free.
$endgroup$
– Severin Schraven
Jan 4 at 17:45
$begingroup$
@Severin Schraven: peter answered that. But to get into the problem, let they be square first and focus on 2 and 3.
$endgroup$
– Saeed
Jan 4 at 17:46
add a comment |
$begingroup$
Let $A$ and $B$ be two arbitrary matrix with proper dimension for multiplication.
Consider this trace inequlaty which is trace of multiplication of two matrices versus their individual traces
$$text{tr}(AB) leq text{tr(A)} text{tr(B)}$$
1- Do we have result for rectangular matrix that satisfy this inequality?
2- If they were square matrices what are the conditions?
3- Is there any specific name for this inequality?
linear-algebra matrices trace
$endgroup$
Let $A$ and $B$ be two arbitrary matrix with proper dimension for multiplication.
Consider this trace inequlaty which is trace of multiplication of two matrices versus their individual traces
$$text{tr}(AB) leq text{tr(A)} text{tr(B)}$$
1- Do we have result for rectangular matrix that satisfy this inequality?
2- If they were square matrices what are the conditions?
3- Is there any specific name for this inequality?
linear-algebra matrices trace
linear-algebra matrices trace
asked Jan 4 at 17:29
SaeedSaeed
969310
969310
2
$begingroup$
How do you define the trace of a matrix which is not a square? In case you take $A=B$ this equivalent to $$sum_{i=1}^n lambda_i^2 leq left(sum_{i=1}^n lambda_i right)^2$$
$endgroup$
– Severin Schraven
Jan 4 at 17:39
$begingroup$
If we have a $mtimes n$-matrix, and $k:=min(m,n)$, the definition $$tr(A)=sum_{j=1}^k a_{jj}$$ would make sense.
$endgroup$
– Peter
Jan 4 at 17:43
$begingroup$
@Peter You are right, I was thinking about something which is coordinate-free.
$endgroup$
– Severin Schraven
Jan 4 at 17:45
$begingroup$
@Severin Schraven: peter answered that. But to get into the problem, let they be square first and focus on 2 and 3.
$endgroup$
– Saeed
Jan 4 at 17:46
add a comment |
2
$begingroup$
How do you define the trace of a matrix which is not a square? In case you take $A=B$ this equivalent to $$sum_{i=1}^n lambda_i^2 leq left(sum_{i=1}^n lambda_i right)^2$$
$endgroup$
– Severin Schraven
Jan 4 at 17:39
$begingroup$
If we have a $mtimes n$-matrix, and $k:=min(m,n)$, the definition $$tr(A)=sum_{j=1}^k a_{jj}$$ would make sense.
$endgroup$
– Peter
Jan 4 at 17:43
$begingroup$
@Peter You are right, I was thinking about something which is coordinate-free.
$endgroup$
– Severin Schraven
Jan 4 at 17:45
$begingroup$
@Severin Schraven: peter answered that. But to get into the problem, let they be square first and focus on 2 and 3.
$endgroup$
– Saeed
Jan 4 at 17:46
2
2
$begingroup$
How do you define the trace of a matrix which is not a square? In case you take $A=B$ this equivalent to $$sum_{i=1}^n lambda_i^2 leq left(sum_{i=1}^n lambda_i right)^2$$
$endgroup$
– Severin Schraven
Jan 4 at 17:39
$begingroup$
How do you define the trace of a matrix which is not a square? In case you take $A=B$ this equivalent to $$sum_{i=1}^n lambda_i^2 leq left(sum_{i=1}^n lambda_i right)^2$$
$endgroup$
– Severin Schraven
Jan 4 at 17:39
$begingroup$
If we have a $mtimes n$-matrix, and $k:=min(m,n)$, the definition $$tr(A)=sum_{j=1}^k a_{jj}$$ would make sense.
$endgroup$
– Peter
Jan 4 at 17:43
$begingroup$
If we have a $mtimes n$-matrix, and $k:=min(m,n)$, the definition $$tr(A)=sum_{j=1}^k a_{jj}$$ would make sense.
$endgroup$
– Peter
Jan 4 at 17:43
$begingroup$
@Peter You are right, I was thinking about something which is coordinate-free.
$endgroup$
– Severin Schraven
Jan 4 at 17:45
$begingroup$
@Peter You are right, I was thinking about something which is coordinate-free.
$endgroup$
– Severin Schraven
Jan 4 at 17:45
$begingroup$
@Severin Schraven: peter answered that. But to get into the problem, let they be square first and focus on 2 and 3.
$endgroup$
– Saeed
Jan 4 at 17:46
$begingroup$
@Severin Schraven: peter answered that. But to get into the problem, let they be square first and focus on 2 and 3.
$endgroup$
– Saeed
Jan 4 at 17:46
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Can't think of anything deep, but if both $A$ and $B$ are positive semidefinite, the inequality is true because
$$
operatorname{tr}(AB)
=operatorname{tr}(A^{1/2}A^{1/2}B)
=operatorname{tr}(A^{1/2}BA^{1/2})
=|A^{1/2}B^{1/2}|_F^2le|A^{1/2}|_F^2|B^{1/2}|_F^2
=operatorname{tr}(A)operatorname{tr}(B).
$$
$endgroup$
$begingroup$
is there any name for this inequality?
$endgroup$
– Saeed
Jan 4 at 17:51
$begingroup$
Can you explain what $A^{1/2}$ is? When they are psd we have $A=U_ALambda_AU_A^T$ and $B=U_BLambda_BU_B^T$. So $text{tr}(U_ALambda_AU_A^TU_BLambda_BU_B^T)=text{tr}(U_B^TU_ALambda_AU_A^TU_BLambda_B)$, how can I get what you have?
$endgroup$
– Saeed
Jan 4 at 17:54
$begingroup$
What's that $F$ norm?
$endgroup$
– Yanko
Jan 4 at 17:57
$begingroup$
@Yanko $|cdot|_F$ denotes Frobenius norm.
$endgroup$
– user1551
Jan 4 at 18:00
$begingroup$
@Saeed $A^{1/2}$ is the (unique) positive semidefinite square root of $A$. If you orthogonally diagonalise $A$ as $QDQ^T$, then $A^{1/2}=QD^{1/2}Q^T$ where $D^{1/2}$ is the entrywise square root of $D$ (i.e. $D^{1/2}$ is the diagonal matrix whose diagonal entries are the square roots of their correspondents in $D$).
$endgroup$
– user1551
Jan 4 at 18:03
|
show 1 more comment
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3061871%2fwhat-are-the-conditions-on-texttrab-leq-texttra-texttrb-to-be%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Can't think of anything deep, but if both $A$ and $B$ are positive semidefinite, the inequality is true because
$$
operatorname{tr}(AB)
=operatorname{tr}(A^{1/2}A^{1/2}B)
=operatorname{tr}(A^{1/2}BA^{1/2})
=|A^{1/2}B^{1/2}|_F^2le|A^{1/2}|_F^2|B^{1/2}|_F^2
=operatorname{tr}(A)operatorname{tr}(B).
$$
$endgroup$
$begingroup$
is there any name for this inequality?
$endgroup$
– Saeed
Jan 4 at 17:51
$begingroup$
Can you explain what $A^{1/2}$ is? When they are psd we have $A=U_ALambda_AU_A^T$ and $B=U_BLambda_BU_B^T$. So $text{tr}(U_ALambda_AU_A^TU_BLambda_BU_B^T)=text{tr}(U_B^TU_ALambda_AU_A^TU_BLambda_B)$, how can I get what you have?
$endgroup$
– Saeed
Jan 4 at 17:54
$begingroup$
What's that $F$ norm?
$endgroup$
– Yanko
Jan 4 at 17:57
$begingroup$
@Yanko $|cdot|_F$ denotes Frobenius norm.
$endgroup$
– user1551
Jan 4 at 18:00
$begingroup$
@Saeed $A^{1/2}$ is the (unique) positive semidefinite square root of $A$. If you orthogonally diagonalise $A$ as $QDQ^T$, then $A^{1/2}=QD^{1/2}Q^T$ where $D^{1/2}$ is the entrywise square root of $D$ (i.e. $D^{1/2}$ is the diagonal matrix whose diagonal entries are the square roots of their correspondents in $D$).
$endgroup$
– user1551
Jan 4 at 18:03
|
show 1 more comment
$begingroup$
Can't think of anything deep, but if both $A$ and $B$ are positive semidefinite, the inequality is true because
$$
operatorname{tr}(AB)
=operatorname{tr}(A^{1/2}A^{1/2}B)
=operatorname{tr}(A^{1/2}BA^{1/2})
=|A^{1/2}B^{1/2}|_F^2le|A^{1/2}|_F^2|B^{1/2}|_F^2
=operatorname{tr}(A)operatorname{tr}(B).
$$
$endgroup$
$begingroup$
is there any name for this inequality?
$endgroup$
– Saeed
Jan 4 at 17:51
$begingroup$
Can you explain what $A^{1/2}$ is? When they are psd we have $A=U_ALambda_AU_A^T$ and $B=U_BLambda_BU_B^T$. So $text{tr}(U_ALambda_AU_A^TU_BLambda_BU_B^T)=text{tr}(U_B^TU_ALambda_AU_A^TU_BLambda_B)$, how can I get what you have?
$endgroup$
– Saeed
Jan 4 at 17:54
$begingroup$
What's that $F$ norm?
$endgroup$
– Yanko
Jan 4 at 17:57
$begingroup$
@Yanko $|cdot|_F$ denotes Frobenius norm.
$endgroup$
– user1551
Jan 4 at 18:00
$begingroup$
@Saeed $A^{1/2}$ is the (unique) positive semidefinite square root of $A$. If you orthogonally diagonalise $A$ as $QDQ^T$, then $A^{1/2}=QD^{1/2}Q^T$ where $D^{1/2}$ is the entrywise square root of $D$ (i.e. $D^{1/2}$ is the diagonal matrix whose diagonal entries are the square roots of their correspondents in $D$).
$endgroup$
– user1551
Jan 4 at 18:03
|
show 1 more comment
$begingroup$
Can't think of anything deep, but if both $A$ and $B$ are positive semidefinite, the inequality is true because
$$
operatorname{tr}(AB)
=operatorname{tr}(A^{1/2}A^{1/2}B)
=operatorname{tr}(A^{1/2}BA^{1/2})
=|A^{1/2}B^{1/2}|_F^2le|A^{1/2}|_F^2|B^{1/2}|_F^2
=operatorname{tr}(A)operatorname{tr}(B).
$$
$endgroup$
Can't think of anything deep, but if both $A$ and $B$ are positive semidefinite, the inequality is true because
$$
operatorname{tr}(AB)
=operatorname{tr}(A^{1/2}A^{1/2}B)
=operatorname{tr}(A^{1/2}BA^{1/2})
=|A^{1/2}B^{1/2}|_F^2le|A^{1/2}|_F^2|B^{1/2}|_F^2
=operatorname{tr}(A)operatorname{tr}(B).
$$
edited Jan 4 at 18:01
answered Jan 4 at 17:43


user1551user1551
72.3k566127
72.3k566127
$begingroup$
is there any name for this inequality?
$endgroup$
– Saeed
Jan 4 at 17:51
$begingroup$
Can you explain what $A^{1/2}$ is? When they are psd we have $A=U_ALambda_AU_A^T$ and $B=U_BLambda_BU_B^T$. So $text{tr}(U_ALambda_AU_A^TU_BLambda_BU_B^T)=text{tr}(U_B^TU_ALambda_AU_A^TU_BLambda_B)$, how can I get what you have?
$endgroup$
– Saeed
Jan 4 at 17:54
$begingroup$
What's that $F$ norm?
$endgroup$
– Yanko
Jan 4 at 17:57
$begingroup$
@Yanko $|cdot|_F$ denotes Frobenius norm.
$endgroup$
– user1551
Jan 4 at 18:00
$begingroup$
@Saeed $A^{1/2}$ is the (unique) positive semidefinite square root of $A$. If you orthogonally diagonalise $A$ as $QDQ^T$, then $A^{1/2}=QD^{1/2}Q^T$ where $D^{1/2}$ is the entrywise square root of $D$ (i.e. $D^{1/2}$ is the diagonal matrix whose diagonal entries are the square roots of their correspondents in $D$).
$endgroup$
– user1551
Jan 4 at 18:03
|
show 1 more comment
$begingroup$
is there any name for this inequality?
$endgroup$
– Saeed
Jan 4 at 17:51
$begingroup$
Can you explain what $A^{1/2}$ is? When they are psd we have $A=U_ALambda_AU_A^T$ and $B=U_BLambda_BU_B^T$. So $text{tr}(U_ALambda_AU_A^TU_BLambda_BU_B^T)=text{tr}(U_B^TU_ALambda_AU_A^TU_BLambda_B)$, how can I get what you have?
$endgroup$
– Saeed
Jan 4 at 17:54
$begingroup$
What's that $F$ norm?
$endgroup$
– Yanko
Jan 4 at 17:57
$begingroup$
@Yanko $|cdot|_F$ denotes Frobenius norm.
$endgroup$
– user1551
Jan 4 at 18:00
$begingroup$
@Saeed $A^{1/2}$ is the (unique) positive semidefinite square root of $A$. If you orthogonally diagonalise $A$ as $QDQ^T$, then $A^{1/2}=QD^{1/2}Q^T$ where $D^{1/2}$ is the entrywise square root of $D$ (i.e. $D^{1/2}$ is the diagonal matrix whose diagonal entries are the square roots of their correspondents in $D$).
$endgroup$
– user1551
Jan 4 at 18:03
$begingroup$
is there any name for this inequality?
$endgroup$
– Saeed
Jan 4 at 17:51
$begingroup$
is there any name for this inequality?
$endgroup$
– Saeed
Jan 4 at 17:51
$begingroup$
Can you explain what $A^{1/2}$ is? When they are psd we have $A=U_ALambda_AU_A^T$ and $B=U_BLambda_BU_B^T$. So $text{tr}(U_ALambda_AU_A^TU_BLambda_BU_B^T)=text{tr}(U_B^TU_ALambda_AU_A^TU_BLambda_B)$, how can I get what you have?
$endgroup$
– Saeed
Jan 4 at 17:54
$begingroup$
Can you explain what $A^{1/2}$ is? When they are psd we have $A=U_ALambda_AU_A^T$ and $B=U_BLambda_BU_B^T$. So $text{tr}(U_ALambda_AU_A^TU_BLambda_BU_B^T)=text{tr}(U_B^TU_ALambda_AU_A^TU_BLambda_B)$, how can I get what you have?
$endgroup$
– Saeed
Jan 4 at 17:54
$begingroup$
What's that $F$ norm?
$endgroup$
– Yanko
Jan 4 at 17:57
$begingroup$
What's that $F$ norm?
$endgroup$
– Yanko
Jan 4 at 17:57
$begingroup$
@Yanko $|cdot|_F$ denotes Frobenius norm.
$endgroup$
– user1551
Jan 4 at 18:00
$begingroup$
@Yanko $|cdot|_F$ denotes Frobenius norm.
$endgroup$
– user1551
Jan 4 at 18:00
$begingroup$
@Saeed $A^{1/2}$ is the (unique) positive semidefinite square root of $A$. If you orthogonally diagonalise $A$ as $QDQ^T$, then $A^{1/2}=QD^{1/2}Q^T$ where $D^{1/2}$ is the entrywise square root of $D$ (i.e. $D^{1/2}$ is the diagonal matrix whose diagonal entries are the square roots of their correspondents in $D$).
$endgroup$
– user1551
Jan 4 at 18:03
$begingroup$
@Saeed $A^{1/2}$ is the (unique) positive semidefinite square root of $A$. If you orthogonally diagonalise $A$ as $QDQ^T$, then $A^{1/2}=QD^{1/2}Q^T$ where $D^{1/2}$ is the entrywise square root of $D$ (i.e. $D^{1/2}$ is the diagonal matrix whose diagonal entries are the square roots of their correspondents in $D$).
$endgroup$
– user1551
Jan 4 at 18:03
|
show 1 more comment
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3061871%2fwhat-are-the-conditions-on-texttrab-leq-texttra-texttrb-to-be%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
2
$begingroup$
How do you define the trace of a matrix which is not a square? In case you take $A=B$ this equivalent to $$sum_{i=1}^n lambda_i^2 leq left(sum_{i=1}^n lambda_i right)^2$$
$endgroup$
– Severin Schraven
Jan 4 at 17:39
$begingroup$
If we have a $mtimes n$-matrix, and $k:=min(m,n)$, the definition $$tr(A)=sum_{j=1}^k a_{jj}$$ would make sense.
$endgroup$
– Peter
Jan 4 at 17:43
$begingroup$
@Peter You are right, I was thinking about something which is coordinate-free.
$endgroup$
– Severin Schraven
Jan 4 at 17:45
$begingroup$
@Severin Schraven: peter answered that. But to get into the problem, let they be square first and focus on 2 and 3.
$endgroup$
– Saeed
Jan 4 at 17:46