What is a rank-1 tensor? What is the meaning of rank in this context?
$begingroup$
I feel like different sources use the term "rank" differently, which is perhaps leading to my confusion.
When I think of rank I think of number of linearly independent columns/rows, number of pivots in RREF, etc... So a vector always has a rank of 1. A $n times m$ matrix has $rank leq min(m,n)$.
For tensors, I have always been under the impression that: a scalar is a 0-th order tensor; a vector is a 1st order tensor; a matrix is a 2nd order tensor.
When reading this https://www.sandia.gov/~tgkolda/pubs/pubfiles/TensorReview.pdf, I came across the term "rank-one tensor." See page 463 (page number is located on top right), in the sentence below Fig. 3.1, it states "The CP decomposition factorizes a tensor into a sum of component rank-one
tensors." In this context, is rank-one tensor just a vector? That's what it seems like from studying Eq. (3.1). Does the term "rank" here have anything to do with the number of linearly independent columns or is it just describing the order of the tensor, i.e., the number of dimensions of the tensor? For example, a rank-2 tensor would then be a matrix and a rank-0 tensor would be a scalar?
matrix-rank tensor-rank
$endgroup$
add a comment |
$begingroup$
I feel like different sources use the term "rank" differently, which is perhaps leading to my confusion.
When I think of rank I think of number of linearly independent columns/rows, number of pivots in RREF, etc... So a vector always has a rank of 1. A $n times m$ matrix has $rank leq min(m,n)$.
For tensors, I have always been under the impression that: a scalar is a 0-th order tensor; a vector is a 1st order tensor; a matrix is a 2nd order tensor.
When reading this https://www.sandia.gov/~tgkolda/pubs/pubfiles/TensorReview.pdf, I came across the term "rank-one tensor." See page 463 (page number is located on top right), in the sentence below Fig. 3.1, it states "The CP decomposition factorizes a tensor into a sum of component rank-one
tensors." In this context, is rank-one tensor just a vector? That's what it seems like from studying Eq. (3.1). Does the term "rank" here have anything to do with the number of linearly independent columns or is it just describing the order of the tensor, i.e., the number of dimensions of the tensor? For example, a rank-2 tensor would then be a matrix and a rank-0 tensor would be a scalar?
matrix-rank tensor-rank
$endgroup$
$begingroup$
The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
$endgroup$
– gandalf61
Jan 28 at 17:22
$begingroup$
Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
$endgroup$
– Iamanon
Jan 28 at 17:33
add a comment |
$begingroup$
I feel like different sources use the term "rank" differently, which is perhaps leading to my confusion.
When I think of rank I think of number of linearly independent columns/rows, number of pivots in RREF, etc... So a vector always has a rank of 1. A $n times m$ matrix has $rank leq min(m,n)$.
For tensors, I have always been under the impression that: a scalar is a 0-th order tensor; a vector is a 1st order tensor; a matrix is a 2nd order tensor.
When reading this https://www.sandia.gov/~tgkolda/pubs/pubfiles/TensorReview.pdf, I came across the term "rank-one tensor." See page 463 (page number is located on top right), in the sentence below Fig. 3.1, it states "The CP decomposition factorizes a tensor into a sum of component rank-one
tensors." In this context, is rank-one tensor just a vector? That's what it seems like from studying Eq. (3.1). Does the term "rank" here have anything to do with the number of linearly independent columns or is it just describing the order of the tensor, i.e., the number of dimensions of the tensor? For example, a rank-2 tensor would then be a matrix and a rank-0 tensor would be a scalar?
matrix-rank tensor-rank
$endgroup$
I feel like different sources use the term "rank" differently, which is perhaps leading to my confusion.
When I think of rank I think of number of linearly independent columns/rows, number of pivots in RREF, etc... So a vector always has a rank of 1. A $n times m$ matrix has $rank leq min(m,n)$.
For tensors, I have always been under the impression that: a scalar is a 0-th order tensor; a vector is a 1st order tensor; a matrix is a 2nd order tensor.
When reading this https://www.sandia.gov/~tgkolda/pubs/pubfiles/TensorReview.pdf, I came across the term "rank-one tensor." See page 463 (page number is located on top right), in the sentence below Fig. 3.1, it states "The CP decomposition factorizes a tensor into a sum of component rank-one
tensors." In this context, is rank-one tensor just a vector? That's what it seems like from studying Eq. (3.1). Does the term "rank" here have anything to do with the number of linearly independent columns or is it just describing the order of the tensor, i.e., the number of dimensions of the tensor? For example, a rank-2 tensor would then be a matrix and a rank-0 tensor would be a scalar?
matrix-rank tensor-rank
matrix-rank tensor-rank
asked Jan 28 at 17:01
IamanonIamanon
1328
1328
$begingroup$
The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
$endgroup$
– gandalf61
Jan 28 at 17:22
$begingroup$
Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
$endgroup$
– Iamanon
Jan 28 at 17:33
add a comment |
$begingroup$
The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
$endgroup$
– gandalf61
Jan 28 at 17:22
$begingroup$
Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
$endgroup$
– Iamanon
Jan 28 at 17:33
$begingroup$
The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
$endgroup$
– gandalf61
Jan 28 at 17:22
$begingroup$
The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
$endgroup$
– gandalf61
Jan 28 at 17:22
$begingroup$
Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
$endgroup$
– Iamanon
Jan 28 at 17:33
$begingroup$
Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
$endgroup$
– Iamanon
Jan 28 at 17:33
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3091128%2fwhat-is-a-rank-1-tensor-what-is-the-meaning-of-rank-in-this-context%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3091128%2fwhat-is-a-rank-1-tensor-what-is-the-meaning-of-rank-in-this-context%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
$endgroup$
– gandalf61
Jan 28 at 17:22
$begingroup$
Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
$endgroup$
– Iamanon
Jan 28 at 17:33