What is a rank-1 tensor? What is the meaning of rank in this context?












1












$begingroup$


I feel like different sources use the term "rank" differently, which is perhaps leading to my confusion.



When I think of rank I think of number of linearly independent columns/rows, number of pivots in RREF, etc... So a vector always has a rank of 1. A $n times m$ matrix has $rank leq min(m,n)$.



For tensors, I have always been under the impression that: a scalar is a 0-th order tensor; a vector is a 1st order tensor; a matrix is a 2nd order tensor.



When reading this https://www.sandia.gov/~tgkolda/pubs/pubfiles/TensorReview.pdf, I came across the term "rank-one tensor." See page 463 (page number is located on top right), in the sentence below Fig. 3.1, it states "The CP decomposition factorizes a tensor into a sum of component rank-one
tensors." In this context, is rank-one tensor just a vector? That's what it seems like from studying Eq. (3.1). Does the term "rank" here have anything to do with the number of linearly independent columns or is it just describing the order of the tensor, i.e., the number of dimensions of the tensor? For example, a rank-2 tensor would then be a matrix and a rank-0 tensor would be a scalar?










share|cite|improve this question









$endgroup$












  • $begingroup$
    The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
    $endgroup$
    – gandalf61
    Jan 28 at 17:22












  • $begingroup$
    Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
    $endgroup$
    – Iamanon
    Jan 28 at 17:33
















1












$begingroup$


I feel like different sources use the term "rank" differently, which is perhaps leading to my confusion.



When I think of rank I think of number of linearly independent columns/rows, number of pivots in RREF, etc... So a vector always has a rank of 1. A $n times m$ matrix has $rank leq min(m,n)$.



For tensors, I have always been under the impression that: a scalar is a 0-th order tensor; a vector is a 1st order tensor; a matrix is a 2nd order tensor.



When reading this https://www.sandia.gov/~tgkolda/pubs/pubfiles/TensorReview.pdf, I came across the term "rank-one tensor." See page 463 (page number is located on top right), in the sentence below Fig. 3.1, it states "The CP decomposition factorizes a tensor into a sum of component rank-one
tensors." In this context, is rank-one tensor just a vector? That's what it seems like from studying Eq. (3.1). Does the term "rank" here have anything to do with the number of linearly independent columns or is it just describing the order of the tensor, i.e., the number of dimensions of the tensor? For example, a rank-2 tensor would then be a matrix and a rank-0 tensor would be a scalar?










share|cite|improve this question









$endgroup$












  • $begingroup$
    The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
    $endgroup$
    – gandalf61
    Jan 28 at 17:22












  • $begingroup$
    Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
    $endgroup$
    – Iamanon
    Jan 28 at 17:33














1












1








1





$begingroup$


I feel like different sources use the term "rank" differently, which is perhaps leading to my confusion.



When I think of rank I think of number of linearly independent columns/rows, number of pivots in RREF, etc... So a vector always has a rank of 1. A $n times m$ matrix has $rank leq min(m,n)$.



For tensors, I have always been under the impression that: a scalar is a 0-th order tensor; a vector is a 1st order tensor; a matrix is a 2nd order tensor.



When reading this https://www.sandia.gov/~tgkolda/pubs/pubfiles/TensorReview.pdf, I came across the term "rank-one tensor." See page 463 (page number is located on top right), in the sentence below Fig. 3.1, it states "The CP decomposition factorizes a tensor into a sum of component rank-one
tensors." In this context, is rank-one tensor just a vector? That's what it seems like from studying Eq. (3.1). Does the term "rank" here have anything to do with the number of linearly independent columns or is it just describing the order of the tensor, i.e., the number of dimensions of the tensor? For example, a rank-2 tensor would then be a matrix and a rank-0 tensor would be a scalar?










share|cite|improve this question









$endgroup$




I feel like different sources use the term "rank" differently, which is perhaps leading to my confusion.



When I think of rank I think of number of linearly independent columns/rows, number of pivots in RREF, etc... So a vector always has a rank of 1. A $n times m$ matrix has $rank leq min(m,n)$.



For tensors, I have always been under the impression that: a scalar is a 0-th order tensor; a vector is a 1st order tensor; a matrix is a 2nd order tensor.



When reading this https://www.sandia.gov/~tgkolda/pubs/pubfiles/TensorReview.pdf, I came across the term "rank-one tensor." See page 463 (page number is located on top right), in the sentence below Fig. 3.1, it states "The CP decomposition factorizes a tensor into a sum of component rank-one
tensors." In this context, is rank-one tensor just a vector? That's what it seems like from studying Eq. (3.1). Does the term "rank" here have anything to do with the number of linearly independent columns or is it just describing the order of the tensor, i.e., the number of dimensions of the tensor? For example, a rank-2 tensor would then be a matrix and a rank-0 tensor would be a scalar?







matrix-rank tensor-rank






share|cite|improve this question













share|cite|improve this question











share|cite|improve this question




share|cite|improve this question










asked Jan 28 at 17:01









IamanonIamanon

1328




1328












  • $begingroup$
    The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
    $endgroup$
    – gandalf61
    Jan 28 at 17:22












  • $begingroup$
    Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
    $endgroup$
    – Iamanon
    Jan 28 at 17:33


















  • $begingroup$
    The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
    $endgroup$
    – gandalf61
    Jan 28 at 17:22












  • $begingroup$
    Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
    $endgroup$
    – Iamanon
    Jan 28 at 17:33
















$begingroup$
The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
$endgroup$
– gandalf61
Jan 28 at 17:22






$begingroup$
The order and the rank of a tensor are different concepts> Wikipedia has an article on tensor rank decomposition (a.k.a. canonical polyadic decomposition) at en.wikipedia.org/wiki/Tensor_rank_decomposition
$endgroup$
– gandalf61
Jan 28 at 17:22














$begingroup$
Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
$endgroup$
– Iamanon
Jan 28 at 17:33




$begingroup$
Thanks. I read this before. I have also seen "rank" used in contexts such as "Write the rank-3 approximation of X, where X is a rank-3 tensor." Does this mean representing X as another rank-3 tensor, or what does rank-3 approximation mean in this kind of context?
$endgroup$
– Iamanon
Jan 28 at 17:33










0






active

oldest

votes












Your Answer





StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3091128%2fwhat-is-a-rank-1-tensor-what-is-the-meaning-of-rank-in-this-context%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes
















draft saved

draft discarded




















































Thanks for contributing an answer to Mathematics Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3091128%2fwhat-is-a-rank-1-tensor-what-is-the-meaning-of-rank-in-this-context%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

MongoDB - Not Authorized To Execute Command

How to fix TextFormField cause rebuild widget in Flutter

in spring boot 2.1 many test slices are not allowed anymore due to multiple @BootstrapWith