The Structure of the Jacobian Matrix in One-to-One Transformations
$begingroup$
I currently study Searle's et al. (1992) book "variance components". In appendix S.d (page 474) they define Jacobian matrix of the transformation $Theta rightarrowDelta$ as
$J_{Theta rightarrowDelta}=left[_m frac {partial Theta_i}{partial Delta_j}right]_{i,j}$
$m$ indicates that it is a matrix with the corresponding partial derivatives at $(i,j)$. Hence, $J$ is the Jacobian matrix of a function which takes as input the vector $Theta$ and produces as output the vector $Delta$. Or as the authors put it: parameters in $Theta$ "are transformed in a one-to-one manner to the vector $Delta$"
However, if I remind myself about the structure of a Jacobian matrix, amongst others here, then I find the following:
$ J=[frac {partial f}{partial x_i}...frac {partial f}{partial x_n}]$
Here, J is the Jacobian matrix $[m,n]$ of $f$, where $f:ℝ^n → ℝ^m$ is a function which takes as input the vector $x$ and produces as output the vector $f(x)$.
Hence, I find the two definitions of the Jacobian matrix conflicting since
$J_{Theta rightarrowDelta} = J^{-1}$
I do not believe that there is a mistake in Searle's et al. but cannot reconcile both definitions of a Jacobian matrix. What do I miss?
linear-algebra matrices jacobian
$endgroup$
add a comment |
$begingroup$
I currently study Searle's et al. (1992) book "variance components". In appendix S.d (page 474) they define Jacobian matrix of the transformation $Theta rightarrowDelta$ as
$J_{Theta rightarrowDelta}=left[_m frac {partial Theta_i}{partial Delta_j}right]_{i,j}$
$m$ indicates that it is a matrix with the corresponding partial derivatives at $(i,j)$. Hence, $J$ is the Jacobian matrix of a function which takes as input the vector $Theta$ and produces as output the vector $Delta$. Or as the authors put it: parameters in $Theta$ "are transformed in a one-to-one manner to the vector $Delta$"
However, if I remind myself about the structure of a Jacobian matrix, amongst others here, then I find the following:
$ J=[frac {partial f}{partial x_i}...frac {partial f}{partial x_n}]$
Here, J is the Jacobian matrix $[m,n]$ of $f$, where $f:ℝ^n → ℝ^m$ is a function which takes as input the vector $x$ and produces as output the vector $f(x)$.
Hence, I find the two definitions of the Jacobian matrix conflicting since
$J_{Theta rightarrowDelta} = J^{-1}$
I do not believe that there is a mistake in Searle's et al. but cannot reconcile both definitions of a Jacobian matrix. What do I miss?
linear-algebra matrices jacobian
$endgroup$
add a comment |
$begingroup$
I currently study Searle's et al. (1992) book "variance components". In appendix S.d (page 474) they define Jacobian matrix of the transformation $Theta rightarrowDelta$ as
$J_{Theta rightarrowDelta}=left[_m frac {partial Theta_i}{partial Delta_j}right]_{i,j}$
$m$ indicates that it is a matrix with the corresponding partial derivatives at $(i,j)$. Hence, $J$ is the Jacobian matrix of a function which takes as input the vector $Theta$ and produces as output the vector $Delta$. Or as the authors put it: parameters in $Theta$ "are transformed in a one-to-one manner to the vector $Delta$"
However, if I remind myself about the structure of a Jacobian matrix, amongst others here, then I find the following:
$ J=[frac {partial f}{partial x_i}...frac {partial f}{partial x_n}]$
Here, J is the Jacobian matrix $[m,n]$ of $f$, where $f:ℝ^n → ℝ^m$ is a function which takes as input the vector $x$ and produces as output the vector $f(x)$.
Hence, I find the two definitions of the Jacobian matrix conflicting since
$J_{Theta rightarrowDelta} = J^{-1}$
I do not believe that there is a mistake in Searle's et al. but cannot reconcile both definitions of a Jacobian matrix. What do I miss?
linear-algebra matrices jacobian
$endgroup$
I currently study Searle's et al. (1992) book "variance components". In appendix S.d (page 474) they define Jacobian matrix of the transformation $Theta rightarrowDelta$ as
$J_{Theta rightarrowDelta}=left[_m frac {partial Theta_i}{partial Delta_j}right]_{i,j}$
$m$ indicates that it is a matrix with the corresponding partial derivatives at $(i,j)$. Hence, $J$ is the Jacobian matrix of a function which takes as input the vector $Theta$ and produces as output the vector $Delta$. Or as the authors put it: parameters in $Theta$ "are transformed in a one-to-one manner to the vector $Delta$"
However, if I remind myself about the structure of a Jacobian matrix, amongst others here, then I find the following:
$ J=[frac {partial f}{partial x_i}...frac {partial f}{partial x_n}]$
Here, J is the Jacobian matrix $[m,n]$ of $f$, where $f:ℝ^n → ℝ^m$ is a function which takes as input the vector $x$ and produces as output the vector $f(x)$.
Hence, I find the two definitions of the Jacobian matrix conflicting since
$J_{Theta rightarrowDelta} = J^{-1}$
I do not believe that there is a mistake in Searle's et al. but cannot reconcile both definitions of a Jacobian matrix. What do I miss?
linear-algebra matrices jacobian
linear-algebra matrices jacobian
asked Jan 24 at 20:13


DomBDomB
396
396
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
That's just because of how the Jacobian is used in probability. If $Delta = f(Theta)$ and $p_Delta, p_Theta$ are the two densities then
$$mathbf{P}(Delta in A) = int_A p_{Delta}(delta) ,ddelta = mathbf{P}(Theta in f^{-1}(A)) = int_{f^{-1}(A)} p_Theta(theta) ,dtheta $$
The change of variables theorem tells us that
$$ int_{f^{-1}(A)} p_Theta(theta) ,dtheta = int_A p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right| ,ddelta. $$
So
$$ p_Delta(delta) = p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right|. $$
Which means we don't want the Jacobian of $f$ as defined on Wikipedia, we want the Jacobian of $f^{-1}$.
$endgroup$
$begingroup$
thanks for the answer. I was just wondering if you could recommend and literature (e.g. textbook) that would allow me to study this a bit more in detail. Cheers
$endgroup$
– DomB
Jan 25 at 18:47
$begingroup$
@Dom Any multivariable calculus or analysis book covers the change of variables formula. You can also look at intro differential geometry books (e.g. Spivak's Calculus on Manifolds or Tu's An Introduction to Manifolds).
$endgroup$
– Trevor Gunn
Jan 25 at 22:11
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3086304%2fthe-structure-of-the-jacobian-matrix-in-one-to-one-transformations%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
That's just because of how the Jacobian is used in probability. If $Delta = f(Theta)$ and $p_Delta, p_Theta$ are the two densities then
$$mathbf{P}(Delta in A) = int_A p_{Delta}(delta) ,ddelta = mathbf{P}(Theta in f^{-1}(A)) = int_{f^{-1}(A)} p_Theta(theta) ,dtheta $$
The change of variables theorem tells us that
$$ int_{f^{-1}(A)} p_Theta(theta) ,dtheta = int_A p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right| ,ddelta. $$
So
$$ p_Delta(delta) = p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right|. $$
Which means we don't want the Jacobian of $f$ as defined on Wikipedia, we want the Jacobian of $f^{-1}$.
$endgroup$
$begingroup$
thanks for the answer. I was just wondering if you could recommend and literature (e.g. textbook) that would allow me to study this a bit more in detail. Cheers
$endgroup$
– DomB
Jan 25 at 18:47
$begingroup$
@Dom Any multivariable calculus or analysis book covers the change of variables formula. You can also look at intro differential geometry books (e.g. Spivak's Calculus on Manifolds or Tu's An Introduction to Manifolds).
$endgroup$
– Trevor Gunn
Jan 25 at 22:11
add a comment |
$begingroup$
That's just because of how the Jacobian is used in probability. If $Delta = f(Theta)$ and $p_Delta, p_Theta$ are the two densities then
$$mathbf{P}(Delta in A) = int_A p_{Delta}(delta) ,ddelta = mathbf{P}(Theta in f^{-1}(A)) = int_{f^{-1}(A)} p_Theta(theta) ,dtheta $$
The change of variables theorem tells us that
$$ int_{f^{-1}(A)} p_Theta(theta) ,dtheta = int_A p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right| ,ddelta. $$
So
$$ p_Delta(delta) = p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right|. $$
Which means we don't want the Jacobian of $f$ as defined on Wikipedia, we want the Jacobian of $f^{-1}$.
$endgroup$
$begingroup$
thanks for the answer. I was just wondering if you could recommend and literature (e.g. textbook) that would allow me to study this a bit more in detail. Cheers
$endgroup$
– DomB
Jan 25 at 18:47
$begingroup$
@Dom Any multivariable calculus or analysis book covers the change of variables formula. You can also look at intro differential geometry books (e.g. Spivak's Calculus on Manifolds or Tu's An Introduction to Manifolds).
$endgroup$
– Trevor Gunn
Jan 25 at 22:11
add a comment |
$begingroup$
That's just because of how the Jacobian is used in probability. If $Delta = f(Theta)$ and $p_Delta, p_Theta$ are the two densities then
$$mathbf{P}(Delta in A) = int_A p_{Delta}(delta) ,ddelta = mathbf{P}(Theta in f^{-1}(A)) = int_{f^{-1}(A)} p_Theta(theta) ,dtheta $$
The change of variables theorem tells us that
$$ int_{f^{-1}(A)} p_Theta(theta) ,dtheta = int_A p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right| ,ddelta. $$
So
$$ p_Delta(delta) = p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right|. $$
Which means we don't want the Jacobian of $f$ as defined on Wikipedia, we want the Jacobian of $f^{-1}$.
$endgroup$
That's just because of how the Jacobian is used in probability. If $Delta = f(Theta)$ and $p_Delta, p_Theta$ are the two densities then
$$mathbf{P}(Delta in A) = int_A p_{Delta}(delta) ,ddelta = mathbf{P}(Theta in f^{-1}(A)) = int_{f^{-1}(A)} p_Theta(theta) ,dtheta $$
The change of variables theorem tells us that
$$ int_{f^{-1}(A)} p_Theta(theta) ,dtheta = int_A p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right| ,ddelta. $$
So
$$ p_Delta(delta) = p_Theta(f^{-1}(delta))left| detleft[ frac{partial Theta_i}{partial Delta_j} right] right|. $$
Which means we don't want the Jacobian of $f$ as defined on Wikipedia, we want the Jacobian of $f^{-1}$.
answered Jan 24 at 20:48


Trevor GunnTrevor Gunn
14.9k32047
14.9k32047
$begingroup$
thanks for the answer. I was just wondering if you could recommend and literature (e.g. textbook) that would allow me to study this a bit more in detail. Cheers
$endgroup$
– DomB
Jan 25 at 18:47
$begingroup$
@Dom Any multivariable calculus or analysis book covers the change of variables formula. You can also look at intro differential geometry books (e.g. Spivak's Calculus on Manifolds or Tu's An Introduction to Manifolds).
$endgroup$
– Trevor Gunn
Jan 25 at 22:11
add a comment |
$begingroup$
thanks for the answer. I was just wondering if you could recommend and literature (e.g. textbook) that would allow me to study this a bit more in detail. Cheers
$endgroup$
– DomB
Jan 25 at 18:47
$begingroup$
@Dom Any multivariable calculus or analysis book covers the change of variables formula. You can also look at intro differential geometry books (e.g. Spivak's Calculus on Manifolds or Tu's An Introduction to Manifolds).
$endgroup$
– Trevor Gunn
Jan 25 at 22:11
$begingroup$
thanks for the answer. I was just wondering if you could recommend and literature (e.g. textbook) that would allow me to study this a bit more in detail. Cheers
$endgroup$
– DomB
Jan 25 at 18:47
$begingroup$
thanks for the answer. I was just wondering if you could recommend and literature (e.g. textbook) that would allow me to study this a bit more in detail. Cheers
$endgroup$
– DomB
Jan 25 at 18:47
$begingroup$
@Dom Any multivariable calculus or analysis book covers the change of variables formula. You can also look at intro differential geometry books (e.g. Spivak's Calculus on Manifolds or Tu's An Introduction to Manifolds).
$endgroup$
– Trevor Gunn
Jan 25 at 22:11
$begingroup$
@Dom Any multivariable calculus or analysis book covers the change of variables formula. You can also look at intro differential geometry books (e.g. Spivak's Calculus on Manifolds or Tu's An Introduction to Manifolds).
$endgroup$
– Trevor Gunn
Jan 25 at 22:11
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3086304%2fthe-structure-of-the-jacobian-matrix-in-one-to-one-transformations%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown