Is there a functional (i.e. infinite-dimensional) generalization of the second partial derivative test?












2












$begingroup$


For a smooth function $f: mathbb{R}^n to mathbb{R}$, we can (usually) test whether a critical point ${bf x}_0$ (at which ${bf nabla} f({bf x}_0) = {bf 0}$) is a local maximum, minimum, or saddle point via the second partial derivative test, which considers the signs of the eigenvalues of the Hessian matrix $H_{ij} := partial_i partial_j f$. This result can be generalized to successively more general domains of $f$:




  1. If the domain of $f$ is an arbitrary Riemannian manifold, then the test still works, but we instead consider the eigenvalues of the tensor $H^i_{ j} = g^{ik} H_{kj}$, where $H_{kj}$ is the Hessian tensor $H_{ij} := nabla_i nabla_j f = partial_i partial_j f - Gamma_{ij}^k partial_k f$, where $Gamma_{ij}^k$ are the Christoffel symbols (of the second kind).


  2. If the domain of $f$ is an arbitrary smooth manifold with a torsion-free connection, then the Hessian (as defined directly above) is a rank-$(2,0)$ tensor rather than a rank-$(1,1)$ tensor, so we can't talk about its eigenvalues. But we can still talk about the signature of the corresponding quadratic form by Sylvester's law of inertia, so I believe the test still works.


  3. If the domain of $f$ is an arbitrary smooth manifold without a connection, then there's no natural way to define a Hessian tensor away from the critical points. But at a critical point the Hessian tensor becomes independent of the connection, so we can define it (in local coordinates) by the usual Euclidean-space formula $H_{ij} := partial_i partial_j f$ and use Sylvester's law of inertia as above.



Now if $f$ (which I will rename $S$) is a smooth functional $S[q]$, then its domain is an infinite-dimensional space of functions $q(t)$. In this case we can still talk about critical "points" of the functional, which are functions $q_0(t)$ at which $S[q]$ is stationary. For example, if $S$ takes the form
$$S[q] = int_a^b L left( q(t), frac{dq}{dt}, t right) dt$$ for some constants $a$ and $b$ and differentiable function $L: mathbb{R}^3 to mathbb{R}$, then the critical "points" $q_0(t)$ are given by the Euler-Lagrange equation
$$frac{partial L}{partial q} - frac{d}{dt} frac{partial L}{partial dot{q}} = 0.$$



Is there a functional generalization of the second partial derivative test that tests whether these critical functions $q_0(t)$ are local minima, local maxima, or saddle points of the functional $F[q]$?



(I don't know anything about quadratic forms on infinite-dimensional vector spaces, so I have no idea if there's any notion of a signature, etc.)










share|cite|improve this question









$endgroup$

















    2












    $begingroup$


    For a smooth function $f: mathbb{R}^n to mathbb{R}$, we can (usually) test whether a critical point ${bf x}_0$ (at which ${bf nabla} f({bf x}_0) = {bf 0}$) is a local maximum, minimum, or saddle point via the second partial derivative test, which considers the signs of the eigenvalues of the Hessian matrix $H_{ij} := partial_i partial_j f$. This result can be generalized to successively more general domains of $f$:




    1. If the domain of $f$ is an arbitrary Riemannian manifold, then the test still works, but we instead consider the eigenvalues of the tensor $H^i_{ j} = g^{ik} H_{kj}$, where $H_{kj}$ is the Hessian tensor $H_{ij} := nabla_i nabla_j f = partial_i partial_j f - Gamma_{ij}^k partial_k f$, where $Gamma_{ij}^k$ are the Christoffel symbols (of the second kind).


    2. If the domain of $f$ is an arbitrary smooth manifold with a torsion-free connection, then the Hessian (as defined directly above) is a rank-$(2,0)$ tensor rather than a rank-$(1,1)$ tensor, so we can't talk about its eigenvalues. But we can still talk about the signature of the corresponding quadratic form by Sylvester's law of inertia, so I believe the test still works.


    3. If the domain of $f$ is an arbitrary smooth manifold without a connection, then there's no natural way to define a Hessian tensor away from the critical points. But at a critical point the Hessian tensor becomes independent of the connection, so we can define it (in local coordinates) by the usual Euclidean-space formula $H_{ij} := partial_i partial_j f$ and use Sylvester's law of inertia as above.



    Now if $f$ (which I will rename $S$) is a smooth functional $S[q]$, then its domain is an infinite-dimensional space of functions $q(t)$. In this case we can still talk about critical "points" of the functional, which are functions $q_0(t)$ at which $S[q]$ is stationary. For example, if $S$ takes the form
    $$S[q] = int_a^b L left( q(t), frac{dq}{dt}, t right) dt$$ for some constants $a$ and $b$ and differentiable function $L: mathbb{R}^3 to mathbb{R}$, then the critical "points" $q_0(t)$ are given by the Euler-Lagrange equation
    $$frac{partial L}{partial q} - frac{d}{dt} frac{partial L}{partial dot{q}} = 0.$$



    Is there a functional generalization of the second partial derivative test that tests whether these critical functions $q_0(t)$ are local minima, local maxima, or saddle points of the functional $F[q]$?



    (I don't know anything about quadratic forms on infinite-dimensional vector spaces, so I have no idea if there's any notion of a signature, etc.)










    share|cite|improve this question









    $endgroup$















      2












      2








      2


      1



      $begingroup$


      For a smooth function $f: mathbb{R}^n to mathbb{R}$, we can (usually) test whether a critical point ${bf x}_0$ (at which ${bf nabla} f({bf x}_0) = {bf 0}$) is a local maximum, minimum, or saddle point via the second partial derivative test, which considers the signs of the eigenvalues of the Hessian matrix $H_{ij} := partial_i partial_j f$. This result can be generalized to successively more general domains of $f$:




      1. If the domain of $f$ is an arbitrary Riemannian manifold, then the test still works, but we instead consider the eigenvalues of the tensor $H^i_{ j} = g^{ik} H_{kj}$, where $H_{kj}$ is the Hessian tensor $H_{ij} := nabla_i nabla_j f = partial_i partial_j f - Gamma_{ij}^k partial_k f$, where $Gamma_{ij}^k$ are the Christoffel symbols (of the second kind).


      2. If the domain of $f$ is an arbitrary smooth manifold with a torsion-free connection, then the Hessian (as defined directly above) is a rank-$(2,0)$ tensor rather than a rank-$(1,1)$ tensor, so we can't talk about its eigenvalues. But we can still talk about the signature of the corresponding quadratic form by Sylvester's law of inertia, so I believe the test still works.


      3. If the domain of $f$ is an arbitrary smooth manifold without a connection, then there's no natural way to define a Hessian tensor away from the critical points. But at a critical point the Hessian tensor becomes independent of the connection, so we can define it (in local coordinates) by the usual Euclidean-space formula $H_{ij} := partial_i partial_j f$ and use Sylvester's law of inertia as above.



      Now if $f$ (which I will rename $S$) is a smooth functional $S[q]$, then its domain is an infinite-dimensional space of functions $q(t)$. In this case we can still talk about critical "points" of the functional, which are functions $q_0(t)$ at which $S[q]$ is stationary. For example, if $S$ takes the form
      $$S[q] = int_a^b L left( q(t), frac{dq}{dt}, t right) dt$$ for some constants $a$ and $b$ and differentiable function $L: mathbb{R}^3 to mathbb{R}$, then the critical "points" $q_0(t)$ are given by the Euler-Lagrange equation
      $$frac{partial L}{partial q} - frac{d}{dt} frac{partial L}{partial dot{q}} = 0.$$



      Is there a functional generalization of the second partial derivative test that tests whether these critical functions $q_0(t)$ are local minima, local maxima, or saddle points of the functional $F[q]$?



      (I don't know anything about quadratic forms on infinite-dimensional vector spaces, so I have no idea if there's any notion of a signature, etc.)










      share|cite|improve this question









      $endgroup$




      For a smooth function $f: mathbb{R}^n to mathbb{R}$, we can (usually) test whether a critical point ${bf x}_0$ (at which ${bf nabla} f({bf x}_0) = {bf 0}$) is a local maximum, minimum, or saddle point via the second partial derivative test, which considers the signs of the eigenvalues of the Hessian matrix $H_{ij} := partial_i partial_j f$. This result can be generalized to successively more general domains of $f$:




      1. If the domain of $f$ is an arbitrary Riemannian manifold, then the test still works, but we instead consider the eigenvalues of the tensor $H^i_{ j} = g^{ik} H_{kj}$, where $H_{kj}$ is the Hessian tensor $H_{ij} := nabla_i nabla_j f = partial_i partial_j f - Gamma_{ij}^k partial_k f$, where $Gamma_{ij}^k$ are the Christoffel symbols (of the second kind).


      2. If the domain of $f$ is an arbitrary smooth manifold with a torsion-free connection, then the Hessian (as defined directly above) is a rank-$(2,0)$ tensor rather than a rank-$(1,1)$ tensor, so we can't talk about its eigenvalues. But we can still talk about the signature of the corresponding quadratic form by Sylvester's law of inertia, so I believe the test still works.


      3. If the domain of $f$ is an arbitrary smooth manifold without a connection, then there's no natural way to define a Hessian tensor away from the critical points. But at a critical point the Hessian tensor becomes independent of the connection, so we can define it (in local coordinates) by the usual Euclidean-space formula $H_{ij} := partial_i partial_j f$ and use Sylvester's law of inertia as above.



      Now if $f$ (which I will rename $S$) is a smooth functional $S[q]$, then its domain is an infinite-dimensional space of functions $q(t)$. In this case we can still talk about critical "points" of the functional, which are functions $q_0(t)$ at which $S[q]$ is stationary. For example, if $S$ takes the form
      $$S[q] = int_a^b L left( q(t), frac{dq}{dt}, t right) dt$$ for some constants $a$ and $b$ and differentiable function $L: mathbb{R}^3 to mathbb{R}$, then the critical "points" $q_0(t)$ are given by the Euler-Lagrange equation
      $$frac{partial L}{partial q} - frac{d}{dt} frac{partial L}{partial dot{q}} = 0.$$



      Is there a functional generalization of the second partial derivative test that tests whether these critical functions $q_0(t)$ are local minima, local maxima, or saddle points of the functional $F[q]$?



      (I don't know anything about quadratic forms on infinite-dimensional vector spaces, so I have no idea if there's any notion of a signature, etc.)







      functional-analysis calculus-of-variations quadratic-forms stationary-point






      share|cite|improve this question













      share|cite|improve this question











      share|cite|improve this question




      share|cite|improve this question










      asked Feb 3 at 5:50









      tparkertparker

      1,941834




      1,941834






















          1 Answer
          1






          active

          oldest

          votes


















          3












          $begingroup$

          Suppose that your functional $S$ is defined on an infinite-dimensional (real) Banach space $X$. Further, we need some differentiability of $S$, and the right tool here is 'twice Fréchet differentiable'.



          This ensures that $S$ satisfies a Taylor expansion
          $$S(x + h) = S(x) + S'(x),h + frac12 , S''(x) [h,h] + o(|h|^2).$$
          Here, the second derivative $S''(x)$ is a bounded, bilinear form on $X$.



          Now, if $bar x$ is a local minimizer, you have




          • $S'(bar x) = 0$


          • $S''(bar x) [h,h] ge 0$ for all $h in X$ (note that this generalizes 'positive semi-definite').


          Similarly, if





          • $S'(bar x) = 0$ and

          • there exists $alpha > 0$ such that for all $h in X$ we have $S''(bar x) [h,h] ge alpha , |h|^2$ (note that this generalizes 'positive definite'),


          then $bar x$ is a local minimizer.






          share|cite|improve this answer









          $endgroup$













          • $begingroup$
            Operationally, how do we calculate the second Fréchet derivative for a particular functional $S$ (e.g. of the form given in the question, where the EL equation gives the first Fréchet derivative)?
            $endgroup$
            – tparker
            Feb 3 at 20:27










          • $begingroup$
            You just take another derivative w.r.t. $q$. But for your functional, you have to choose $X = H^1(a,b)$ and then, $S$ has to be quadratic w.r.t. $dq/dt$, otherwise the differentiability fails.
            $endgroup$
            – gerw
            Feb 4 at 6:29












          Your Answer








          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "69"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          noCode: true, onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3098233%2fis-there-a-functional-i-e-infinite-dimensional-generalization-of-the-second-p%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          3












          $begingroup$

          Suppose that your functional $S$ is defined on an infinite-dimensional (real) Banach space $X$. Further, we need some differentiability of $S$, and the right tool here is 'twice Fréchet differentiable'.



          This ensures that $S$ satisfies a Taylor expansion
          $$S(x + h) = S(x) + S'(x),h + frac12 , S''(x) [h,h] + o(|h|^2).$$
          Here, the second derivative $S''(x)$ is a bounded, bilinear form on $X$.



          Now, if $bar x$ is a local minimizer, you have




          • $S'(bar x) = 0$


          • $S''(bar x) [h,h] ge 0$ for all $h in X$ (note that this generalizes 'positive semi-definite').


          Similarly, if





          • $S'(bar x) = 0$ and

          • there exists $alpha > 0$ such that for all $h in X$ we have $S''(bar x) [h,h] ge alpha , |h|^2$ (note that this generalizes 'positive definite'),


          then $bar x$ is a local minimizer.






          share|cite|improve this answer









          $endgroup$













          • $begingroup$
            Operationally, how do we calculate the second Fréchet derivative for a particular functional $S$ (e.g. of the form given in the question, where the EL equation gives the first Fréchet derivative)?
            $endgroup$
            – tparker
            Feb 3 at 20:27










          • $begingroup$
            You just take another derivative w.r.t. $q$. But for your functional, you have to choose $X = H^1(a,b)$ and then, $S$ has to be quadratic w.r.t. $dq/dt$, otherwise the differentiability fails.
            $endgroup$
            – gerw
            Feb 4 at 6:29
















          3












          $begingroup$

          Suppose that your functional $S$ is defined on an infinite-dimensional (real) Banach space $X$. Further, we need some differentiability of $S$, and the right tool here is 'twice Fréchet differentiable'.



          This ensures that $S$ satisfies a Taylor expansion
          $$S(x + h) = S(x) + S'(x),h + frac12 , S''(x) [h,h] + o(|h|^2).$$
          Here, the second derivative $S''(x)$ is a bounded, bilinear form on $X$.



          Now, if $bar x$ is a local minimizer, you have




          • $S'(bar x) = 0$


          • $S''(bar x) [h,h] ge 0$ for all $h in X$ (note that this generalizes 'positive semi-definite').


          Similarly, if





          • $S'(bar x) = 0$ and

          • there exists $alpha > 0$ such that for all $h in X$ we have $S''(bar x) [h,h] ge alpha , |h|^2$ (note that this generalizes 'positive definite'),


          then $bar x$ is a local minimizer.






          share|cite|improve this answer









          $endgroup$













          • $begingroup$
            Operationally, how do we calculate the second Fréchet derivative for a particular functional $S$ (e.g. of the form given in the question, where the EL equation gives the first Fréchet derivative)?
            $endgroup$
            – tparker
            Feb 3 at 20:27










          • $begingroup$
            You just take another derivative w.r.t. $q$. But for your functional, you have to choose $X = H^1(a,b)$ and then, $S$ has to be quadratic w.r.t. $dq/dt$, otherwise the differentiability fails.
            $endgroup$
            – gerw
            Feb 4 at 6:29














          3












          3








          3





          $begingroup$

          Suppose that your functional $S$ is defined on an infinite-dimensional (real) Banach space $X$. Further, we need some differentiability of $S$, and the right tool here is 'twice Fréchet differentiable'.



          This ensures that $S$ satisfies a Taylor expansion
          $$S(x + h) = S(x) + S'(x),h + frac12 , S''(x) [h,h] + o(|h|^2).$$
          Here, the second derivative $S''(x)$ is a bounded, bilinear form on $X$.



          Now, if $bar x$ is a local minimizer, you have




          • $S'(bar x) = 0$


          • $S''(bar x) [h,h] ge 0$ for all $h in X$ (note that this generalizes 'positive semi-definite').


          Similarly, if





          • $S'(bar x) = 0$ and

          • there exists $alpha > 0$ such that for all $h in X$ we have $S''(bar x) [h,h] ge alpha , |h|^2$ (note that this generalizes 'positive definite'),


          then $bar x$ is a local minimizer.






          share|cite|improve this answer









          $endgroup$



          Suppose that your functional $S$ is defined on an infinite-dimensional (real) Banach space $X$. Further, we need some differentiability of $S$, and the right tool here is 'twice Fréchet differentiable'.



          This ensures that $S$ satisfies a Taylor expansion
          $$S(x + h) = S(x) + S'(x),h + frac12 , S''(x) [h,h] + o(|h|^2).$$
          Here, the second derivative $S''(x)$ is a bounded, bilinear form on $X$.



          Now, if $bar x$ is a local minimizer, you have




          • $S'(bar x) = 0$


          • $S''(bar x) [h,h] ge 0$ for all $h in X$ (note that this generalizes 'positive semi-definite').


          Similarly, if





          • $S'(bar x) = 0$ and

          • there exists $alpha > 0$ such that for all $h in X$ we have $S''(bar x) [h,h] ge alpha , |h|^2$ (note that this generalizes 'positive definite'),


          then $bar x$ is a local minimizer.







          share|cite|improve this answer












          share|cite|improve this answer



          share|cite|improve this answer










          answered Feb 3 at 18:25









          gerwgerw

          20.1k11334




          20.1k11334












          • $begingroup$
            Operationally, how do we calculate the second Fréchet derivative for a particular functional $S$ (e.g. of the form given in the question, where the EL equation gives the first Fréchet derivative)?
            $endgroup$
            – tparker
            Feb 3 at 20:27










          • $begingroup$
            You just take another derivative w.r.t. $q$. But for your functional, you have to choose $X = H^1(a,b)$ and then, $S$ has to be quadratic w.r.t. $dq/dt$, otherwise the differentiability fails.
            $endgroup$
            – gerw
            Feb 4 at 6:29


















          • $begingroup$
            Operationally, how do we calculate the second Fréchet derivative for a particular functional $S$ (e.g. of the form given in the question, where the EL equation gives the first Fréchet derivative)?
            $endgroup$
            – tparker
            Feb 3 at 20:27










          • $begingroup$
            You just take another derivative w.r.t. $q$. But for your functional, you have to choose $X = H^1(a,b)$ and then, $S$ has to be quadratic w.r.t. $dq/dt$, otherwise the differentiability fails.
            $endgroup$
            – gerw
            Feb 4 at 6:29
















          $begingroup$
          Operationally, how do we calculate the second Fréchet derivative for a particular functional $S$ (e.g. of the form given in the question, where the EL equation gives the first Fréchet derivative)?
          $endgroup$
          – tparker
          Feb 3 at 20:27




          $begingroup$
          Operationally, how do we calculate the second Fréchet derivative for a particular functional $S$ (e.g. of the form given in the question, where the EL equation gives the first Fréchet derivative)?
          $endgroup$
          – tparker
          Feb 3 at 20:27












          $begingroup$
          You just take another derivative w.r.t. $q$. But for your functional, you have to choose $X = H^1(a,b)$ and then, $S$ has to be quadratic w.r.t. $dq/dt$, otherwise the differentiability fails.
          $endgroup$
          – gerw
          Feb 4 at 6:29




          $begingroup$
          You just take another derivative w.r.t. $q$. But for your functional, you have to choose $X = H^1(a,b)$ and then, $S$ has to be quadratic w.r.t. $dq/dt$, otherwise the differentiability fails.
          $endgroup$
          – gerw
          Feb 4 at 6:29


















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Mathematics Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3098233%2fis-there-a-functional-i-e-infinite-dimensional-generalization-of-the-second-p%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          MongoDB - Not Authorized To Execute Command

          How to fix TextFormField cause rebuild widget in Flutter

          in spring boot 2.1 many test slices are not allowed anymore due to multiple @BootstrapWith