How to run hql script using spark sql?












-1














I have Hive Query script and wanted to run in command line mode in unix, is there any option available to run it in command line mode?










share|improve this question
























  • Could you please elaborate it further what you want to achieve and what you have done so far?
    – VIN
    Nov 20 '18 at 3:10










  • I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
    – ASK
    Nov 20 '18 at 13:55










  • So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
    – ASK
    Nov 20 '18 at 13:58










  • I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
    – ASK
    Nov 20 '18 at 17:33
















-1














I have Hive Query script and wanted to run in command line mode in unix, is there any option available to run it in command line mode?










share|improve this question
























  • Could you please elaborate it further what you want to achieve and what you have done so far?
    – VIN
    Nov 20 '18 at 3:10










  • I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
    – ASK
    Nov 20 '18 at 13:55










  • So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
    – ASK
    Nov 20 '18 at 13:58










  • I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
    – ASK
    Nov 20 '18 at 17:33














-1












-1








-1







I have Hive Query script and wanted to run in command line mode in unix, is there any option available to run it in command line mode?










share|improve this question















I have Hive Query script and wanted to run in command line mode in unix, is there any option available to run it in command line mode?







unix apache-spark-sql hiveql






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Nov 20 '18 at 10:30









VIN

13311




13311










asked Nov 19 '18 at 20:35









ASKASK

568




568












  • Could you please elaborate it further what you want to achieve and what you have done so far?
    – VIN
    Nov 20 '18 at 3:10










  • I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
    – ASK
    Nov 20 '18 at 13:55










  • So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
    – ASK
    Nov 20 '18 at 13:58










  • I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
    – ASK
    Nov 20 '18 at 17:33


















  • Could you please elaborate it further what you want to achieve and what you have done so far?
    – VIN
    Nov 20 '18 at 3:10










  • I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
    – ASK
    Nov 20 '18 at 13:55










  • So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
    – ASK
    Nov 20 '18 at 13:58










  • I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
    – ASK
    Nov 20 '18 at 17:33
















Could you please elaborate it further what you want to achieve and what you have done so far?
– VIN
Nov 20 '18 at 3:10




Could you please elaborate it further what you want to achieve and what you have done so far?
– VIN
Nov 20 '18 at 3:10












I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
– ASK
Nov 20 '18 at 13:55




I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
– ASK
Nov 20 '18 at 13:55












So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
– ASK
Nov 20 '18 at 13:58




So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
– ASK
Nov 20 '18 at 13:58












I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
– ASK
Nov 20 '18 at 17:33




I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
– ASK
Nov 20 '18 at 17:33












1 Answer
1






active

oldest

votes


















0














As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
Below is link for same.
cloudera.com/documentation/enterprise/5-10-x/topics/spark.html






share|improve this answer





















    Your Answer






    StackExchange.ifUsing("editor", function () {
    StackExchange.using("externalEditor", function () {
    StackExchange.using("snippets", function () {
    StackExchange.snippets.init();
    });
    });
    }, "code-snippets");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "1"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382248%2fhow-to-run-hql-script-using-spark-sql%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    0














    As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
    Below is link for same.
    cloudera.com/documentation/enterprise/5-10-x/topics/spark.html






    share|improve this answer


























      0














      As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
      Below is link for same.
      cloudera.com/documentation/enterprise/5-10-x/topics/spark.html






      share|improve this answer
























        0












        0








        0






        As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
        Below is link for same.
        cloudera.com/documentation/enterprise/5-10-x/topics/spark.html






        share|improve this answer












        As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
        Below is link for same.
        cloudera.com/documentation/enterprise/5-10-x/topics/spark.html







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Nov 27 '18 at 20:17









        ASKASK

        568




        568






























            draft saved

            draft discarded




















































            Thanks for contributing an answer to Stack Overflow!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382248%2fhow-to-run-hql-script-using-spark-sql%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            MongoDB - Not Authorized To Execute Command

            How to fix TextFormField cause rebuild widget in Flutter

            Npm cannot find a required file even through it is in the searched directory