How to run hql script using spark sql?
I have Hive Query script and wanted to run in command line mode in unix, is there any option available to run it in command line mode?
unix apache-spark-sql hiveql
add a comment |
I have Hive Query script and wanted to run in command line mode in unix, is there any option available to run it in command line mode?
unix apache-spark-sql hiveql
Could you please elaborate it further what you want to achieve and what you have done so far?
– VIN
Nov 20 '18 at 3:10
I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
– ASK
Nov 20 '18 at 13:55
So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
– ASK
Nov 20 '18 at 13:58
I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
– ASK
Nov 20 '18 at 17:33
add a comment |
I have Hive Query script and wanted to run in command line mode in unix, is there any option available to run it in command line mode?
unix apache-spark-sql hiveql
I have Hive Query script and wanted to run in command line mode in unix, is there any option available to run it in command line mode?
unix apache-spark-sql hiveql
unix apache-spark-sql hiveql
edited Nov 20 '18 at 10:30
VIN
13311
13311
asked Nov 19 '18 at 20:35
ASKASK
568
568
Could you please elaborate it further what you want to achieve and what you have done so far?
– VIN
Nov 20 '18 at 3:10
I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
– ASK
Nov 20 '18 at 13:55
So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
– ASK
Nov 20 '18 at 13:58
I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
– ASK
Nov 20 '18 at 17:33
add a comment |
Could you please elaborate it further what you want to achieve and what you have done so far?
– VIN
Nov 20 '18 at 3:10
I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
– ASK
Nov 20 '18 at 13:55
So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
– ASK
Nov 20 '18 at 13:58
I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
– ASK
Nov 20 '18 at 17:33
Could you please elaborate it further what you want to achieve and what you have done so far?
– VIN
Nov 20 '18 at 3:10
Could you please elaborate it further what you want to achieve and what you have done so far?
– VIN
Nov 20 '18 at 3:10
I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
– ASK
Nov 20 '18 at 13:55
I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
– ASK
Nov 20 '18 at 13:55
So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
– ASK
Nov 20 '18 at 13:58
So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
– ASK
Nov 20 '18 at 13:58
I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
– ASK
Nov 20 '18 at 17:33
I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
– ASK
Nov 20 '18 at 17:33
add a comment |
1 Answer
1
active
oldest
votes
As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
Below is link for same.
cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382248%2fhow-to-run-hql-script-using-spark-sql%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
Below is link for same.
cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
add a comment |
As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
Below is link for same.
cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
add a comment |
As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
Below is link for same.
cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
As I am using Cloudera Hadoop (5.10.x)and according to CDH 5.10.x documentation it documentation its not supported.
Below is link for same.
cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
answered Nov 27 '18 at 20:17
ASKASK
568
568
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382248%2fhow-to-run-hql-script-using-spark-sql%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Could you please elaborate it further what you want to achieve and what you have done so far?
– VIN
Nov 20 '18 at 3:10
I want to write shell job which will take query from properties file and run it on Hive, Impala and SparkSQL. Here I am trying to create performance matrix for query in Hive, Impala and Spark?
– ASK
Nov 20 '18 at 13:55
So far I have written shell job which will take Query from properties file and running on to Hive and Impala, same query I want to run on Spark SQL. If you have any idea, help appreciated.
– ASK
Nov 20 '18 at 13:58
I am using cloudera hadoop CDH 5.10.x, and found documentation its not supported in this CDH version. Below is link for same. cloudera.com/documentation/enterprise/5-10-x/topics/spark.html
– ASK
Nov 20 '18 at 17:33