Mixing
how to make sure the data imported using sqoop follows the same row order in hive as in mysql table
How to make sure the data imported using sqoop follows the same row order in hive as in mysql table?
mysql> select * from customer;
+------+--------+------+--------+
| id | name | age | salary |
+------+--------+------+--------+
| 1 | John | 30 | 80000 |
| 2 | Kevin | 33 | 84000 |
| 3 | Mark | 28 | 90000 |
| 4 | Jenna | 34 | 93000 |
| 5 | Robert | 32 | 100000 |
| 6 | Zoya | 40 | 60000 |
| 7 | Sam | 37 | 75000 |
| 8 | George | 31 | 67000 |
| 9 | Peter | 23 | 70000 |
| 19 | Alex | 26 | 74000 |
+------+--------+------+-----
I want after the table has been imported. It follows the same order in hive too.
sqoop
edited Nov 26 '18 at 8:59
dev ツ
7,02174082
asked Nov 21 '18 at 17:06
Kishaloy NandyKishaloy Nandy
12
add a comment |
How to make sure the data imported using sqoop follows the same row order in hive as in mysql table?
mysql> select * from customer;
+------+--------+------+--------+
| id | name | age | salary |
+------+--------+------+--------+
| 1 | John | 30 | 80000 |
| 2 | Kevin | 33 | 84000 |
| 3 | Mark | 28 | 90000 |
| 4 | Jenna | 34 | 93000 |
| 5 | Robert | 32 | 100000 |
| 6 | Zoya | 40 | 60000 |
| 7 | Sam | 37 | 75000 |
| 8 | George | 31 | 67000 |
| 9 | Peter | 23 | 70000 |
| 19 | Alex | 26 | 74000 |
+------+--------+------+-----
I want after the table has been imported. It follows the same order in hive too.
sqoop
edited Nov 26 '18 at 8:59
dev ツ
7,02174082
asked Nov 21 '18 at 17:06
Kishaloy NandyKishaloy Nandy
12
add a comment |
How to make sure the data imported using sqoop follows the same row order in hive as in mysql table?
mysql> select * from customer;
+------+--------+------+--------+
| id | name | age | salary |
+------+--------+------+--------+
| 1 | John | 30 | 80000 |
| 2 | Kevin | 33 | 84000 |
| 3 | Mark | 28 | 90000 |
| 4 | Jenna | 34 | 93000 |
| 5 | Robert | 32 | 100000 |
| 6 | Zoya | 40 | 60000 |
| 7 | Sam | 37 | 75000 |
| 8 | George | 31 | 67000 |
| 9 | Peter | 23 | 70000 |
| 19 | Alex | 26 | 74000 |
+------+--------+------+-----
I want after the table has been imported. It follows the same order in hive too.
sqoop
edited Nov 26 '18 at 8:59
dev ツ
7,02174082
asked Nov 21 '18 at 17:06
Kishaloy NandyKishaloy Nandy
12
How to make sure the data imported using sqoop follows the same row order in hive as in mysql table?
mysql> select * from customer;
+------+--------+------+--------+
| id | name | age | salary |
+------+--------+------+--------+
| 1 | John | 30 | 80000 |
| 2 | Kevin | 33 | 84000 |
| 3 | Mark | 28 | 90000 |
| 4 | Jenna | 34 | 93000 |
| 5 | Robert | 32 | 100000 |
| 6 | Zoya | 40 | 60000 |
| 7 | Sam | 37 | 75000 |
| 8 | George | 31 | 67000 |
| 9 | Peter | 23 | 70000 |
| 19 | Alex | 26 | 74000 |
+------+--------+------+-----
I want after the table has been imported. It follows the same order in hive too.
sqoop
sqoop
edited Nov 26 '18 at 8:59
dev ツ
7,02174082
asked Nov 21 '18 at 17:06
Kishaloy NandyKishaloy Nandy
12
edited Nov 26 '18 at 8:59
dev ツ
7,02174082
asked Nov 21 '18 at 17:06
Kishaloy NandyKishaloy Nandy
12
edited Nov 26 '18 at 8:59
dev ツ
7,02174082
edited Nov 26 '18 at 8:59
dev ツ
7,02174082
edited Nov 26 '18 at 8:59
dev ツ
7,02174082
7,02174082
asked Nov 21 '18 at 17:06
Kishaloy NandyKishaloy Nandy
12
asked Nov 21 '18 at 17:06
Kishaloy NandyKishaloy Nandy
12
asked Nov 21 '18 at 17:06
Kishaloy NandyKishaloy Nandy
12
12
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
While importing the tables into the hive using Apache Sqoop, by default it is in the same order but to be double sure, you can do one thing, if your MySQL table has the primary key then create hive table manually with same Schema and primary key and write import statement without --create-hive-table argument.
This way it will make sure that data will be in the same order as MySQL table
answered Jan 24 at 10:14
Anil AgrawalAnil Agrawal
163
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53417235%2fhow-to-make-sure-the-data-imported-using-sqoop-follows-the-same-row-order-in-hiv%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
While importing the tables into the hive using Apache Sqoop, by default it is in the same order but to be double sure, you can do one thing, if your MySQL table has the primary key then create hive table manually with same Schema and primary key and write import statement without --create-hive-table argument.
This way it will make sure that data will be in the same order as MySQL table
answered Jan 24 at 10:14
Anil AgrawalAnil Agrawal
163
add a comment |
While importing the tables into the hive using Apache Sqoop, by default it is in the same order but to be double sure, you can do one thing, if your MySQL table has the primary key then create hive table manually with same Schema and primary key and write import statement without --create-hive-table argument.
This way it will make sure that data will be in the same order as MySQL table
answered Jan 24 at 10:14
Anil AgrawalAnil Agrawal
163
add a comment |
While importing the tables into the hive using Apache Sqoop, by default it is in the same order but to be double sure, you can do one thing, if your MySQL table has the primary key then create hive table manually with same Schema and primary key and write import statement without --create-hive-table argument.
This way it will make sure that data will be in the same order as MySQL table
answered Jan 24 at 10:14
Anil AgrawalAnil Agrawal
163
While importing the tables into the hive using Apache Sqoop, by default it is in the same order but to be double sure, you can do one thing, if your MySQL table has the primary key then create hive table manually with same Schema and primary key and write import statement without --create-hive-table argument.
This way it will make sure that data will be in the same order as MySQL table
answered Jan 24 at 10:14
Anil AgrawalAnil Agrawal
163
answered Jan 24 at 10:14
Anil AgrawalAnil Agrawal
163
answered Jan 24 at 10:14
Anil AgrawalAnil Agrawal
163
answered Jan 24 at 10:14
Anil AgrawalAnil Agrawal
163
163
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53417235%2fhow-to-make-sure-the-data-imported-using-sqoop-follows-the-same-row-order-in-hiv%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
