Mixing
Accumulo Iterator Not Being Called
I am learning Accumulo and want to add my own Iterator to a scan. My Iterator extends WrappingIterator, and I add it to my scanner (priority 10, MyIterator.class), but none of the methods nor the public no-args constructor ever gets called. I am using MiniAccumulo cluster and set breakpoints in the constructor and other public methods of my Iterator, but they are never hit.
Ultimately what I am trying to do (beyond learning about Iterators):
- I want Accumulo to maintain versions of my changes so I have configured it mic, majc, and scan # of versions to MAX_INT
- When scanning across a range of keys, there are times when I only want the most recent for each key in the range (not the full history returned to the client).
- My thought was to write an Iterator that could return the latest key/value pair for each item in the range where latest = the key with the latest timestamp value for each in the range.
Thanks.
accumulo
asked Nov 19 '18 at 12:57
codemasterg
85
add a comment |
I am learning Accumulo and want to add my own Iterator to a scan. My Iterator extends WrappingIterator, and I add it to my scanner (priority 10, MyIterator.class), but none of the methods nor the public no-args constructor ever gets called. I am using MiniAccumulo cluster and set breakpoints in the constructor and other public methods of my Iterator, but they are never hit.
Ultimately what I am trying to do (beyond learning about Iterators):
- I want Accumulo to maintain versions of my changes so I have configured it mic, majc, and scan # of versions to MAX_INT
- When scanning across a range of keys, there are times when I only want the most recent for each key in the range (not the full history returned to the client).
- My thought was to write an Iterator that could return the latest key/value pair for each item in the range where latest = the key with the latest timestamp value for each in the range.
Thanks.
accumulo
asked Nov 19 '18 at 12:57
codemasterg
85
This question isn't well suited to StackOverflow because it doesn't have a single answer, and more details are needed to figure out what is going wrong in your case. I recommend asking on Accumulo's user mailing list instead. user@accumulo.apache.org
– Christopher
Nov 24 '18 at 17:02
1
I figured what the problem was. It turns out that my Iterator was being called. The reason it was not hitting any breakpoints is that it is executed in another process (instance of the JVM); a tablet server. Once I realized that even MiniAccumuloCluster starts a separate process for the tablet server, I figured out how to get the debug ports from the MiniAccumuloCluster and remotely debug my Iterator from Eclipse. Thanks for the suggestion about posting to the Accumulo forum, I'll do so in the future.
– codemasterg
Nov 25 '18 at 21:40
add a comment |
I am learning Accumulo and want to add my own Iterator to a scan. My Iterator extends WrappingIterator, and I add it to my scanner (priority 10, MyIterator.class), but none of the methods nor the public no-args constructor ever gets called. I am using MiniAccumulo cluster and set breakpoints in the constructor and other public methods of my Iterator, but they are never hit.
Ultimately what I am trying to do (beyond learning about Iterators):
- I want Accumulo to maintain versions of my changes so I have configured it mic, majc, and scan # of versions to MAX_INT
- When scanning across a range of keys, there are times when I only want the most recent for each key in the range (not the full history returned to the client).
- My thought was to write an Iterator that could return the latest key/value pair for each item in the range where latest = the key with the latest timestamp value for each in the range.
Thanks.
accumulo
asked Nov 19 '18 at 12:57
codemasterg
85
I am learning Accumulo and want to add my own Iterator to a scan. My Iterator extends WrappingIterator, and I add it to my scanner (priority 10, MyIterator.class), but none of the methods nor the public no-args constructor ever gets called. I am using MiniAccumulo cluster and set breakpoints in the constructor and other public methods of my Iterator, but they are never hit.
Ultimately what I am trying to do (beyond learning about Iterators):
- I want Accumulo to maintain versions of my changes so I have configured it mic, majc, and scan # of versions to MAX_INT
- When scanning across a range of keys, there are times when I only want the most recent for each key in the range (not the full history returned to the client).
- My thought was to write an Iterator that could return the latest key/value pair for each item in the range where latest = the key with the latest timestamp value for each in the range.
Thanks.
accumulo
accumulo
asked Nov 19 '18 at 12:57
codemasterg
85
asked Nov 19 '18 at 12:57
codemasterg
85
asked Nov 19 '18 at 12:57
codemasterg
85
asked Nov 19 '18 at 12:57
codemasterg
85
asked Nov 19 '18 at 12:57
codemasterg
85
85
This question isn't well suited to StackOverflow because it doesn't have a single answer, and more details are needed to figure out what is going wrong in your case. I recommend asking on Accumulo's user mailing list instead. user@accumulo.apache.org
– Christopher
Nov 24 '18 at 17:02
1
I figured what the problem was. It turns out that my Iterator was being called. The reason it was not hitting any breakpoints is that it is executed in another process (instance of the JVM); a tablet server. Once I realized that even MiniAccumuloCluster starts a separate process for the tablet server, I figured out how to get the debug ports from the MiniAccumuloCluster and remotely debug my Iterator from Eclipse. Thanks for the suggestion about posting to the Accumulo forum, I'll do so in the future.
– codemasterg
Nov 25 '18 at 21:40
add a comment |
This question isn't well suited to StackOverflow because it doesn't have a single answer, and more details are needed to figure out what is going wrong in your case. I recommend asking on Accumulo's user mailing list instead. user@accumulo.apache.org
– Christopher
Nov 24 '18 at 17:02
1
I figured what the problem was. It turns out that my Iterator was being called. The reason it was not hitting any breakpoints is that it is executed in another process (instance of the JVM); a tablet server. Once I realized that even MiniAccumuloCluster starts a separate process for the tablet server, I figured out how to get the debug ports from the MiniAccumuloCluster and remotely debug my Iterator from Eclipse. Thanks for the suggestion about posting to the Accumulo forum, I'll do so in the future.
– codemasterg
Nov 25 '18 at 21:40
This question isn't well suited to StackOverflow because it doesn't have a single answer, and more details are needed to figure out what is going wrong in your case. I recommend asking on Accumulo's user mailing list instead. user@accumulo.apache.org
– Christopher
Nov 24 '18 at 17:02
This question isn't well suited to StackOverflow because it doesn't have a single answer, and more details are needed to figure out what is going wrong in your case. I recommend asking on Accumulo's user mailing list instead. user@accumulo.apache.org
– Christopher
Nov 24 '18 at 17:02
1
1
I figured what the problem was. It turns out that my Iterator was being called. The reason it was not hitting any breakpoints is that it is executed in another process (instance of the JVM); a tablet server. Once I realized that even MiniAccumuloCluster starts a separate process for the tablet server, I figured out how to get the debug ports from the MiniAccumuloCluster and remotely debug my Iterator from Eclipse. Thanks for the suggestion about posting to the Accumulo forum, I'll do so in the future.
– codemasterg
Nov 25 '18 at 21:40
I figured what the problem was. It turns out that my Iterator was being called. The reason it was not hitting any breakpoints is that it is executed in another process (instance of the JVM); a tablet server. Once I realized that even MiniAccumuloCluster starts a separate process for the tablet server, I figured out how to get the debug ports from the MiniAccumuloCluster and remotely debug my Iterator from Eclipse. Thanks for the suggestion about posting to the Accumulo forum, I'll do so in the future.
– codemasterg
Nov 25 '18 at 21:40
add a comment |
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53375153%2faccumulo-iterator-not-being-called%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53375153%2faccumulo-iterator-not-being-called%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
This question isn't well suited to StackOverflow because it doesn't have a single answer, and more details are needed to figure out what is going wrong in your case. I recommend asking on Accumulo's user mailing list instead. user@accumulo.apache.org
– Christopher
Nov 24 '18 at 17:02
1
I figured what the problem was. It turns out that my Iterator was being called. The reason it was not hitting any breakpoints is that it is executed in another process (instance of the JVM); a tablet server. Once I realized that even MiniAccumuloCluster starts a separate process for the tablet server, I figured out how to get the debug ports from the MiniAccumuloCluster and remotely debug my Iterator from Eclipse. Thanks for the suggestion about posting to the Accumulo forum, I'll do so in the future.
– codemasterg
Nov 25 '18 at 21:40