Mixing
Kafka - Retries in Kafka cluster
In Kafka cluster , If retries is getting increased what would be cause of it ?
What are the factors related to retries ?
apache-kafka
edited Jan 3 at 16:55
cricket_007
83.7k1147117
asked Jan 2 at 19:08
Karthikeyan DurairajKarthikeyan Durairaj
698
add a comment |
In Kafka cluster , If retries is getting increased what would be cause of it ?
What are the factors related to retries ?
apache-kafka
edited Jan 3 at 16:55
cricket_007
83.7k1147117
asked Jan 2 at 19:08
Karthikeyan DurairajKarthikeyan Durairaj
698
Check out this link. Might help. stackoverflow.com/questions/52649077/assert-kafka-send-worked/…
– Bitswazsky
Jan 3 at 8:44
add a comment |
In Kafka cluster , If retries is getting increased what would be cause of it ?
What are the factors related to retries ?
apache-kafka
edited Jan 3 at 16:55
cricket_007
83.7k1147117
asked Jan 2 at 19:08
Karthikeyan DurairajKarthikeyan Durairaj
698
In Kafka cluster , If retries is getting increased what would be cause of it ?
What are the factors related to retries ?
apache-kafka
apache-kafka
edited Jan 3 at 16:55
cricket_007
83.7k1147117
asked Jan 2 at 19:08
Karthikeyan DurairajKarthikeyan Durairaj
698
edited Jan 3 at 16:55
cricket_007
83.7k1147117
asked Jan 2 at 19:08
Karthikeyan DurairajKarthikeyan Durairaj
698
edited Jan 3 at 16:55
cricket_007
83.7k1147117
edited Jan 3 at 16:55
cricket_007
83.7k1147117
edited Jan 3 at 16:55
cricket_007
83.7k1147117
83.7k1147117
asked Jan 2 at 19:08
Karthikeyan DurairajKarthikeyan Durairaj
698
asked Jan 2 at 19:08
Karthikeyan DurairajKarthikeyan Durairaj
698
asked Jan 2 at 19:08
Karthikeyan DurairajKarthikeyan Durairaj
698
698
Check out this link. Might help. stackoverflow.com/questions/52649077/assert-kafka-send-worked/…
– Bitswazsky
Jan 3 at 8:44
add a comment |
Check out this link. Might help. stackoverflow.com/questions/52649077/assert-kafka-send-worked/…
– Bitswazsky
Jan 3 at 8:44
Check out this link. Might help. stackoverflow.com/questions/52649077/assert-kafka-send-worked/…
– Bitswazsky
Jan 3 at 8:44
Check out this link. Might help. stackoverflow.com/questions/52649077/assert-kafka-send-worked/…
– Bitswazsky
Jan 3 at 8:44
add a comment |
1 Answer
1
active
oldest
votes
On the Kafka producer side (the Java producer client) there are two types of possible errors: retriable and not retriable.
The retriable ones are errors that can be resolved just resending the message (so trying one more time), for example a connection error or a no-leader because a leader election could be run and a leader will be elected soon. In this case the producer tries to re-send the message until the send succeeded or the max number of configured retries are reached.
Other errors like when a message is too large are not retriable; they cannot be "fixed" just re-sending the message.
answered Jan 2 at 20:52
ppatiernoppatierno
4,71011228
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54011876%2fkafka-retries-in-kafka-cluster%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
On the Kafka producer side (the Java producer client) there are two types of possible errors: retriable and not retriable.
The retriable ones are errors that can be resolved just resending the message (so trying one more time), for example a connection error or a no-leader because a leader election could be run and a leader will be elected soon. In this case the producer tries to re-send the message until the send succeeded or the max number of configured retries are reached.
Other errors like when a message is too large are not retriable; they cannot be "fixed" just re-sending the message.
answered Jan 2 at 20:52
ppatiernoppatierno
4,71011228
add a comment |
On the Kafka producer side (the Java producer client) there are two types of possible errors: retriable and not retriable.
The retriable ones are errors that can be resolved just resending the message (so trying one more time), for example a connection error or a no-leader because a leader election could be run and a leader will be elected soon. In this case the producer tries to re-send the message until the send succeeded or the max number of configured retries are reached.
Other errors like when a message is too large are not retriable; they cannot be "fixed" just re-sending the message.
answered Jan 2 at 20:52
ppatiernoppatierno
4,71011228
add a comment |
On the Kafka producer side (the Java producer client) there are two types of possible errors: retriable and not retriable.
The retriable ones are errors that can be resolved just resending the message (so trying one more time), for example a connection error or a no-leader because a leader election could be run and a leader will be elected soon. In this case the producer tries to re-send the message until the send succeeded or the max number of configured retries are reached.
Other errors like when a message is too large are not retriable; they cannot be "fixed" just re-sending the message.
answered Jan 2 at 20:52
ppatiernoppatierno
4,71011228
On the Kafka producer side (the Java producer client) there are two types of possible errors: retriable and not retriable.
The retriable ones are errors that can be resolved just resending the message (so trying one more time), for example a connection error or a no-leader because a leader election could be run and a leader will be elected soon. In this case the producer tries to re-send the message until the send succeeded or the max number of configured retries are reached.
Other errors like when a message is too large are not retriable; they cannot be "fixed" just re-sending the message.
answered Jan 2 at 20:52
ppatiernoppatierno
4,71011228
answered Jan 2 at 20:52
ppatiernoppatierno
4,71011228
answered Jan 2 at 20:52
ppatiernoppatierno
4,71011228
answered Jan 2 at 20:52
ppatiernoppatierno
4,71011228
4,71011228
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54011876%2fkafka-retries-in-kafka-cluster%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Check out this link. Might help. stackoverflow.com/questions/52649077/assert-kafka-send-worked/…
– Bitswazsky
Jan 3 at 8:44