Mixing
Python property testing with timeout
I have a certain amount of time to test a system. Can I write a Python property test that runs property tests until one hour is up? I looked for a solution in hypothesis but I couldn't find one.
I imagine that property-testing libraries have some kind of test-case generator, in which can I could just pull and execute from it until the timeout is up. This would be an acceptable lazy solution.
python timeout python-hypothesis property-testing
asked Nov 19 '18 at 20:14
Matthew PiziakMatthew Piziak
1,55932041
add a comment |
I have a certain amount of time to test a system. Can I write a Python property test that runs property tests until one hour is up? I looked for a solution in hypothesis but I couldn't find one.
I imagine that property-testing libraries have some kind of test-case generator, in which can I could just pull and execute from it until the timeout is up. This would be an acceptable lazy solution.
python timeout python-hypothesis property-testing
asked Nov 19 '18 at 20:14
Matthew PiziakMatthew Piziak
1,55932041
1
@Prune - this is a question about the Hypothesis library I maintain, and is not a duplicate. Can you reopen so that I can answer?
– Zac Hatfield-Dodds
Nov 25 '18 at 6:06
1
Short answer as a comment: Hypothesis does not have a generator you can pull from. However you can add@settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9)to a test and it should run for an hour (or until finding a bug). github.com/HypothesisWorks/hypothesis/issues/171 is the issue to add a full fuzzing mode.
– Zac Hatfield-Dodds
Nov 25 '18 at 6:11
@ZacHatfield-Dodds: done; thanks for picking up the issue.
– Prune
Nov 26 '18 at 15:13
@ZacHatfield-Dodds Thank you for rescuing my question, and thank you for the answer. If you would like to promote it I'd be happy to accept it.
– Matthew Piziak
Nov 26 '18 at 22:06
add a comment |
I have a certain amount of time to test a system. Can I write a Python property test that runs property tests until one hour is up? I looked for a solution in hypothesis but I couldn't find one.
I imagine that property-testing libraries have some kind of test-case generator, in which can I could just pull and execute from it until the timeout is up. This would be an acceptable lazy solution.
python timeout python-hypothesis property-testing
asked Nov 19 '18 at 20:14
Matthew PiziakMatthew Piziak
1,55932041
I have a certain amount of time to test a system. Can I write a Python property test that runs property tests until one hour is up? I looked for a solution in hypothesis but I couldn't find one.
I imagine that property-testing libraries have some kind of test-case generator, in which can I could just pull and execute from it until the timeout is up. This would be an acceptable lazy solution.
python timeout python-hypothesis property-testing
python timeout python-hypothesis property-testing
asked Nov 19 '18 at 20:14
Matthew PiziakMatthew Piziak
1,55932041
asked Nov 19 '18 at 20:14
Matthew PiziakMatthew Piziak
1,55932041
asked Nov 19 '18 at 20:14
Matthew PiziakMatthew Piziak
1,55932041
asked Nov 19 '18 at 20:14
Matthew PiziakMatthew Piziak
1,55932041
asked Nov 19 '18 at 20:14
Matthew PiziakMatthew Piziak
1,55932041
1,55932041
1
@Prune - this is a question about the Hypothesis library I maintain, and is not a duplicate. Can you reopen so that I can answer?
– Zac Hatfield-Dodds
Nov 25 '18 at 6:06
1
Short answer as a comment: Hypothesis does not have a generator you can pull from. However you can add@settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9)to a test and it should run for an hour (or until finding a bug). github.com/HypothesisWorks/hypothesis/issues/171 is the issue to add a full fuzzing mode.
– Zac Hatfield-Dodds
Nov 25 '18 at 6:11
@ZacHatfield-Dodds: done; thanks for picking up the issue.
– Prune
Nov 26 '18 at 15:13
@ZacHatfield-Dodds Thank you for rescuing my question, and thank you for the answer. If you would like to promote it I'd be happy to accept it.
– Matthew Piziak
Nov 26 '18 at 22:06
add a comment |
1
@Prune - this is a question about the Hypothesis library I maintain, and is not a duplicate. Can you reopen so that I can answer?
– Zac Hatfield-Dodds
Nov 25 '18 at 6:06
1
Short answer as a comment: Hypothesis does not have a generator you can pull from. However you can add@settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9)to a test and it should run for an hour (or until finding a bug). github.com/HypothesisWorks/hypothesis/issues/171 is the issue to add a full fuzzing mode.
– Zac Hatfield-Dodds
Nov 25 '18 at 6:11
@ZacHatfield-Dodds: done; thanks for picking up the issue.
– Prune
Nov 26 '18 at 15:13
@ZacHatfield-Dodds Thank you for rescuing my question, and thank you for the answer. If you would like to promote it I'd be happy to accept it.
– Matthew Piziak
Nov 26 '18 at 22:06
1
1
@Prune - this is a question about the Hypothesis library I maintain, and is not a duplicate. Can you reopen so that I can answer?
– Zac Hatfield-Dodds
Nov 25 '18 at 6:06
@Prune - this is a question about the Hypothesis library I maintain, and is not a duplicate. Can you reopen so that I can answer?
– Zac Hatfield-Dodds
Nov 25 '18 at 6:06
1
1
Short answer as a comment: Hypothesis does not have a generator you can pull from. However you can add
@settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9) to a test and it should run for an hour (or until finding a bug). github.com/HypothesisWorks/hypothesis/issues/171 is the issue to add a full fuzzing mode.– Zac Hatfield-Dodds
Nov 25 '18 at 6:11
Short answer as a comment: Hypothesis does not have a generator you can pull from. However you can add
@settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9) to a test and it should run for an hour (or until finding a bug). github.com/HypothesisWorks/hypothesis/issues/171 is the issue to add a full fuzzing mode.– Zac Hatfield-Dodds
Nov 25 '18 at 6:11
@ZacHatfield-Dodds: done; thanks for picking up the issue.
– Prune
Nov 26 '18 at 15:13
@ZacHatfield-Dodds: done; thanks for picking up the issue.
– Prune
Nov 26 '18 at 15:13
@ZacHatfield-Dodds Thank you for rescuing my question, and thank you for the answer. If you would like to promote it I'd be happy to accept it.
– Matthew Piziak
Nov 26 '18 at 22:06
@ZacHatfield-Dodds Thank you for rescuing my question, and thank you for the answer. If you would like to promote it I'd be happy to accept it.
– Matthew Piziak
Nov 26 '18 at 22:06
add a comment |
1 Answer
1
active
oldest
votes
Hypothesis does not have a generator you can pull from - the internals are implemented quite differently to the usual lazy-infinite-list construction used by Quickcheck (because... Haskell).
We have an open issue to add a fuzzing mode, which will (hopefully) be the subject of an undergrad group project at Imperial College in early 2019.
Until that's ready, you can add @settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9) to a test and it should run for an hour (or until finding a bug).
answered Nov 30 '18 at 6:42
Zac Hatfield-DoddsZac Hatfield-Dodds
35710
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53381978%2fpython-property-testing-with-timeout%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Hypothesis does not have a generator you can pull from - the internals are implemented quite differently to the usual lazy-infinite-list construction used by Quickcheck (because... Haskell).
We have an open issue to add a fuzzing mode, which will (hopefully) be the subject of an undergrad group project at Imperial College in early 2019.
Until that's ready, you can add @settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9) to a test and it should run for an hour (or until finding a bug).
answered Nov 30 '18 at 6:42
Zac Hatfield-DoddsZac Hatfield-Dodds
35710
add a comment |
Hypothesis does not have a generator you can pull from - the internals are implemented quite differently to the usual lazy-infinite-list construction used by Quickcheck (because... Haskell).
We have an open issue to add a fuzzing mode, which will (hopefully) be the subject of an undergrad group project at Imperial College in early 2019.
Until that's ready, you can add @settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9) to a test and it should run for an hour (or until finding a bug).
answered Nov 30 '18 at 6:42
Zac Hatfield-DoddsZac Hatfield-Dodds
35710
add a comment |
Hypothesis does not have a generator you can pull from - the internals are implemented quite differently to the usual lazy-infinite-list construction used by Quickcheck (because... Haskell).
We have an open issue to add a fuzzing mode, which will (hopefully) be the subject of an undergrad group project at Imperial College in early 2019.
Until that's ready, you can add @settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9) to a test and it should run for an hour (or until finding a bug).
answered Nov 30 '18 at 6:42
Zac Hatfield-DoddsZac Hatfield-Dodds
35710
Hypothesis does not have a generator you can pull from - the internals are implemented quite differently to the usual lazy-infinite-list construction used by Quickcheck (because... Haskell).
We have an open issue to add a fuzzing mode, which will (hopefully) be the subject of an undergrad group project at Imperial College in early 2019.
Until that's ready, you can add @settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9) to a test and it should run for an hour (or until finding a bug).
answered Nov 30 '18 at 6:42
Zac Hatfield-DoddsZac Hatfield-Dodds
35710
answered Nov 30 '18 at 6:42
Zac Hatfield-DoddsZac Hatfield-Dodds
35710
answered Nov 30 '18 at 6:42
Zac Hatfield-DoddsZac Hatfield-Dodds
35710
answered Nov 30 '18 at 6:42
Zac Hatfield-DoddsZac Hatfield-Dodds
35710
35710
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53381978%2fpython-property-testing-with-timeout%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
@Prune - this is a question about the Hypothesis library I maintain, and is not a duplicate. Can you reopen so that I can answer?
– Zac Hatfield-Dodds
Nov 25 '18 at 6:06
1
Short answer as a comment: Hypothesis does not have a generator you can pull from. However you can add
@settings(timeout=60*60, suppress_health_check=HealthCheck.all(), max_examples=10**9)to a test and it should run for an hour (or until finding a bug). github.com/HypothesisWorks/hypothesis/issues/171 is the issue to add a full fuzzing mode.– Zac Hatfield-Dodds
Nov 25 '18 at 6:11
@ZacHatfield-Dodds: done; thanks for picking up the issue.
– Prune
Nov 26 '18 at 15:13
@ZacHatfield-Dodds Thank you for rescuing my question, and thank you for the answer. If you would like to promote it I'd be happy to accept it.
– Matthew Piziak
Nov 26 '18 at 22:06