Mixing
Shared config variable between multiple processes
Say you have a config.py which inside has
settings = read_yaml('settings.yaml')
so config.settings is a dictionary.
in one script foo.py you have:
import config
config.settings['foo'] = str(time.time())
write_yaml('settings.yaml', config.settings)
and in another script bar.py you have
import config
while True:
sleep(10)
print config.settings['foo']
How would you keep the printed value in bar.py up to date with the new value after running foo.py at any time without the obvious reading the file again seeing as the while loop in bar.py needs to be as quick as possible!
I currently run these on seperate bash threads i.e:
$ python bar.py
$ python foo.py
But I could run bar in a thread if that is possible?
python dictionary parallel-processing multiprocessing multiple-processes
edited Jan 1 at 18:31
finefoot
2,78541835
asked Jan 1 at 18:19
maxismemaxisme
1,14432863
add a comment |
Say you have a config.py which inside has
settings = read_yaml('settings.yaml')
so config.settings is a dictionary.
in one script foo.py you have:
import config
config.settings['foo'] = str(time.time())
write_yaml('settings.yaml', config.settings)
and in another script bar.py you have
import config
while True:
sleep(10)
print config.settings['foo']
How would you keep the printed value in bar.py up to date with the new value after running foo.py at any time without the obvious reading the file again seeing as the while loop in bar.py needs to be as quick as possible!
I currently run these on seperate bash threads i.e:
$ python bar.py
$ python foo.py
But I could run bar in a thread if that is possible?
python dictionary parallel-processing multiprocessing multiple-processes
edited Jan 1 at 18:31
finefoot
2,78541835
asked Jan 1 at 18:19
maxismemaxisme
1,14432863
stackoverflow.com/questions/13034496/…
– Makalone LOgman
Jan 1 at 18:30
Is using any of the standard IPC mechanisms an option for communication between foo and bar?
– Sharad
Jan 1 at 18:47
Oh, I see yourprintstatement now. Is this a Python 2 question?
– finefoot
Jan 1 at 19:05
add a comment |
Say you have a config.py which inside has
settings = read_yaml('settings.yaml')
so config.settings is a dictionary.
in one script foo.py you have:
import config
config.settings['foo'] = str(time.time())
write_yaml('settings.yaml', config.settings)
and in another script bar.py you have
import config
while True:
sleep(10)
print config.settings['foo']
How would you keep the printed value in bar.py up to date with the new value after running foo.py at any time without the obvious reading the file again seeing as the while loop in bar.py needs to be as quick as possible!
I currently run these on seperate bash threads i.e:
$ python bar.py
$ python foo.py
But I could run bar in a thread if that is possible?
python dictionary parallel-processing multiprocessing multiple-processes
edited Jan 1 at 18:31
finefoot
2,78541835
asked Jan 1 at 18:19
maxismemaxisme
1,14432863
Say you have a config.py which inside has
settings = read_yaml('settings.yaml')
so config.settings is a dictionary.
in one script foo.py you have:
import config
config.settings['foo'] = str(time.time())
write_yaml('settings.yaml', config.settings)
and in another script bar.py you have
import config
while True:
sleep(10)
print config.settings['foo']
How would you keep the printed value in bar.py up to date with the new value after running foo.py at any time without the obvious reading the file again seeing as the while loop in bar.py needs to be as quick as possible!
I currently run these on seperate bash threads i.e:
$ python bar.py
$ python foo.py
But I could run bar in a thread if that is possible?
python dictionary parallel-processing multiprocessing multiple-processes
python dictionary parallel-processing multiprocessing multiple-processes
edited Jan 1 at 18:31
finefoot
2,78541835
asked Jan 1 at 18:19
maxismemaxisme
1,14432863
edited Jan 1 at 18:31
finefoot
2,78541835
asked Jan 1 at 18:19
maxismemaxisme
1,14432863
edited Jan 1 at 18:31
finefoot
2,78541835
edited Jan 1 at 18:31
finefoot
2,78541835
edited Jan 1 at 18:31
finefoot
2,78541835
2,78541835
asked Jan 1 at 18:19
maxismemaxisme
1,14432863
asked Jan 1 at 18:19
maxismemaxisme
1,14432863
asked Jan 1 at 18:19
maxismemaxisme
1,14432863
1,14432863
stackoverflow.com/questions/13034496/…
– Makalone LOgman
Jan 1 at 18:30
Is using any of the standard IPC mechanisms an option for communication between foo and bar?
– Sharad
Jan 1 at 18:47
Oh, I see yourprintstatement now. Is this a Python 2 question?
– finefoot
Jan 1 at 19:05
add a comment |
stackoverflow.com/questions/13034496/…
– Makalone LOgman
Jan 1 at 18:30
Is using any of the standard IPC mechanisms an option for communication between foo and bar?
– Sharad
Jan 1 at 18:47
Oh, I see yourprintstatement now. Is this a Python 2 question?
– finefoot
Jan 1 at 19:05
stackoverflow.com/questions/13034496/…
– Makalone LOgman
Jan 1 at 18:30
stackoverflow.com/questions/13034496/…
– Makalone LOgman
Jan 1 at 18:30
Is using any of the standard IPC mechanisms an option for communication between foo and bar?
– Sharad
Jan 1 at 18:47
Is using any of the standard IPC mechanisms an option for communication between foo and bar?
– Sharad
Jan 1 at 18:47
Oh, I see your
print statement now. Is this a Python 2 question?– finefoot
Jan 1 at 19:05
Oh, I see your
print statement now. Is this a Python 2 question?– finefoot
Jan 1 at 19:05
add a comment |
1 Answer
1
active
oldest
votes
I don't know how fast you need this to be. But it would certainly be possible to just reload the config module with importlib.reload. So config.py and foo.py stay the same and your bar.py changes to:
import importlib
import config
while True:
sleep(10)
print config.settings['foo']
importlib.reload(config)
Update
The example above works for Python >= 3.4, use imp.reload for earlier versions of Python 3 or reload for Python 2.
answered Jan 1 at 18:41
finefootfinefoot
2,78541835
By the way, it might make more sense to put the reload immediately in front of the print and after the sleep, so any changes during the sleep will be included...
– finefoot
Jan 1 at 19:20
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53997828%2fshared-config-variable-between-multiple-processes%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
I don't know how fast you need this to be. But it would certainly be possible to just reload the config module with importlib.reload. So config.py and foo.py stay the same and your bar.py changes to:
import importlib
import config
while True:
sleep(10)
print config.settings['foo']
importlib.reload(config)
Update
The example above works for Python >= 3.4, use imp.reload for earlier versions of Python 3 or reload for Python 2.
answered Jan 1 at 18:41
finefootfinefoot
2,78541835
By the way, it might make more sense to put the reload immediately in front of the print and after the sleep, so any changes during the sleep will be included...
– finefoot
Jan 1 at 19:20
add a comment |
I don't know how fast you need this to be. But it would certainly be possible to just reload the config module with importlib.reload. So config.py and foo.py stay the same and your bar.py changes to:
import importlib
import config
while True:
sleep(10)
print config.settings['foo']
importlib.reload(config)
Update
The example above works for Python >= 3.4, use imp.reload for earlier versions of Python 3 or reload for Python 2.
answered Jan 1 at 18:41
finefootfinefoot
2,78541835
By the way, it might make more sense to put the reload immediately in front of the print and after the sleep, so any changes during the sleep will be included...
– finefoot
Jan 1 at 19:20
add a comment |
I don't know how fast you need this to be. But it would certainly be possible to just reload the config module with importlib.reload. So config.py and foo.py stay the same and your bar.py changes to:
import importlib
import config
while True:
sleep(10)
print config.settings['foo']
importlib.reload(config)
Update
The example above works for Python >= 3.4, use imp.reload for earlier versions of Python 3 or reload for Python 2.
answered Jan 1 at 18:41
finefootfinefoot
2,78541835
I don't know how fast you need this to be. But it would certainly be possible to just reload the config module with importlib.reload. So config.py and foo.py stay the same and your bar.py changes to:
import importlib
import config
while True:
sleep(10)
print config.settings['foo']
importlib.reload(config)
Update
The example above works for Python >= 3.4, use imp.reload for earlier versions of Python 3 or reload for Python 2.
answered Jan 1 at 18:41
finefootfinefoot
2,78541835
edited Jan 1 at 19:07
answered Jan 1 at 18:41
finefootfinefoot
2,78541835
answered Jan 1 at 18:41
finefootfinefoot
2,78541835
answered Jan 1 at 18:41
finefootfinefoot
2,78541835
2,78541835
By the way, it might make more sense to put the reload immediately in front of the print and after the sleep, so any changes during the sleep will be included...
– finefoot
Jan 1 at 19:20
add a comment |
By the way, it might make more sense to put the reload immediately in front of the print and after the sleep, so any changes during the sleep will be included...
– finefoot
Jan 1 at 19:20
By the way, it might make more sense to put the reload immediately in front of the print and after the sleep, so any changes during the sleep will be included...
– finefoot
Jan 1 at 19:20
By the way, it might make more sense to put the reload immediately in front of the print and after the sleep, so any changes during the sleep will be included...
– finefoot
Jan 1 at 19:20
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53997828%2fshared-config-variable-between-multiple-processes%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
stackoverflow.com/questions/13034496/…
– Makalone LOgman
Jan 1 at 18:30
Is using any of the standard IPC mechanisms an option for communication between foo and bar?
– Sharad
Jan 1 at 18:47
Oh, I see your
printstatement now. Is this a Python 2 question?– finefoot
Jan 1 at 19:05