How to clear values from columns with the values “No” instead of NaN?
I have a dataset that I'm going through and I have No
values in some slots instead of NaN
so I couldn't use the dropna
method. I believe that there is a specific way of looking for certain value in an entire dataset and performing operations on it but I don't know how that is done.
This is the csv I'm working with.
https://raw.githubusercontent.com/ryanleeallred/datasets/master/messy-data.csv
python pandas csv
add a comment |
I have a dataset that I'm going through and I have No
values in some slots instead of NaN
so I couldn't use the dropna
method. I believe that there is a specific way of looking for certain value in an entire dataset and performing operations on it but I don't know how that is done.
This is the csv I'm working with.
https://raw.githubusercontent.com/ryanleeallred/datasets/master/messy-data.csv
python pandas csv
I don't seeNaN
values anywhere in your CSV file. Did you leave something out?
– Tim Biegeleisen
Jan 2 at 5:35
What library are you using to parse csv?
– Aakash Verma
Jan 2 at 5:35
@Tim I think he’s talking about the dataframe which would contain NaN for all the empty cellss
– Aakash Verma
Jan 2 at 5:36
I don't know Pandas data frames. Oh, the horror.
– Tim Biegeleisen
Jan 2 at 5:36
"I have a dataset that I'm going through and I have "No" values in some slots instead of NaN"
– user10851318
Jan 2 at 5:38
add a comment |
I have a dataset that I'm going through and I have No
values in some slots instead of NaN
so I couldn't use the dropna
method. I believe that there is a specific way of looking for certain value in an entire dataset and performing operations on it but I don't know how that is done.
This is the csv I'm working with.
https://raw.githubusercontent.com/ryanleeallred/datasets/master/messy-data.csv
python pandas csv
I have a dataset that I'm going through and I have No
values in some slots instead of NaN
so I couldn't use the dropna
method. I believe that there is a specific way of looking for certain value in an entire dataset and performing operations on it but I don't know how that is done.
This is the csv I'm working with.
https://raw.githubusercontent.com/ryanleeallred/datasets/master/messy-data.csv
python pandas csv
python pandas csv
edited Jan 2 at 6:16
AkshayNevrekar
5,29791940
5,29791940
asked Jan 2 at 5:33
user10851318
I don't seeNaN
values anywhere in your CSV file. Did you leave something out?
– Tim Biegeleisen
Jan 2 at 5:35
What library are you using to parse csv?
– Aakash Verma
Jan 2 at 5:35
@Tim I think he’s talking about the dataframe which would contain NaN for all the empty cellss
– Aakash Verma
Jan 2 at 5:36
I don't know Pandas data frames. Oh, the horror.
– Tim Biegeleisen
Jan 2 at 5:36
"I have a dataset that I'm going through and I have "No" values in some slots instead of NaN"
– user10851318
Jan 2 at 5:38
add a comment |
I don't seeNaN
values anywhere in your CSV file. Did you leave something out?
– Tim Biegeleisen
Jan 2 at 5:35
What library are you using to parse csv?
– Aakash Verma
Jan 2 at 5:35
@Tim I think he’s talking about the dataframe which would contain NaN for all the empty cellss
– Aakash Verma
Jan 2 at 5:36
I don't know Pandas data frames. Oh, the horror.
– Tim Biegeleisen
Jan 2 at 5:36
"I have a dataset that I'm going through and I have "No" values in some slots instead of NaN"
– user10851318
Jan 2 at 5:38
I don't see
NaN
values anywhere in your CSV file. Did you leave something out?– Tim Biegeleisen
Jan 2 at 5:35
I don't see
NaN
values anywhere in your CSV file. Did you leave something out?– Tim Biegeleisen
Jan 2 at 5:35
What library are you using to parse csv?
– Aakash Verma
Jan 2 at 5:35
What library are you using to parse csv?
– Aakash Verma
Jan 2 at 5:35
@Tim I think he’s talking about the dataframe which would contain NaN for all the empty cellss
– Aakash Verma
Jan 2 at 5:36
@Tim I think he’s talking about the dataframe which would contain NaN for all the empty cellss
– Aakash Verma
Jan 2 at 5:36
I don't know Pandas data frames. Oh, the horror.
– Tim Biegeleisen
Jan 2 at 5:36
I don't know Pandas data frames. Oh, the horror.
– Tim Biegeleisen
Jan 2 at 5:36
"I have a dataset that I'm going through and I have "No" values in some slots instead of NaN"
– user10851318
Jan 2 at 5:38
"I have a dataset that I'm going through and I have "No" values in some slots instead of NaN"
– user10851318
Jan 2 at 5:38
add a comment |
1 Answer
1
active
oldest
votes
You can replace No
by nan
and use dropna
import numpy as np
df = pd.DataFrame({'a':['Yes','No','No','Yes']})
df = df.replace('No',np.nan)
df.dropna()
Output:
a
0 Yes
3 Yes
1
Thank you very much. I've accepted your answer and gave you an upvote. If you think that this was a well asked question, could you give me an upvote as well?
– user10851318
Jan 2 at 5:49
1
@OnurOzbek Refer this: How to create minimal, complete and verifiable example Next time when you ask a question on SO, follow these guidelines, you will get more upvotes. Upvoted :-)
– AkshayNevrekar
Jan 2 at 5:53
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54001665%2fhow-to-clear-values-from-columns-with-the-values-no-instead-of-nan%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
You can replace No
by nan
and use dropna
import numpy as np
df = pd.DataFrame({'a':['Yes','No','No','Yes']})
df = df.replace('No',np.nan)
df.dropna()
Output:
a
0 Yes
3 Yes
1
Thank you very much. I've accepted your answer and gave you an upvote. If you think that this was a well asked question, could you give me an upvote as well?
– user10851318
Jan 2 at 5:49
1
@OnurOzbek Refer this: How to create minimal, complete and verifiable example Next time when you ask a question on SO, follow these guidelines, you will get more upvotes. Upvoted :-)
– AkshayNevrekar
Jan 2 at 5:53
add a comment |
You can replace No
by nan
and use dropna
import numpy as np
df = pd.DataFrame({'a':['Yes','No','No','Yes']})
df = df.replace('No',np.nan)
df.dropna()
Output:
a
0 Yes
3 Yes
1
Thank you very much. I've accepted your answer and gave you an upvote. If you think that this was a well asked question, could you give me an upvote as well?
– user10851318
Jan 2 at 5:49
1
@OnurOzbek Refer this: How to create minimal, complete and verifiable example Next time when you ask a question on SO, follow these guidelines, you will get more upvotes. Upvoted :-)
– AkshayNevrekar
Jan 2 at 5:53
add a comment |
You can replace No
by nan
and use dropna
import numpy as np
df = pd.DataFrame({'a':['Yes','No','No','Yes']})
df = df.replace('No',np.nan)
df.dropna()
Output:
a
0 Yes
3 Yes
You can replace No
by nan
and use dropna
import numpy as np
df = pd.DataFrame({'a':['Yes','No','No','Yes']})
df = df.replace('No',np.nan)
df.dropna()
Output:
a
0 Yes
3 Yes
answered Jan 2 at 5:36
AkshayNevrekarAkshayNevrekar
5,29791940
5,29791940
1
Thank you very much. I've accepted your answer and gave you an upvote. If you think that this was a well asked question, could you give me an upvote as well?
– user10851318
Jan 2 at 5:49
1
@OnurOzbek Refer this: How to create minimal, complete and verifiable example Next time when you ask a question on SO, follow these guidelines, you will get more upvotes. Upvoted :-)
– AkshayNevrekar
Jan 2 at 5:53
add a comment |
1
Thank you very much. I've accepted your answer and gave you an upvote. If you think that this was a well asked question, could you give me an upvote as well?
– user10851318
Jan 2 at 5:49
1
@OnurOzbek Refer this: How to create minimal, complete and verifiable example Next time when you ask a question on SO, follow these guidelines, you will get more upvotes. Upvoted :-)
– AkshayNevrekar
Jan 2 at 5:53
1
1
Thank you very much. I've accepted your answer and gave you an upvote. If you think that this was a well asked question, could you give me an upvote as well?
– user10851318
Jan 2 at 5:49
Thank you very much. I've accepted your answer and gave you an upvote. If you think that this was a well asked question, could you give me an upvote as well?
– user10851318
Jan 2 at 5:49
1
1
@OnurOzbek Refer this: How to create minimal, complete and verifiable example Next time when you ask a question on SO, follow these guidelines, you will get more upvotes. Upvoted :-)
– AkshayNevrekar
Jan 2 at 5:53
@OnurOzbek Refer this: How to create minimal, complete and verifiable example Next time when you ask a question on SO, follow these guidelines, you will get more upvotes. Upvoted :-)
– AkshayNevrekar
Jan 2 at 5:53
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54001665%2fhow-to-clear-values-from-columns-with-the-values-no-instead-of-nan%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
I don't see
NaN
values anywhere in your CSV file. Did you leave something out?– Tim Biegeleisen
Jan 2 at 5:35
What library are you using to parse csv?
– Aakash Verma
Jan 2 at 5:35
@Tim I think he’s talking about the dataframe which would contain NaN for all the empty cellss
– Aakash Verma
Jan 2 at 5:36
I don't know Pandas data frames. Oh, the horror.
– Tim Biegeleisen
Jan 2 at 5:36
"I have a dataset that I'm going through and I have "No" values in some slots instead of NaN"
– user10851318
Jan 2 at 5:38