How to do a paired t-test using two different weights












0















I am doing an analysis on the well-being of children placed in foster care, and my dataset is based on a survey answered by a sample of all children placed in foster care in 2014 and 2018. About 50 percent of all children placed in foster care are 17 years old, but because this was not acoounted for in the process of collecting the data, I need to calculate a set of weights according to this age problem.



However, only about a third of the children who answered the survey in 2014 also answers the survey in 2018. That means that 2 thirds of the sample in 2018 are new respondents, and weights have therefore been calculated in both 2014 and 2018 and are not the equal to each other.



I am now going to compare the group of respondents in 2014 to the respondents in 2018 to find out if there has been a statistically significant change in the well being over the course of these four years.



My manager has asked me to do a paired t-test, because we have made the assumption the two samples contain same group of children (although this is not exactly true).



I am working in SAS and normally I have no problems doing a paired t-test, but because I have to use the aforementioned weights, I am a bit lost. My problem is that I have no idea how to state, that the variable from 2014 needs to be weighed with the weight from 2014, and that the variable from 2018 needs to be weighed with the weight from 2018 when I am doing the t-test.



I have posted an example of my code below:



Data have;
input id age_2014 age_2018 w_2014 w_2018 q_2014 q_2018;
lines;
1 11 15 1 1.3 0 1
2 11 15 1 1.3 0 1
3 11 . 1 . 1 0
4 13 17 2 2.1 1 0
5 13 17 2 2.1 0 1
6 . 17 . 2.1 1 0
7 13 17 2 2.1 1 0
8 . 15 . 1.3 1 0
9 11 . 1 . 1 0
10 . 17 . 2.1 0 1
;
run;

Proc ttest data=have H0=0 sides=2 alpha=0.05;
weight w_2014 w_2018;
paired q_2014*q_2018;
run;


My main problem is that I don't know where to state the two weights. At this point I get an error because I can't write two weights in the weight-statement.



Maybe it is actually wrong to assume that the two sample consists of the same people, and therefore it is not correct to use a paired-test?










share|improve this question


















  • 1





    It only makes sense to talk about a paired test in relation to cases where you can actually calculate the difference - you are testing whether the difference is zero. You can discard cases where this isn't possible, or impute missing values. You can assign an overall weight to each difference, but a 'weighted difference' is not a meaningful concept for individual rows.

    – user667489
    Nov 20 '18 at 16:49


















0















I am doing an analysis on the well-being of children placed in foster care, and my dataset is based on a survey answered by a sample of all children placed in foster care in 2014 and 2018. About 50 percent of all children placed in foster care are 17 years old, but because this was not acoounted for in the process of collecting the data, I need to calculate a set of weights according to this age problem.



However, only about a third of the children who answered the survey in 2014 also answers the survey in 2018. That means that 2 thirds of the sample in 2018 are new respondents, and weights have therefore been calculated in both 2014 and 2018 and are not the equal to each other.



I am now going to compare the group of respondents in 2014 to the respondents in 2018 to find out if there has been a statistically significant change in the well being over the course of these four years.



My manager has asked me to do a paired t-test, because we have made the assumption the two samples contain same group of children (although this is not exactly true).



I am working in SAS and normally I have no problems doing a paired t-test, but because I have to use the aforementioned weights, I am a bit lost. My problem is that I have no idea how to state, that the variable from 2014 needs to be weighed with the weight from 2014, and that the variable from 2018 needs to be weighed with the weight from 2018 when I am doing the t-test.



I have posted an example of my code below:



Data have;
input id age_2014 age_2018 w_2014 w_2018 q_2014 q_2018;
lines;
1 11 15 1 1.3 0 1
2 11 15 1 1.3 0 1
3 11 . 1 . 1 0
4 13 17 2 2.1 1 0
5 13 17 2 2.1 0 1
6 . 17 . 2.1 1 0
7 13 17 2 2.1 1 0
8 . 15 . 1.3 1 0
9 11 . 1 . 1 0
10 . 17 . 2.1 0 1
;
run;

Proc ttest data=have H0=0 sides=2 alpha=0.05;
weight w_2014 w_2018;
paired q_2014*q_2018;
run;


My main problem is that I don't know where to state the two weights. At this point I get an error because I can't write two weights in the weight-statement.



Maybe it is actually wrong to assume that the two sample consists of the same people, and therefore it is not correct to use a paired-test?










share|improve this question


















  • 1





    It only makes sense to talk about a paired test in relation to cases where you can actually calculate the difference - you are testing whether the difference is zero. You can discard cases where this isn't possible, or impute missing values. You can assign an overall weight to each difference, but a 'weighted difference' is not a meaningful concept for individual rows.

    – user667489
    Nov 20 '18 at 16:49
















0












0








0








I am doing an analysis on the well-being of children placed in foster care, and my dataset is based on a survey answered by a sample of all children placed in foster care in 2014 and 2018. About 50 percent of all children placed in foster care are 17 years old, but because this was not acoounted for in the process of collecting the data, I need to calculate a set of weights according to this age problem.



However, only about a third of the children who answered the survey in 2014 also answers the survey in 2018. That means that 2 thirds of the sample in 2018 are new respondents, and weights have therefore been calculated in both 2014 and 2018 and are not the equal to each other.



I am now going to compare the group of respondents in 2014 to the respondents in 2018 to find out if there has been a statistically significant change in the well being over the course of these four years.



My manager has asked me to do a paired t-test, because we have made the assumption the two samples contain same group of children (although this is not exactly true).



I am working in SAS and normally I have no problems doing a paired t-test, but because I have to use the aforementioned weights, I am a bit lost. My problem is that I have no idea how to state, that the variable from 2014 needs to be weighed with the weight from 2014, and that the variable from 2018 needs to be weighed with the weight from 2018 when I am doing the t-test.



I have posted an example of my code below:



Data have;
input id age_2014 age_2018 w_2014 w_2018 q_2014 q_2018;
lines;
1 11 15 1 1.3 0 1
2 11 15 1 1.3 0 1
3 11 . 1 . 1 0
4 13 17 2 2.1 1 0
5 13 17 2 2.1 0 1
6 . 17 . 2.1 1 0
7 13 17 2 2.1 1 0
8 . 15 . 1.3 1 0
9 11 . 1 . 1 0
10 . 17 . 2.1 0 1
;
run;

Proc ttest data=have H0=0 sides=2 alpha=0.05;
weight w_2014 w_2018;
paired q_2014*q_2018;
run;


My main problem is that I don't know where to state the two weights. At this point I get an error because I can't write two weights in the weight-statement.



Maybe it is actually wrong to assume that the two sample consists of the same people, and therefore it is not correct to use a paired-test?










share|improve this question














I am doing an analysis on the well-being of children placed in foster care, and my dataset is based on a survey answered by a sample of all children placed in foster care in 2014 and 2018. About 50 percent of all children placed in foster care are 17 years old, but because this was not acoounted for in the process of collecting the data, I need to calculate a set of weights according to this age problem.



However, only about a third of the children who answered the survey in 2014 also answers the survey in 2018. That means that 2 thirds of the sample in 2018 are new respondents, and weights have therefore been calculated in both 2014 and 2018 and are not the equal to each other.



I am now going to compare the group of respondents in 2014 to the respondents in 2018 to find out if there has been a statistically significant change in the well being over the course of these four years.



My manager has asked me to do a paired t-test, because we have made the assumption the two samples contain same group of children (although this is not exactly true).



I am working in SAS and normally I have no problems doing a paired t-test, but because I have to use the aforementioned weights, I am a bit lost. My problem is that I have no idea how to state, that the variable from 2014 needs to be weighed with the weight from 2014, and that the variable from 2018 needs to be weighed with the weight from 2018 when I am doing the t-test.



I have posted an example of my code below:



Data have;
input id age_2014 age_2018 w_2014 w_2018 q_2014 q_2018;
lines;
1 11 15 1 1.3 0 1
2 11 15 1 1.3 0 1
3 11 . 1 . 1 0
4 13 17 2 2.1 1 0
5 13 17 2 2.1 0 1
6 . 17 . 2.1 1 0
7 13 17 2 2.1 1 0
8 . 15 . 1.3 1 0
9 11 . 1 . 1 0
10 . 17 . 2.1 0 1
;
run;

Proc ttest data=have H0=0 sides=2 alpha=0.05;
weight w_2014 w_2018;
paired q_2014*q_2018;
run;


My main problem is that I don't know where to state the two weights. At this point I get an error because I can't write two weights in the weight-statement.



Maybe it is actually wrong to assume that the two sample consists of the same people, and therefore it is not correct to use a paired-test?







sas weight t-test






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Nov 20 '18 at 15:19









BeeBeeBeeBee

335




335








  • 1





    It only makes sense to talk about a paired test in relation to cases where you can actually calculate the difference - you are testing whether the difference is zero. You can discard cases where this isn't possible, or impute missing values. You can assign an overall weight to each difference, but a 'weighted difference' is not a meaningful concept for individual rows.

    – user667489
    Nov 20 '18 at 16:49
















  • 1





    It only makes sense to talk about a paired test in relation to cases where you can actually calculate the difference - you are testing whether the difference is zero. You can discard cases where this isn't possible, or impute missing values. You can assign an overall weight to each difference, but a 'weighted difference' is not a meaningful concept for individual rows.

    – user667489
    Nov 20 '18 at 16:49










1




1





It only makes sense to talk about a paired test in relation to cases where you can actually calculate the difference - you are testing whether the difference is zero. You can discard cases where this isn't possible, or impute missing values. You can assign an overall weight to each difference, but a 'weighted difference' is not a meaningful concept for individual rows.

– user667489
Nov 20 '18 at 16:49







It only makes sense to talk about a paired test in relation to cases where you can actually calculate the difference - you are testing whether the difference is zero. You can discard cases where this isn't possible, or impute missing values. You can assign an overall weight to each difference, but a 'weighted difference' is not a meaningful concept for individual rows.

– user667489
Nov 20 '18 at 16:49














0






active

oldest

votes











Your Answer






StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53396162%2fhow-to-do-a-paired-t-test-using-two-different-weights%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes
















draft saved

draft discarded




















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53396162%2fhow-to-do-a-paired-t-test-using-two-different-weights%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Can a sorcerer learn a 5th-level spell early by creating spell slots using the Font of Magic feature?

ts Property 'filter' does not exist on type '{}'

mat-slide-toggle shouldn't change it's state when I click cancel in confirmation window