Mixing
Comparison of two self ratings
$begingroup$
I have a small doubt regarding the comparison of two ratings.
I have two candidates, I asked them to rate themselves out of 10 in 4 different subjects. Both have the same level of knowledge in both subjects.
Student name Rating (Maths Physics Chemistry Biology)
A 10 10 10 10
B 7 7 7 7
(According to A he is giving 10/10 for his best skill, and B is giving 7/10 for his best skill.)
If I am comparing A and B in an absolute scale A is better than B. Is there a way or approach to detect them having the same skill? The only reference I have is the information in the table which is relative and I know they have the same skillset.
Please help me out,
Correct me if I am wrong.
Thanks and regards,
Sarin
statistics math-software number-comparison
asked Jan 25 at 8:30
SarinSarin
11
$endgroup$
add a comment |
$begingroup$
I have a small doubt regarding the comparison of two ratings.
I have two candidates, I asked them to rate themselves out of 10 in 4 different subjects. Both have the same level of knowledge in both subjects.
Student name Rating (Maths Physics Chemistry Biology)
A 10 10 10 10
B 7 7 7 7
(According to A he is giving 10/10 for his best skill, and B is giving 7/10 for his best skill.)
If I am comparing A and B in an absolute scale A is better than B. Is there a way or approach to detect them having the same skill? The only reference I have is the information in the table which is relative and I know they have the same skillset.
Please help me out,
Correct me if I am wrong.
Thanks and regards,
Sarin
statistics math-software number-comparison
asked Jan 25 at 8:30
SarinSarin
11
$endgroup$
$begingroup$
One important perspective for this, I think, is what those ratings are for, which generally helps to extract credible information. Since this is self-reporting, people's behavior should be based on, at least to some extent, their expectation on the outcome of their report. Also, other details like whether both candidates know the total number of candidates should have a bite.
$endgroup$
– user146512
Jan 25 at 8:37
$begingroup$
I agree with you. Some relative understanding about rating between candidates will help here. But still wondering how to fill the gap between these two details.
$endgroup$
– Sarin
Jan 25 at 9:28
add a comment |
$begingroup$
I have a small doubt regarding the comparison of two ratings.
I have two candidates, I asked them to rate themselves out of 10 in 4 different subjects. Both have the same level of knowledge in both subjects.
Student name Rating (Maths Physics Chemistry Biology)
A 10 10 10 10
B 7 7 7 7
(According to A he is giving 10/10 for his best skill, and B is giving 7/10 for his best skill.)
If I am comparing A and B in an absolute scale A is better than B. Is there a way or approach to detect them having the same skill? The only reference I have is the information in the table which is relative and I know they have the same skillset.
Please help me out,
Correct me if I am wrong.
Thanks and regards,
Sarin
statistics math-software number-comparison
asked Jan 25 at 8:30
SarinSarin
11
$endgroup$
I have a small doubt regarding the comparison of two ratings.
I have two candidates, I asked them to rate themselves out of 10 in 4 different subjects. Both have the same level of knowledge in both subjects.
Student name Rating (Maths Physics Chemistry Biology)
A 10 10 10 10
B 7 7 7 7
(According to A he is giving 10/10 for his best skill, and B is giving 7/10 for his best skill.)
If I am comparing A and B in an absolute scale A is better than B. Is there a way or approach to detect them having the same skill? The only reference I have is the information in the table which is relative and I know they have the same skillset.
Please help me out,
Correct me if I am wrong.
Thanks and regards,
Sarin
statistics math-software number-comparison
statistics math-software number-comparison
asked Jan 25 at 8:30
SarinSarin
11
asked Jan 25 at 8:30
SarinSarin
11
asked Jan 25 at 8:30
SarinSarin
11
asked Jan 25 at 8:30
SarinSarin
11
asked Jan 25 at 8:30
SarinSarin
11
11
$begingroup$
One important perspective for this, I think, is what those ratings are for, which generally helps to extract credible information. Since this is self-reporting, people's behavior should be based on, at least to some extent, their expectation on the outcome of their report. Also, other details like whether both candidates know the total number of candidates should have a bite.
$endgroup$
– user146512
Jan 25 at 8:37
$begingroup$
I agree with you. Some relative understanding about rating between candidates will help here. But still wondering how to fill the gap between these two details.
$endgroup$
– Sarin
Jan 25 at 9:28
add a comment |
$begingroup$
One important perspective for this, I think, is what those ratings are for, which generally helps to extract credible information. Since this is self-reporting, people's behavior should be based on, at least to some extent, their expectation on the outcome of their report. Also, other details like whether both candidates know the total number of candidates should have a bite.
$endgroup$
– user146512
Jan 25 at 8:37
$begingroup$
I agree with you. Some relative understanding about rating between candidates will help here. But still wondering how to fill the gap between these two details.
$endgroup$
– Sarin
Jan 25 at 9:28
$begingroup$
One important perspective for this, I think, is what those ratings are for, which generally helps to extract credible information. Since this is self-reporting, people's behavior should be based on, at least to some extent, their expectation on the outcome of their report. Also, other details like whether both candidates know the total number of candidates should have a bite.
$endgroup$
– user146512
Jan 25 at 8:37
$begingroup$
One important perspective for this, I think, is what those ratings are for, which generally helps to extract credible information. Since this is self-reporting, people's behavior should be based on, at least to some extent, their expectation on the outcome of their report. Also, other details like whether both candidates know the total number of candidates should have a bite.
$endgroup$
– user146512
Jan 25 at 8:37
$begingroup$
I agree with you. Some relative understanding about rating between candidates will help here. But still wondering how to fill the gap between these two details.
$endgroup$
– Sarin
Jan 25 at 9:28
$begingroup$
I agree with you. Some relative understanding about rating between candidates will help here. But still wondering how to fill the gap between these two details.
$endgroup$
– Sarin
Jan 25 at 9:28
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
With self-ratings? I don't see any realistic way to use them to compare between different students. There's some credibility in comparing how a student rated themself in different subjects, but across different students? You have no way of telling what standards they're using. Also, all sorts of social effects apply.
That said, student A is almost certainly lying. Whether he's lying to you to get attention, or lying to himself that he doesn't have more to learn, I wouldn't trust those ratings at all. (Why did I switch to gendered pronouns? See social effects above.) With just these numbers to work with, and no other information about the candidates, I would rather work with student B.
And all this? It's more social science than anything. The mathematics of it doesn't really come in until we have some actual credible data.
answered Jan 25 at 10:05
jmerryjmerry
14.9k1632
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3086872%2fcomparison-of-two-self-ratings%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
With self-ratings? I don't see any realistic way to use them to compare between different students. There's some credibility in comparing how a student rated themself in different subjects, but across different students? You have no way of telling what standards they're using. Also, all sorts of social effects apply.
That said, student A is almost certainly lying. Whether he's lying to you to get attention, or lying to himself that he doesn't have more to learn, I wouldn't trust those ratings at all. (Why did I switch to gendered pronouns? See social effects above.) With just these numbers to work with, and no other information about the candidates, I would rather work with student B.
And all this? It's more social science than anything. The mathematics of it doesn't really come in until we have some actual credible data.
answered Jan 25 at 10:05
jmerryjmerry
14.9k1632
$endgroup$
add a comment |
$begingroup$
With self-ratings? I don't see any realistic way to use them to compare between different students. There's some credibility in comparing how a student rated themself in different subjects, but across different students? You have no way of telling what standards they're using. Also, all sorts of social effects apply.
That said, student A is almost certainly lying. Whether he's lying to you to get attention, or lying to himself that he doesn't have more to learn, I wouldn't trust those ratings at all. (Why did I switch to gendered pronouns? See social effects above.) With just these numbers to work with, and no other information about the candidates, I would rather work with student B.
And all this? It's more social science than anything. The mathematics of it doesn't really come in until we have some actual credible data.
answered Jan 25 at 10:05
jmerryjmerry
14.9k1632
$endgroup$
add a comment |
$begingroup$
With self-ratings? I don't see any realistic way to use them to compare between different students. There's some credibility in comparing how a student rated themself in different subjects, but across different students? You have no way of telling what standards they're using. Also, all sorts of social effects apply.
That said, student A is almost certainly lying. Whether he's lying to you to get attention, or lying to himself that he doesn't have more to learn, I wouldn't trust those ratings at all. (Why did I switch to gendered pronouns? See social effects above.) With just these numbers to work with, and no other information about the candidates, I would rather work with student B.
And all this? It's more social science than anything. The mathematics of it doesn't really come in until we have some actual credible data.
answered Jan 25 at 10:05
jmerryjmerry
14.9k1632
$endgroup$
With self-ratings? I don't see any realistic way to use them to compare between different students. There's some credibility in comparing how a student rated themself in different subjects, but across different students? You have no way of telling what standards they're using. Also, all sorts of social effects apply.
That said, student A is almost certainly lying. Whether he's lying to you to get attention, or lying to himself that he doesn't have more to learn, I wouldn't trust those ratings at all. (Why did I switch to gendered pronouns? See social effects above.) With just these numbers to work with, and no other information about the candidates, I would rather work with student B.
And all this? It's more social science than anything. The mathematics of it doesn't really come in until we have some actual credible data.
answered Jan 25 at 10:05
jmerryjmerry
14.9k1632
answered Jan 25 at 10:05
jmerryjmerry
14.9k1632
answered Jan 25 at 10:05
jmerryjmerry
14.9k1632
answered Jan 25 at 10:05
jmerryjmerry
14.9k1632
14.9k1632
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3086872%2fcomparison-of-two-self-ratings%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
One important perspective for this, I think, is what those ratings are for, which generally helps to extract credible information. Since this is self-reporting, people's behavior should be based on, at least to some extent, their expectation on the outcome of their report. Also, other details like whether both candidates know the total number of candidates should have a bite.
$endgroup$
– user146512
Jan 25 at 8:37
$begingroup$
I agree with you. Some relative understanding about rating between candidates will help here. But still wondering how to fill the gap between these two details.
$endgroup$
– Sarin
Jan 25 at 9:28