What is the default smartirs for gensim TfidfModel?
Using gensim
:
from gensim.models import TfidfModel
from gensim.corpora import Dictionary
sent0 = "The quick brown fox jumps over the lazy brown dog .".lower().split()
sent1 = "Mr brown jumps over the lazy fox .".lower().split()
dataset = [sent0, sent1]
vocab = Dictionary(dataset)
corpus = [vocab.doc2bow(sent) for sent in dataset]
model = TfidfModel(corpus)
# To retrieve the same pd.DataFrame format.
documents_tfidf_lol = [{vocab[word_idx]:tfidf_value for word_idx, tfidf_value in sent} for sent in model[corpus]]
documents_tfidf = pd.DataFrame(documents_tfidf_lol)
documents_tfidf.fillna(0, inplace=True)
documents_tfidf
[out]:
dog mr quick
0 0.707107 0.0 0.707107
1 0.000000 1.0 0.000000
If we do the TF-IDF computation manually,
sent0 = "The quick brown fox jumps over the lazy brown dog .".lower().split()
sent1 = "Mr brown jumps over the lazy fox .".lower().split()
documents = pd.DataFrame.from_dict(list(map(Counter, [sent0, sent1])))
documents.fillna(0, inplace=True, downcast='infer')
documents = documents.apply(lambda x: x/sum(x)) # Normalize the TF.
documents.head()
# To compute the IDF for all words.
num_sentences, num_words = documents.shape
idf_vector = # Lets save an ordered list of IDFS w.r.t. order of the column names.
for word in documents:
word_idf = math.log(num_sentences/len(documents[word].nonzero()[0]))
idf_vector.append(word_idf)
# Compute the TF-IDF table.
documents_tfidf = pd.DataFrame(documents.as_matrix() * np.array(idf_vector),
columns=list(documents))
documents_tfidf
[out]:
. brown dog fox jumps lazy mr over quick the
0 0.0 0.0 0.693147 0.0 0.0 0.0 0.000000 0.0 0.693147 0.0
1 0.0 0.0 0.000000 0.0 0.0 0.0 0.693147 0.0 0.000000 0.0
If we use math.log2
instead of math.log
:
. brown dog fox jumps lazy mr over quick the
0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0
1 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0
It looks like gensim
:
- remove the non-salient words from the TF-IDF model, it's evident when we
print(model[corpus])
- maybe the log base seem to be different from the log_2
- maybe there's some normalization going on.
Looking at https://radimrehurek.com/gensim/models/tfidfmodel.html#gensim.models.tfidfmodel.TfidfModel , the smart
scheme difference would have output different values but it's not clear in the docs what is the default value.
What is the default smartirs for gensim TfidfModel?
What are the other default parameters that've caused the difference between a natively implemented TF-IDF and gensim's?
python nlp gensim information-retrieval tf-idf
add a comment |
Using gensim
:
from gensim.models import TfidfModel
from gensim.corpora import Dictionary
sent0 = "The quick brown fox jumps over the lazy brown dog .".lower().split()
sent1 = "Mr brown jumps over the lazy fox .".lower().split()
dataset = [sent0, sent1]
vocab = Dictionary(dataset)
corpus = [vocab.doc2bow(sent) for sent in dataset]
model = TfidfModel(corpus)
# To retrieve the same pd.DataFrame format.
documents_tfidf_lol = [{vocab[word_idx]:tfidf_value for word_idx, tfidf_value in sent} for sent in model[corpus]]
documents_tfidf = pd.DataFrame(documents_tfidf_lol)
documents_tfidf.fillna(0, inplace=True)
documents_tfidf
[out]:
dog mr quick
0 0.707107 0.0 0.707107
1 0.000000 1.0 0.000000
If we do the TF-IDF computation manually,
sent0 = "The quick brown fox jumps over the lazy brown dog .".lower().split()
sent1 = "Mr brown jumps over the lazy fox .".lower().split()
documents = pd.DataFrame.from_dict(list(map(Counter, [sent0, sent1])))
documents.fillna(0, inplace=True, downcast='infer')
documents = documents.apply(lambda x: x/sum(x)) # Normalize the TF.
documents.head()
# To compute the IDF for all words.
num_sentences, num_words = documents.shape
idf_vector = # Lets save an ordered list of IDFS w.r.t. order of the column names.
for word in documents:
word_idf = math.log(num_sentences/len(documents[word].nonzero()[0]))
idf_vector.append(word_idf)
# Compute the TF-IDF table.
documents_tfidf = pd.DataFrame(documents.as_matrix() * np.array(idf_vector),
columns=list(documents))
documents_tfidf
[out]:
. brown dog fox jumps lazy mr over quick the
0 0.0 0.0 0.693147 0.0 0.0 0.0 0.000000 0.0 0.693147 0.0
1 0.0 0.0 0.000000 0.0 0.0 0.0 0.693147 0.0 0.000000 0.0
If we use math.log2
instead of math.log
:
. brown dog fox jumps lazy mr over quick the
0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0
1 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0
It looks like gensim
:
- remove the non-salient words from the TF-IDF model, it's evident when we
print(model[corpus])
- maybe the log base seem to be different from the log_2
- maybe there's some normalization going on.
Looking at https://radimrehurek.com/gensim/models/tfidfmodel.html#gensim.models.tfidfmodel.TfidfModel , the smart
scheme difference would have output different values but it's not clear in the docs what is the default value.
What is the default smartirs for gensim TfidfModel?
What are the other default parameters that've caused the difference between a natively implemented TF-IDF and gensim's?
python nlp gensim information-retrieval tf-idf
add a comment |
Using gensim
:
from gensim.models import TfidfModel
from gensim.corpora import Dictionary
sent0 = "The quick brown fox jumps over the lazy brown dog .".lower().split()
sent1 = "Mr brown jumps over the lazy fox .".lower().split()
dataset = [sent0, sent1]
vocab = Dictionary(dataset)
corpus = [vocab.doc2bow(sent) for sent in dataset]
model = TfidfModel(corpus)
# To retrieve the same pd.DataFrame format.
documents_tfidf_lol = [{vocab[word_idx]:tfidf_value for word_idx, tfidf_value in sent} for sent in model[corpus]]
documents_tfidf = pd.DataFrame(documents_tfidf_lol)
documents_tfidf.fillna(0, inplace=True)
documents_tfidf
[out]:
dog mr quick
0 0.707107 0.0 0.707107
1 0.000000 1.0 0.000000
If we do the TF-IDF computation manually,
sent0 = "The quick brown fox jumps over the lazy brown dog .".lower().split()
sent1 = "Mr brown jumps over the lazy fox .".lower().split()
documents = pd.DataFrame.from_dict(list(map(Counter, [sent0, sent1])))
documents.fillna(0, inplace=True, downcast='infer')
documents = documents.apply(lambda x: x/sum(x)) # Normalize the TF.
documents.head()
# To compute the IDF for all words.
num_sentences, num_words = documents.shape
idf_vector = # Lets save an ordered list of IDFS w.r.t. order of the column names.
for word in documents:
word_idf = math.log(num_sentences/len(documents[word].nonzero()[0]))
idf_vector.append(word_idf)
# Compute the TF-IDF table.
documents_tfidf = pd.DataFrame(documents.as_matrix() * np.array(idf_vector),
columns=list(documents))
documents_tfidf
[out]:
. brown dog fox jumps lazy mr over quick the
0 0.0 0.0 0.693147 0.0 0.0 0.0 0.000000 0.0 0.693147 0.0
1 0.0 0.0 0.000000 0.0 0.0 0.0 0.693147 0.0 0.000000 0.0
If we use math.log2
instead of math.log
:
. brown dog fox jumps lazy mr over quick the
0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0
1 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0
It looks like gensim
:
- remove the non-salient words from the TF-IDF model, it's evident when we
print(model[corpus])
- maybe the log base seem to be different from the log_2
- maybe there's some normalization going on.
Looking at https://radimrehurek.com/gensim/models/tfidfmodel.html#gensim.models.tfidfmodel.TfidfModel , the smart
scheme difference would have output different values but it's not clear in the docs what is the default value.
What is the default smartirs for gensim TfidfModel?
What are the other default parameters that've caused the difference between a natively implemented TF-IDF and gensim's?
python nlp gensim information-retrieval tf-idf
Using gensim
:
from gensim.models import TfidfModel
from gensim.corpora import Dictionary
sent0 = "The quick brown fox jumps over the lazy brown dog .".lower().split()
sent1 = "Mr brown jumps over the lazy fox .".lower().split()
dataset = [sent0, sent1]
vocab = Dictionary(dataset)
corpus = [vocab.doc2bow(sent) for sent in dataset]
model = TfidfModel(corpus)
# To retrieve the same pd.DataFrame format.
documents_tfidf_lol = [{vocab[word_idx]:tfidf_value for word_idx, tfidf_value in sent} for sent in model[corpus]]
documents_tfidf = pd.DataFrame(documents_tfidf_lol)
documents_tfidf.fillna(0, inplace=True)
documents_tfidf
[out]:
dog mr quick
0 0.707107 0.0 0.707107
1 0.000000 1.0 0.000000
If we do the TF-IDF computation manually,
sent0 = "The quick brown fox jumps over the lazy brown dog .".lower().split()
sent1 = "Mr brown jumps over the lazy fox .".lower().split()
documents = pd.DataFrame.from_dict(list(map(Counter, [sent0, sent1])))
documents.fillna(0, inplace=True, downcast='infer')
documents = documents.apply(lambda x: x/sum(x)) # Normalize the TF.
documents.head()
# To compute the IDF for all words.
num_sentences, num_words = documents.shape
idf_vector = # Lets save an ordered list of IDFS w.r.t. order of the column names.
for word in documents:
word_idf = math.log(num_sentences/len(documents[word].nonzero()[0]))
idf_vector.append(word_idf)
# Compute the TF-IDF table.
documents_tfidf = pd.DataFrame(documents.as_matrix() * np.array(idf_vector),
columns=list(documents))
documents_tfidf
[out]:
. brown dog fox jumps lazy mr over quick the
0 0.0 0.0 0.693147 0.0 0.0 0.0 0.000000 0.0 0.693147 0.0
1 0.0 0.0 0.000000 0.0 0.0 0.0 0.693147 0.0 0.000000 0.0
If we use math.log2
instead of math.log
:
. brown dog fox jumps lazy mr over quick the
0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0
1 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0
It looks like gensim
:
- remove the non-salient words from the TF-IDF model, it's evident when we
print(model[corpus])
- maybe the log base seem to be different from the log_2
- maybe there's some normalization going on.
Looking at https://radimrehurek.com/gensim/models/tfidfmodel.html#gensim.models.tfidfmodel.TfidfModel , the smart
scheme difference would have output different values but it's not clear in the docs what is the default value.
What is the default smartirs for gensim TfidfModel?
What are the other default parameters that've caused the difference between a natively implemented TF-IDF and gensim's?
python nlp gensim information-retrieval tf-idf
python nlp gensim information-retrieval tf-idf
edited May 30 '18 at 7:04
alvas
asked May 30 '18 at 6:54
alvasalvas
45.8k64248467
45.8k64248467
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
The default value of smartirs
is None, but if you follow the code, it is equal to ntc.
But how?
First, when you call model = TfidfModel(corpus)
, it calculates IDF of the corpus with a function called wglobal
which explained in docs as:
wglobal
is function for global weighting, the default value is df2idf()
. df2idf
is a function that computes IDF for a term with the given document frequency. The default arguman and formula for df2idf
is:
df2idf(docfreq, totaldocs, log_base=2.0, add=0.0)
which implemented as:
idfs = add + np.log(float(totaldocs) / docfreq) / np.log(log_base)
One of the smartirs is determined: document frequency weighting is inverse-document-frequency or idf
.
wlocals
by default is identity
function. Term frequency of the corpus passed through the identify function which nothing happened, and the corpus itself return. Hence, another parameter of smartirs, term frequency weighing, is natural or n
. Now that we have term frequency and inverse-document-frequency we can compute tfidf:
normalize
by default is true that means after computing TfIDF it normalizes the tfidf vectors. The normalization is done with l2-norm
(Euclidean unit norm) which means our last smartirs is cosine or c
. This part implemented as:
# vec(term_id, value) is tfidf result
length = 1.0 * math.sqrt(sum(val ** 2 for _, val in vec))
normalize_by_length = [(termid, val / length) for termid, val in vec]
When you call model[corpus]
or model.__getitem__()
the following things happen:
__getitem__
has a eps
argument which is a threshold value that will remove all entries that have tfidf-value less than eps
. By default, this value is 1e-12. As a result, when you print the vectors only some of them appeared.
Argh... Forgot to assign the bounty... Thanks for the detailed explanation. I'll redo a bounty and assign you the points =)
– alvas
Jan 4 at 5:36
Never mind :D I hope it helps.
– Amir
Jan 4 at 5:44
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f50598129%2fwhat-is-the-default-smartirs-for-gensim-tfidfmodel%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
The default value of smartirs
is None, but if you follow the code, it is equal to ntc.
But how?
First, when you call model = TfidfModel(corpus)
, it calculates IDF of the corpus with a function called wglobal
which explained in docs as:
wglobal
is function for global weighting, the default value is df2idf()
. df2idf
is a function that computes IDF for a term with the given document frequency. The default arguman and formula for df2idf
is:
df2idf(docfreq, totaldocs, log_base=2.0, add=0.0)
which implemented as:
idfs = add + np.log(float(totaldocs) / docfreq) / np.log(log_base)
One of the smartirs is determined: document frequency weighting is inverse-document-frequency or idf
.
wlocals
by default is identity
function. Term frequency of the corpus passed through the identify function which nothing happened, and the corpus itself return. Hence, another parameter of smartirs, term frequency weighing, is natural or n
. Now that we have term frequency and inverse-document-frequency we can compute tfidf:
normalize
by default is true that means after computing TfIDF it normalizes the tfidf vectors. The normalization is done with l2-norm
(Euclidean unit norm) which means our last smartirs is cosine or c
. This part implemented as:
# vec(term_id, value) is tfidf result
length = 1.0 * math.sqrt(sum(val ** 2 for _, val in vec))
normalize_by_length = [(termid, val / length) for termid, val in vec]
When you call model[corpus]
or model.__getitem__()
the following things happen:
__getitem__
has a eps
argument which is a threshold value that will remove all entries that have tfidf-value less than eps
. By default, this value is 1e-12. As a result, when you print the vectors only some of them appeared.
Argh... Forgot to assign the bounty... Thanks for the detailed explanation. I'll redo a bounty and assign you the points =)
– alvas
Jan 4 at 5:36
Never mind :D I hope it helps.
– Amir
Jan 4 at 5:44
add a comment |
The default value of smartirs
is None, but if you follow the code, it is equal to ntc.
But how?
First, when you call model = TfidfModel(corpus)
, it calculates IDF of the corpus with a function called wglobal
which explained in docs as:
wglobal
is function for global weighting, the default value is df2idf()
. df2idf
is a function that computes IDF for a term with the given document frequency. The default arguman and formula for df2idf
is:
df2idf(docfreq, totaldocs, log_base=2.0, add=0.0)
which implemented as:
idfs = add + np.log(float(totaldocs) / docfreq) / np.log(log_base)
One of the smartirs is determined: document frequency weighting is inverse-document-frequency or idf
.
wlocals
by default is identity
function. Term frequency of the corpus passed through the identify function which nothing happened, and the corpus itself return. Hence, another parameter of smartirs, term frequency weighing, is natural or n
. Now that we have term frequency and inverse-document-frequency we can compute tfidf:
normalize
by default is true that means after computing TfIDF it normalizes the tfidf vectors. The normalization is done with l2-norm
(Euclidean unit norm) which means our last smartirs is cosine or c
. This part implemented as:
# vec(term_id, value) is tfidf result
length = 1.0 * math.sqrt(sum(val ** 2 for _, val in vec))
normalize_by_length = [(termid, val / length) for termid, val in vec]
When you call model[corpus]
or model.__getitem__()
the following things happen:
__getitem__
has a eps
argument which is a threshold value that will remove all entries that have tfidf-value less than eps
. By default, this value is 1e-12. As a result, when you print the vectors only some of them appeared.
Argh... Forgot to assign the bounty... Thanks for the detailed explanation. I'll redo a bounty and assign you the points =)
– alvas
Jan 4 at 5:36
Never mind :D I hope it helps.
– Amir
Jan 4 at 5:44
add a comment |
The default value of smartirs
is None, but if you follow the code, it is equal to ntc.
But how?
First, when you call model = TfidfModel(corpus)
, it calculates IDF of the corpus with a function called wglobal
which explained in docs as:
wglobal
is function for global weighting, the default value is df2idf()
. df2idf
is a function that computes IDF for a term with the given document frequency. The default arguman and formula for df2idf
is:
df2idf(docfreq, totaldocs, log_base=2.0, add=0.0)
which implemented as:
idfs = add + np.log(float(totaldocs) / docfreq) / np.log(log_base)
One of the smartirs is determined: document frequency weighting is inverse-document-frequency or idf
.
wlocals
by default is identity
function. Term frequency of the corpus passed through the identify function which nothing happened, and the corpus itself return. Hence, another parameter of smartirs, term frequency weighing, is natural or n
. Now that we have term frequency and inverse-document-frequency we can compute tfidf:
normalize
by default is true that means after computing TfIDF it normalizes the tfidf vectors. The normalization is done with l2-norm
(Euclidean unit norm) which means our last smartirs is cosine or c
. This part implemented as:
# vec(term_id, value) is tfidf result
length = 1.0 * math.sqrt(sum(val ** 2 for _, val in vec))
normalize_by_length = [(termid, val / length) for termid, val in vec]
When you call model[corpus]
or model.__getitem__()
the following things happen:
__getitem__
has a eps
argument which is a threshold value that will remove all entries that have tfidf-value less than eps
. By default, this value is 1e-12. As a result, when you print the vectors only some of them appeared.
The default value of smartirs
is None, but if you follow the code, it is equal to ntc.
But how?
First, when you call model = TfidfModel(corpus)
, it calculates IDF of the corpus with a function called wglobal
which explained in docs as:
wglobal
is function for global weighting, the default value is df2idf()
. df2idf
is a function that computes IDF for a term with the given document frequency. The default arguman and formula for df2idf
is:
df2idf(docfreq, totaldocs, log_base=2.0, add=0.0)
which implemented as:
idfs = add + np.log(float(totaldocs) / docfreq) / np.log(log_base)
One of the smartirs is determined: document frequency weighting is inverse-document-frequency or idf
.
wlocals
by default is identity
function. Term frequency of the corpus passed through the identify function which nothing happened, and the corpus itself return. Hence, another parameter of smartirs, term frequency weighing, is natural or n
. Now that we have term frequency and inverse-document-frequency we can compute tfidf:
normalize
by default is true that means after computing TfIDF it normalizes the tfidf vectors. The normalization is done with l2-norm
(Euclidean unit norm) which means our last smartirs is cosine or c
. This part implemented as:
# vec(term_id, value) is tfidf result
length = 1.0 * math.sqrt(sum(val ** 2 for _, val in vec))
normalize_by_length = [(termid, val / length) for termid, val in vec]
When you call model[corpus]
or model.__getitem__()
the following things happen:
__getitem__
has a eps
argument which is a threshold value that will remove all entries that have tfidf-value less than eps
. By default, this value is 1e-12. As a result, when you print the vectors only some of them appeared.
edited Jan 2 at 11:35
answered Jan 1 at 21:44


AmirAmir
7,92274174
7,92274174
Argh... Forgot to assign the bounty... Thanks for the detailed explanation. I'll redo a bounty and assign you the points =)
– alvas
Jan 4 at 5:36
Never mind :D I hope it helps.
– Amir
Jan 4 at 5:44
add a comment |
Argh... Forgot to assign the bounty... Thanks for the detailed explanation. I'll redo a bounty and assign you the points =)
– alvas
Jan 4 at 5:36
Never mind :D I hope it helps.
– Amir
Jan 4 at 5:44
Argh... Forgot to assign the bounty... Thanks for the detailed explanation. I'll redo a bounty and assign you the points =)
– alvas
Jan 4 at 5:36
Argh... Forgot to assign the bounty... Thanks for the detailed explanation. I'll redo a bounty and assign you the points =)
– alvas
Jan 4 at 5:36
Never mind :D I hope it helps.
– Amir
Jan 4 at 5:44
Never mind :D I hope it helps.
– Amir
Jan 4 at 5:44
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f50598129%2fwhat-is-the-default-smartirs-for-gensim-tfidfmodel%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown