MauryaHub PYQ Practice

Large Language Models · Quiz 2 · Jan 2025

Large Language Models · Quiz 2 · Jan 2025

← Course papers · Start practice / exam

Questions and published explanations below are available without starting a test. Some questions may not have a published solution yet.

0 / 19 published solutions

Question 118 MCQ · 0.0 marks

General Note: • If you find the given information is insufficient in any of the Numerical Answer Type (NAT) questions, enter -1 as the answer. • In all your calculations, take at least two digits. For example, if the intermediate result is 1.860875, then take it as 1.86 to the next step.
6406533952671.
Instructions has been mentioned above.
6406533952672.
This Instructions is just for a reference & not for an evaluation.

A published solution is not available for this question yet.

Report a correction for Q118

Question 119 MCQ · 2.0 marks

Consider following assertion and reason pair: **Assertion:** A small vocabulary is desirable, as it reduces the size of the embedding matrix. **Reason:** Decreasing the size of the vocabulary increases the number of tokens in the input.
6406533952673.
Assertion and Reason are both true and Reason is a correct explanation of Assertion.
6406533952674.
Assertion and Reason are both true and Reason is not a correct explanation of Assertion.
6406533952675.
Assertion is true but Reason is false.
6406533952676.
Assertion is false but Reason is true.

A published solution is not available for this question yet.

Report a correction for Q119

Question 120 MCQ · 2.0 marks

Consider following statement and mark if it is true or false: Repeating examples in the pre-training datasets are completely harmless for downstream performance.
6406533952680.
TRUE
6406533952681.
FALSE

A published solution is not available for this question yet.

Report a correction for Q120

Question 121 MCQ · 3.0 marks

What is the order of the language modeling pipeline?
6406533952677.
First, the model, which handles text and returns raw predictions. The tokenizer then makes sense of these predictions and converts them back to text when needed.
6406533952678.
First, the tokenizer, which handles text and returns IDs. The model handles these IDs and outputs a prediction, which can be some text.
6406533952679.
The tokenizer handles text and returns IDs. The model handles these IDs and outputs a prediction. The tokenizer can then be used once again to convert these predictions back to some text.

A published solution is not available for this question yet.

Report a correction for Q121

Question 122 MSQ · 3.0 marks

Consider fine-tuning the T5 model on a sentiment classification task. The T5 model was pre- trained using the C4 dataset. Suppose, in the original dataset, the positive samples are denoted by integer 2, neutral samples are denoted by integer 1 and the negative samples are denoted by integer 0. Choose the necessary modifications that one needs to perform to use the T5 model for fine-tuning:
6406533952682.
Map the label 0 to “negative” and 1 to “positive” in the dataset
6406533952683.
Map the label 0 to “negative”, 1 to “neutral” and 2 to “positive” in the dataset
6406533952684.
Map the label 0 to “0”, 1 to “1” and 2 to “2” in the dataset
6406533952685.
Update the vocabulary of T5 with the modified labels
6406533952686.
Add at least one linear layer on top of the decoder for final classification
6406533952687.
None of these.

A published solution is not available for this question yet.

Report a correction for Q122

Question 123 MSQ · 3.0 marks

Source diagram or notation
6406533952688.
[a] your mind [b] ask for brief replies [c] demonstrate the format [d] less the model has to guess [e]
6406533952689.
[a] your mind [b] ask for brief replies [c] demonstrate the format [d] less the model has to guess
6406533952690.
[v] your mind [w] ask for brief replies [x] demonstrate the format [y] less the model has to guess
6406533952691.
[v] your mind [w] ask for brief replies [x] demonstrate the format [y] less the model has to guess [z]
6406533952692.
[a] your mind [b] demonstrate the format [c] ask for brief replies [d] less the model has to guess
6406533952693.
None of these

A published solution is not available for this question yet.

Report a correction for Q123

Question 124 MSQ · 3.0 marks

Suppose the T5 base model has to be fine tuned with gradual unfreezing. First layer of the encoder takes the input in appropriate format. Gradual unfreezing is divided in 12 (i.e. no. of layers) phases. Choose the correct statements:
6406533952694.
In the first phase, weights of only the last layer of encoder and decoder (both) are unfrozen.
6406533952695.
In the first phase, weights of only the last layer of decoder only are unfrozen.
6406533952696.
In the first phase, weights of only the last layer of encoder only are unfrozen.
6406533952697.
In the second phase, weights of only the second last layer of encoder and decoder (both) are unfrozen.
6406533952698.
In the second phase, weights of the last two layers of encoder and decoder (both) are unfrozen.
6406533952699.
In the first phase, weights of only the first layer of encoder and decoder (both) are unfrozen.

A published solution is not available for this question yet.

Report a correction for Q124

Question 125 MSQ · 3.0 marks

Which of the following models uses a form of denoising objective for pre-training?
6406533952700.
BERT
6406533952701.
GPT 3
6406533952702.
BART
6406533952703.
T5

A published solution is not available for this question yet.

Report a correction for Q125

Question 126 MSQ · 3.0 marks

Consider the C4 pipeline. Which of the following will NOT pass through it as it is?
6406533952704.Source diagram or notation
6406533952705.Source diagram or notation
6406533952706.Source diagram or notation
6406533952707.Source diagram or notation
6406533952708.Source diagram or notation
6406533952709.Source diagram or notation
6406533952710.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q126

Question 127 MSQ · 3.0 marks

Which of the following are correct about GPT-3 model with 175B parameters:
6406533952711.
It is an encoder-decoder only model.
6406533952712.
It uses absolute postional encoding.
6406533952713.
It uses a composite dataset for pre-training.
6406533952714.
None of these.

A published solution is not available for this question yet.

Report a correction for Q127

Question 128 NAT · 4.0 marks

Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q128

Question 129 NAT · 3.0 marks

Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q129

Question 130 NAT · 2.0 marks

Source diagram or notation
How many tokens are there in the initial vocabulary?

A published solution is not available for this question yet.

Report a correction for Q130

Question 131 MCQ · 3.0 marks

Source diagram or notation
Which of the following pairs has the highest frequency before any merge?
6406533952718.
(‘u’, ‘g’)
6406533952719.
(‘a’, ‘u’)
6406533952720.
(‘g’, ‘h’)
6406533952721.
(‘h’, ‘t’)
6406533952722.
(‘w’, ‘e’)
6406533952723.
None of these.

A published solution is not available for this question yet.

Report a correction for Q131

Question 132 NAT · 2.0 marks

Source diagram or notation
What is the frequency of the pair merged in the very first merge?

A published solution is not available for this question yet.

Report a correction for Q132

Question 133 NAT · 3.0 marks

Source diagram or notation
What is the minimum number of merges, after which there is a token with exactly 3 English letters?

A published solution is not available for this question yet.

Report a correction for Q133

Question 134 SHORT_TEXT · 3.0 marks

Source diagram or notation
Which pair will be merged in the third merge? Say the pair is (‘ab’,‘c’), then enter **“abc”** (without quotes and white spaces). If there is a tie between two or more candidates, pick the one that occurs first in the original vocabulary. **NOTE:** Enter the exact answer without any extra space in the beginning or at the end.

A published solution is not available for this question yet.

Report a correction for Q134

Question 135 NAT · 2.0 marks

Source diagram or notation
Assume that the process is stopped after 4 merges. How many tokens from the initial vocabulary will have their frequency revised/reduced to 0?

A published solution is not available for this question yet.

Report a correction for Q135

Question 136 MCQ · 3.0 marks

Source diagram or notationSource diagram or notation
6406533952728.Source diagram or notation
6406533952729.Source diagram or notation
6406533952730.Source diagram or notation
6406533952731.Source diagram or notation
6406533952732.Source diagram or notation
6406533952733.Source diagram or notation
      **i-NLP** **Section Id :** 64065382587 **Section Number :** 8 **Section type :** Online **Mandatory or Optional :** Mandatory **Number of Questions :** 19 **Number of Questions to be attempted :** 19

A published solution is not available for this question yet.

Report a correction for Q136