MauryaHub PYQ Practice

Large Language Models · End Term · Sep 2024 · FN

Large Language Models · End Term · Sep 2024 FN

← Course papers · Start practice / exam

Questions and published explanations below are available without starting a test. Some questions may not have a published solution yet.

0 / 22 published solutions

Question 188 MCQ · 0.0 marks

General Note: • If you find the given information is insufficient in any of the Numerical Answer Type (NAT) questions, enter -1 as the answer. • In all your calculations, take at least two digits. For example, if the intermediate result is 1.860875, then take it as 1.86 to the next step.
6406533516328.
Instructions has been mentioned above.
6406533516329.
This Instructions is just for a reference & not for an evaluation.

A published solution is not available for this question yet.

Report a correction for Q188

Question 189 NAT · 3.0 marks

Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q189

Question 190 MSQ · 2.0 marks

Choose the correct statements regarding an encoder-decoder transformer model:
6406533516331.
A self attention block makes use of a mask matrix.
6406533516332.
Multi head self attention block is part of the encoder.
6406533516333.
Teacher forcing can help speed up the training process for tasks such as machine translation.
6406533516334.
None of these.

A published solution is not available for this question yet.

Report a correction for Q190

Question 191 MSQ · 2.0 marks

Consider the following statements about increasing the size of the vocabulary
6406533516344.
It reduces number of tokens required to represent a sentence
6406533516345.
It Increases the computational complexity as embedding matrix size increases
6406533516346.
It increases the context length T
6406533516347.
None of these

A published solution is not available for this question yet.

Report a correction for Q191

Question 192 MSQ · 2.0 marks

Consider the C4 pipeline. Which of the following will NOT pass through it as it is?
6406533516369.Source diagram or notation
6406533516370.Source diagram or notation
6406533516371.Source diagram or notation
6406533516372.Source diagram or notation
6406533516373.Source diagram or notation
6406533516374.Source diagram or notation
6406533516375.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q192

Question 193 MSQ · 2.0 marks

Which of the following are correct about GPT-3 model with 175B parameters:
6406533516376.
It is an encoder-decoder only model.
6406533516377.
It uses absolute postional encoding.
6406533516378.
It uses a composite dataset for pre-training.
6406533516379.
None of these.

A published solution is not available for this question yet.

Report a correction for Q193

Question 194 MSQ · 3.0 marks

Choose all the correct statements about the GPT model:
6406533516335.
All the parameters of are randomly initialized during pre-training
6406533516336.
The model minimizes the CLM objective during fine-tuning for downstream tasks like sentiment classification to improve the performance
6406533516337.
All parameters are randomly initialized during fine-tuning
6406533516338.
In general, fine-tuning requires a dataset with labels
6406533516339.
None of these

A published solution is not available for this question yet.

Report a correction for Q194

Question 195 MSQ · 3.0 marks

Consider fine-tuning the T5 model on a sentiment classification task. The T5 model was pre- trained using the C4 dataset. Suppose, in the original dataset, the positive samples are denoted by integer 1 and the negative samples are denoted by integer 0. Choose the necessary modifications that one needs to perform to use the T5 model for fine-tuning:
6406533516361.
Map the label 0 to “negative” and 1 to “positive” in the dataset
6406533516362.
Map the label 0 to “0” and 1 to “1” in the dataset
6406533516363.
Update the vocabulary of T5 with the modified labels
6406533516364.
Add at least one linear layer on top of the decoder for final classification

A published solution is not available for this question yet.

Report a correction for Q195

Question 196 MCQ · 3.0 marks

Suppose we use a pre-trained model for text generation with the given prompt “I am going to”. Which of the following decoding strategies can be used such that the pre-trained model generates different text completion each time it is executed
6406533516340.Source diagram or notation
6406533516341.Source diagram or notation
6406533516342.Source diagram or notation
6406533516343.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q196

Question 197 MCQ · 2.0 marks

What is the order of the language modeling pipeline?
6406533516365.
First, the model, which handles text and returns raw predictions. The tokenizer then makes sense of these predictions and converts them back to text when needed.
6406533516366.
First, the tokenizer, which handles text and returns IDs. The model handles these IDs and outputs a prediction, which can be some text.
6406533516367.
The tokenizer handles text and returns IDs. The model handles these IDs and outputs a prediction. The tokenizer can then be used once again to convert these predictions back to some text.
6406533516368.
None of these

A published solution is not available for this question yet.

Report a correction for Q197

Question 198 MCQ · 2.0 marks

Consider following statment and mark true or false: Repeating examples in the pre-training datasets are completely harmless for downstream performance.
6406533516380.
TRUE
6406533516381.
FALSE

A published solution is not available for this question yet.

Report a correction for Q198

Question 199 MCQ · 2.0 marks

What is the time complexity of the computing attention score matrix A with a batch size of one? The symbols have usual meaning.
6406533516382.Source diagram or notation
6406533516383.Source diagram or notation
6406533516384.Source diagram or notation
6406533516385.Source diagram or notation
6406533516386.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q199

Question 200 MCQ · 2.0 marks

Source diagram or notation
6406533516390.Source diagram or notation
6406533516391.Source diagram or notation
6406533516392.Source diagram or notation
6406533516393.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q200

Question 201 MCQ · 2.0 marks

Source diagram or notation
6406533516394.Source diagram or notation
6406533516395.Source diagram or notation
6406533516396.Source diagram or notation
6406533516397.Source diagram or notation
6406533516398.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q201

Question 202 NAT · 2.0 marks

Source diagram or notation
How many tokens are there in the initial vocabulary?

A published solution is not available for this question yet.

Report a correction for Q202

Question 203 MCQ · 3.0 marks

Source diagram or notation
Which of the following pairs has the least score before any merge?
6406533516349.Source diagram or notation
6406533516350.Source diagram or notation
6406533516351.Source diagram or notation
6406533516352.Source diagram or notation
6406533516353.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q203

Question 204 SHORT_TEXT · 3.0 marks

Source diagram or notation
Which pair will be merged the very first merge? Say the pair is (‘a’,‘b’), then enter **“ab”** (without quotes and white spaces). If there is a tie between two or more candidates, enter the one that occurs first in the original vocabulary. **NOTE:** Enter the exact answer without any space in the beginning or at the end.

A published solution is not available for this question yet.

Report a correction for Q204

Question 205 NAT · 3.0 marks

Source diagram or notation
What is the score of the pair merged in the very first merge?

A published solution is not available for this question yet.

Report a correction for Q205

Question 206 MCQ · 3.0 marks

Source diagram or notationSource diagram or notation
6406533516356.Source diagram or notation
6406533516357.Source diagram or notation
6406533516358.Source diagram or notation
6406533516359.Source diagram or notation
6406533516360.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q206

Question 207 NAT · 2.0 marks

Source diagram or notation
How many non zero entries will be there in the mask matrix M?

A published solution is not available for this question yet.

Report a correction for Q207

Question 208 NAT · 2.0 marks

Source diagram or notation
What will be the value of following expression? M [0, 0] + M [9, 7] + M [4, 20] + M [18, 31]

A published solution is not available for this question yet.

Report a correction for Q208

Question 209 NAT · 2.0 marks

Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q209