MauryaHub PYQ Practice

Large Language Models · Quiz 1 · May 2025

Large Language Models · Quiz 1 · May 2025

← Course papers · Start practice / exam

Questions and published explanations below are available without starting a test. Some questions may not have a published solution yet.

0 / 22 published solutions

Question 133 MCQ · 2.0 marks

We continue the notation from the previous question. Suppose the randomly assigned weights lead to the good event, that is, there is an unique perfect matching in G with minimum weight, and say this minimum weight is r. What can you say about the determinant of Z in this case?
6406534313776.Source diagram or notation
6406534313777.Source diagram or notation
6406534313778.Source diagram or notation
6406534313779.Source diagram or notation
      **LLM** **Section Id :** 64065391701 **Section Number :** 8 **Section type :** Online **Mandatory or Optional :** Mandatory **Number of Questions :** 16 **Number of Questions to be attempted :** 16 **Section Marks :** 50 **Display Number Panel :** Yes **Section Negative Marks :** 0 **Group All Questions :** No **Enable Mark as Answered Mark for Review and** No **Clear Response :** **Section Maximum Duration :** 0 **Section Minimum Duration :** 0 **Section Time In :** Minutes **Maximum Instruction Time :** 0

A published solution is not available for this question yet.

Report a correction for Q133

Question 135 MCQ · 2.0 marks

Transformers process input tokens:
6406534313782.
One at a time (sequentially)
6406534313783.
In reverse order
6406534313784.
All at once (in parallel)
6406534313785.
Only after seeing the full input

A published solution is not available for this question yet.

Report a correction for Q135

Question 136 MCQ · 2.0 marks

What is the purpose of the softmax function in the attention mechanism?
6406534313786.
Normalize attention scores to a probability distribution
6406534313787.
Add non-linearity to the model
6406534313788.
To predict the correct class for the loss function
6406534313789.
Remove redundant features from the input

A published solution is not available for this question yet.

Report a correction for Q136

Question 137 MCQ · 2.0 marks

What is the main difference between GPT and BERT pre-training objectives?
6406534313790.
GPT uses Masked Language Modeling, BERT uses Causal Language Modeling
6406534313791.
GPT uses Causal Language Modeling, BERT uses Masked Language Modeling
6406534313792.
Both use Masked Language Modeling
6406534313793.
Both use Causal Language Modeling

A published solution is not available for this question yet.

Report a correction for Q137

Question 138 MCQ · 2.0 marks

In Top-K sampling for language generation, increasing the value of K typically has which of the following effects?
6406534313794.
It makes the output more deterministic and repetitive.
6406534313795.
It reduces the probability of selecting high-frequency words.
6406534313796.
It increases the diversity of the generated text but may reduce coherence if K is too large.
6406534313797.
It guarantees grammatical correctness by focusing on top-ranked tokens only.

A published solution is not available for this question yet.

Report a correction for Q138

Question 139 MCQ · 2.0 marks

Why are residual connections important in transformer architectures?
6406534313798.
They reduce memory consumption.
6406534313799.
They add extra cost of compute by adding batch normalization.
6406534313800.
They help in training deep networks by enabling gradient flow.
6406534313801.
They remove the need for layer normalization.

A published solution is not available for this question yet.

Report a correction for Q139

Question 140 MSQ · 3.0 marks

Which of the following statements are true regarding causal language modeling (CLM)?
6406534313802.
The model only attends to past and current tokens during training.
6406534313803.
The model is trained by predicting the next token in a sequence.
6406534313804.
The model uses bidirectional context.
6406534313805.
The CLM objective is commonly used for encoder-only models.

A published solution is not available for this question yet.

Report a correction for Q140

Question 141 MSQ · 3.0 marks

Which of the following are valid reasons why transformer-based large language models are widely used in natural language processing?
6406534313806.
Transformers process input sequences in parallel, enabling faster training.
6406534313807.
They use recurrence to remember long-term dependencies more effectively than LSTMs.
6406534313808.
Transformers are limited to short text inputs due to their architecture.
6406534313809.
Large transformer models can be fine-tuned for various NLP tasks using a single pre-trained model.

A published solution is not available for this question yet.

Report a correction for Q141

Question 142 MSQ · 3.0 marks

Which elements are included in BERT’s input representation for Next Sentence Prediction?
6406534313810.Source diagram or notation
6406534313811.Source diagram or notation
6406534313812.Source diagram or notation
6406534313813.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q142

Question 143 MSQ · 3.0 marks

How does Top-p (nucleus) sampling differ from Top-K sampling in language generation?
6406534313814.
It samples only from a fixed number of tokens at each step.
6406534313815.
It samples from the smallest set of tokens whose cumulative probability exceeds p.
6406534313816.
It always selects the top-p tokens with equal probability.
6406534313817.
It guarantees diversity by selecting all low-probability tokens.

A published solution is not available for this question yet.

Report a correction for Q143

Question 144 NAT · 3.0 marks

Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q144

Question 145 NAT · 3.0 marks

Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q145

Question 146 NAT · 3.0 marks

Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q146

Question 147 MCQ · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Select the scaled dot-product attention for the first head:
6406534313821.Source diagram or notation
6406534313822.Source diagram or notation
6406534313823.Source diagram or notation
6406534313824.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q147

Question 148 MCQ · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Select the scaled dot-product attention for the second head:
6406534313825.Source diagram or notation
6406534313826.Source diagram or notation
6406534313827.Source diagram or notation
6406534313828.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q148

Question 149 MCQ · 2.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Concatenate the outputs from both the attention heads, then apply the output projection matrix Wo to produce the final output of the multi-head attention mechanism. Select the correct result of this operation.
6406534313829.Source diagram or notation
6406534313830.Source diagram or notation
6406534313831.Source diagram or notation
6406534313832.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q149

Question 150 NAT · 1.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
For the given input matrix X and multihead attention output MHA(X), apply a residual connection and store the result in matrix R, and finally compute the sum of all elements in matrix R.

A published solution is not available for this question yet.

Report a correction for Q150

Question 151 NAT · 2.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q151

Question 152 NAT · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q152

Question 153 NAT · 2.0 marks

The table presents the **conditional probability distribution** over vocabulary tokens at each timestep during sequence generation. Each **column** corresponds to a timestep (from 1 to 5), and the values represent the probability of selecting each token given the tokens chosen in all previous timesteps. For timestep t, the values in the column represent:
Source diagram or notation
Based on the above data, answer the given subquestions.
In exhaustive search, at timestep t=1, we run the decoder once to obtain probability distributions over all tokens in the vocabulary. Given the 6 tokens available in the table in the main question, how many times must we run the decoder at timestep t=4?

A published solution is not available for this question yet.

Report a correction for Q153

Question 154 NAT · 1.0 marks

The table presents the **conditional probability distribution** over vocabulary tokens at each timestep during sequence generation. Each **column** corresponds to a timestep (from 1 to 5), and the values represent the probability of selecting each token given the tokens chosen in all previous timesteps. For timestep t, the values in the column represent:
Source diagram or notation
Based on the above data, answer the given subquestions.
How many total sequences of exactly length 5 are possible according to exhaustive search?

A published solution is not available for this question yet.

Report a correction for Q154

Question 155 NAT · 2.0 marks

The table presents the **conditional probability distribution** over vocabulary tokens at each timestep during sequence generation. Each **column** corresponds to a timestep (from 1 to 5), and the values represent the probability of selecting each token given the tokens chosen in all previous timesteps. For timestep t, the values in the column represent:
Source diagram or notation
Based on the above data, answer the given subquestions.
If we use top-k sampling with k=2 at timestep 1, what is the normalized probability of selecting token “sky” at the timestep=1?

A published solution is not available for this question yet.

Report a correction for Q155