MauryaHub PYQ Practice

Large Language Models · Quiz 1 · Jan 2025

Large Language Models · Quiz 1 · Jan 2025

← Course papers · Start practice / exam

This page contains the reliably extracted subset, not the complete original paper.

Questions and published explanations below are available without starting a test. Some questions may not have a published solution yet.

0 / 19 published solutions

Question 103 MCQ · 0.0 marks

General Note: • If you find the given information is insufficient in any of the Numerical Answer Type (NAT) questions, enter -1 as the answer. • In all your calculations, take at least two digits. For example, if the intermediate result is 1.860875, then take it as 1.86 to the next step.
6406533822518.
Instructions has been mentioned above.
6406533822519.
This Instructions is just for a reference & not for an evaluation.

A published solution is not available for this question yet.

Report a correction for Q103

Question 104 MCQ · 2.0 marks

Source diagram or notation
6406533822520.Source diagram or notation
6406533822521.Source diagram or notation
6406533822522.Source diagram or notation
6406533822523.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q104

Question 105 MCQ · 2.0 marks

Consider following assertion and reason pair: **Assertion**: A transformer model cannot be trained in autogregressive mode for machine translation task. **Reason**: Teacher forcing improves the convergence rate. Choose the correct statements
6406533822524.
Assertion and Reason are both true and Reason is a correct explanation of Assertion.
6406533822525.
Assertion and Reason are both true and Reason is not a correct explanation of Assertion.
6406533822526.
Assertion is true but Reason is false.
6406533822527.
Assertion is false but Reason is true.

A published solution is not available for this question yet.

Report a correction for Q105

Question 106 MCQ · 3.0 marks

Suppose we use a pre-trained model for text generation with the given prompt “I am going to”. Which of the following decoding strategies can be used such that the pre-trained model generates different text completion each time it is executed
6406533822532.
Beam search with beam size 1
6406533822533.
Greedy approach
6406533822534.
Top-K with k = 2
6406533822535.
None of these

A published solution is not available for this question yet.

Report a correction for Q106

Question 107 MSQ · 2.0 marks

Which of the following models, in general, struggle to encode a context when translating long sentences?
6406533822536.
An RNN model
6406533822537.
An RNN model with attention mechanism
6406533822538.
A transformer model

A published solution is not available for this question yet.

Report a correction for Q107

Question 108 MSQ · 2.0 marks

Choose the correct statements
6406533822539.
All the parameters of the GPT model are randomly initialized during pre- training
6406533822540.
The model minimizes the CLM objective during fine-tuning to improve the performance
6406533822541.
All parameters of the GPT model are randomly initialized during fine-tuning
6406533822542.
In general, fine-tuning requires a dataset with labels

A published solution is not available for this question yet.

Report a correction for Q108

Question 109 MSQ · 3.0 marks

Source diagram or notation
6406533822528.Source diagram or notation
6406533822529.Source diagram or notation
6406533822530.Source diagram or notation
6406533822531.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q109

Question 110 MSQ · 3.0 marks

Which of the following decoding strategies is (are) appropriate for machine translation tasks? Assume we have infinite compute and the values for k ≥ 3, p > 0.35 where required.
6406533822543.
Top-k sampling
6406533822544.
Beam search with the beam size K = 2
6406533822545.
Top-p sampling
6406533822546.
Exhaustive search
6406533822547.
None of these

A published solution is not available for this question yet.

Report a correction for Q110

Question 111 NAT · 2.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Suppose the number of learnable parameters in the source input-embedding layer is 3200, how many parameters are there in the positional embedding layer of the source language?

A published solution is not available for this question yet.

Report a correction for Q111

Question 112 NAT · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
How many parameters are there in the multi-head attention layer of the encoder (exclude the parameters in the WO matrix used for linear transformation and FFN layer)?

A published solution is not available for this question yet.

Report a correction for Q112

Question 113 NAT · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
How many parameters does the matrix WQ have in anyone head of the encoder?

A published solution is not available for this question yet.

Report a correction for Q113

Question 114 NAT · 1.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Say matrix F is computed by applying batch normalization on X, what will be sum of every element in first / topmost row of F?

A published solution is not available for this question yet.

Report a correction for Q114

Question 115 NAT · 1.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Say matrix F is computed by applying layer normalization on X, what will be sum of every element in first / leftmost column of F?

A published solution is not available for this question yet.

Report a correction for Q115

Question 116 NAT · 2.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q116

Question 117 NAT · 2.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q117

Question 118 NAT · 2.0 marks

Source diagram or notationSource diagram or notation

A published solution is not available for this question yet.

Report a correction for Q118

Question 119 NAT · 2.0 marks

Source diagram or notationSource diagram or notation

A published solution is not available for this question yet.

Report a correction for Q119

Question 120 NAT · 3.0 marks

Source diagram or notationSource diagram or notation

A published solution is not available for this question yet.

Report a correction for Q120

Question 121 MCQ · 2.0 marks

Source diagram or notation
Once the model is sufficiently trained, which of the following tokens will have the highest probability to be the next token, if the input is “Sachin has”:
6406533822558.
broken
6406533822559.
acted
6406533822560.
highest
6406533822561.
None of these       **i-NLP** **Section Id :** 64065379955 **Section Number :** 8 **Section type :** Online **Mandatory or Optional :** Mandatory **Number of Questions :** 31 **Number of Questions to be attempted :** 31 **Section Marks :** 50 **Display Number Panel :** Yes **Section Negative Marks :** 0 **Group All Questions :** No **Enable Mark as Answered Mark for Review and** No **Clear Response :** **Section Maximum Duration :** 0 **Section Minimum Duration :** 0 **Section Time In :** Minutes **Maximum Instruction Time :** 0

A published solution is not available for this question yet.

Report a correction for Q121