MauryaHub PYQ Practice

Reinforcement Learning · Quiz 2 · Sep 2023

Reinforcement Learning · Quiz 2 · Sep 2023

← Course papers · Start practice / exam

This page contains the reliably extracted subset, not the complete original paper.

Questions and published explanations below are available without starting a test. Some questions may not have a published solution yet.

0 / 22 published solutions

Question 90 MCQ · 1.0 marks

If interest rate drops to 3% will you consider changing the decision?
6406532311632.
Yes
6406532311633.
No
6406532311634.
Can’t determine       **RL** **Section Id :** 64065348598 **Section Number :** 5 **Section type :** Online **Mandatory or Optional :** Mandatory **Number of Questions :** 17 **Number of Questions to be attempted :** 17 **Section Marks :** 50 **Display Number Panel :** Yes **Group All Questions :** No **Enable Mark as Answered Mark for Review and** Yes **Clear Response :** **Maximum Instruction Time :** 0

A published solution is not available for this question yet.

Report a correction for Q90

Question 92 NAT · 2.0 marks

Source diagram or notation
**Note:** For numerical answer type questions, always enter your answer correct upto two decimal places without rounding up or off.

A published solution is not available for this question yet.

Report a correction for Q92

Question 93 NAT · 2.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
What is the estimate of V (B) returned by first-visit MC? **Note:** For numerical answer type questions, always enter your answer correct upto two decimal places without rounding up or off.

A published solution is not available for this question yet.

Report a correction for Q93

Question 94 NAT · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
What is the estimate of V (A) returned by first-visit MC? **Note:** For numerical answer type questions, always enter your answer correct upto two decimal places without rounding up or off.

A published solution is not available for this question yet.

Report a correction for Q94

Question 95 NAT · 2.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
What is the estimate of V (B) returned by batch TD(0)? **Note:** For numerical answer type questions, always enter your answer correct upto two decimal places without rounding up or off.

A published solution is not available for this question yet.

Report a correction for Q95

Question 96 NAT · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
What is the estimate of V(A) returned by batch TD(0)? **Note:** For numerical answer type questions, always enter your answer correct upto two decimal places without rounding up or off.

A published solution is not available for this question yet.

Report a correction for Q96

Question 97 MCQ · 2.0 marks

Source diagram or notation
6406532311709.Source diagram or notation
6406532311710.Source diagram or notation
6406532311711.Source diagram or notation
6406532311712.Source diagram or notation
6406532311713.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q97

Question 98 MCQ · 2.0 marks

Which of the following is correct update rule for expected SARSA:
6406532311714.Source diagram or notation
6406532311715.Source diagram or notation
6406532311716.Source diagram or notation
6406532311717.Source diagram or notation
6406532311718.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q98

Question 99 MCQ · 2.0 marks

Choose the correct option:
6406532311727.
SARSA will have more maximization bias compared to Q-learning.
6406532311728.
Q-learning will have more maximization bias compared to SARSA.
6406532311729.
SARSA and Q-learning will have nearly the same maximization bias.
6406532311730.
Maximization bias for SARSA and Q-learning can not be compared.
6406532311731.
None of these.

A published solution is not available for this question yet.

Report a correction for Q99

Question 100 MCQ · 3.0 marks

Consider the following and select the correct option. **Assertion:** Double Q learning removes or minimizes maximization bias. **Reason:** The target action for Q1 is chosen from Q2 estimate and vice versa.
6406532311719.
Assertion and Reason are both true and Reason is a correct explanation of Assertion
6406532311720.Source diagram or notation
Assertion and Reason are both true and Reason is not a correct explanation of Assertion
6406532311721.
Assertion is true and Reason is false
6406532311722.
Both Assertion and Reason are false

A published solution is not available for this question yet.

Report a correction for Q100

Question 101 MCQ · 3.0 marks

Identify the correct Q function estimated by Dueling DQN?
6406532311744.Source diagram or notation
6406532311745.Source diagram or notation
6406532311746.Source diagram or notation
6406532311747.Source diagram or notation
6406532311748.Source diagram or notation
6406532311749.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q101

Question 102 MSQ · 2.0 marks

What is the advantage of computing n\(^{th}\) step reward vs 1-step reward?
6406532311723.Source diagram or notation
6406532311724.Source diagram or notation
6406532311725.Source diagram or notation
6406532311726.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q102

Question 103 MSQ · 3.0 marks

Select correct statements regarding eligibility traces:
6406532311732.
It is an approach to implement the T D(λ) algorithm.
6406532311733.
The state closest to the terminal state in an episode, has the least value of eligibility trace.
6406532311734.
It is initialized as 0 before every trajectory in the TD algorithm.
6406532311735.
It is initialized as 0 at the beginning of the TD algorithm.
6406532311736.
None of these.

A published solution is not available for this question yet.

Report a correction for Q103

Question 104 MCQ · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
What are the Q values for all the actions (i.e. left, up, right, down in that order) in state s1?
6406532311737.
[2, 5, 8, 11]
6406532311738.
[2, 5, 11, 8]
6406532311739.
[5, 2, 8, 11]
6406532311740.
[11, 8, 2, 5]
6406532311741.
None of these.

A published solution is not available for this question yet.

Report a correction for Q104

Question 105 NAT · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
What is the TD(0) target (Q-learning) for this transition? **Note:** For numerical answer type questions, always enter your answer correct upto two decimal places without rounding up or off.

A published solution is not available for this question yet.

Report a correction for Q105

Question 106 NAT · 3.0 marks

Source diagram or notation
Based on the above data, answer the given subquestions.
Source diagram or notation
**Note:** For numerical answer type questions, always enter your answer correct upto two decimal places without rounding up or off.

A published solution is not available for this question yet.

Report a correction for Q106

Question 107 MSQ · 2.0 marks

Training a neural network with TD target, can diverge because:
6406532311750.
High correlation between consecutive samples.
6406532311751.
Target keeps moving as fast as the function approximator.
6406532311752.
The target is moved towards the function approximator.
6406532311753.
The features are learnt from scratch.
6406532311754.
None of these.

A published solution is not available for this question yet.

Report a correction for Q107

Question 108 MSQ · 2.0 marks

Suppose we are using a policy gradient method to solve a reinforcement learning problem. Assuming that the policy returned by the method is not optimal, which among the following are the plausible reasons for such an outcome?
6406532311764.
The search procedure converged to a locally optimal policy.
6406532311765.
The search procedure was terminated before it could reach an optimal policy.
6406532311766.
An optimal policy could not be represented by the parameterisation used to represent the policy.
6406532311767.
None of these

A published solution is not available for this question yet.

Report a correction for Q108

Question 109 MSQ · 2.0 marks

What are the advantages of policy search methods over other approaches?
6406532311768.
They can lead to simpler solution description.
6406532311769.
They offer better convergence as compared to function approximation based methods.
6406532311770.
In continuous action setting, they work better than value function based approaches.
6406532311771.
They are robust to partial observability.
6406532311772.
None of these.

A published solution is not available for this question yet.

Report a correction for Q109

Question 110 MCQ · 2.0 marks

Which of the problems does the replay buffer solve regarding training a Q-network?
6406532311755.
High correlation between consecuteve samples.
6406532311756.
Target keeps moving as fast as the function approximator.
6406532311757.
The target is moved towards the function approximator.
6406532311758.
None of these.

A published solution is not available for this question yet.

Report a correction for Q110

Question 111 MCQ · 2.0 marks

Which of the following is the correct way to represent policy for policy search methods? Assume θ represents a real valued parameter.
6406532311759.Source diagram or notation
6406532311760.Source diagram or notation
6406532311761.Source diagram or notation
6406532311762.Source diagram or notation
6406532311763.Source diagram or notation

A published solution is not available for this question yet.

Report a correction for Q111

Question 112 MCQ · 2.0 marks

Which of the following is the correct way to represent policy for policy search methods?
6406532311773.Source diagram or notation
6406532311774.Source diagram or notation
6406532311775.Source diagram or notation
6406532311776.Source diagram or notation
6406532311777.Source diagram or notation
      **Industry 4.0** **Section Id :** 64065348599 **Section Number :** 6 **Section type :** Online **Mandatory or Optional :** Mandatory **Number of Questions :** 9 **Number of Questions to be attempted :** 9 **Section Marks :** 20 **Display Number Panel :** Yes **Group All Questions :** No **Enable Mark as Answered Mark for Review and** Yes **Clear Response :** **Maximum Instruction Time :** 0

A published solution is not available for this question yet.

Report a correction for Q112