MauryaHub PYQ Practice

da5007_2023T3_Q1_NA.pdf

Reinforcement Learning · Quiz 1 · Sep 2023

← Course papers · Start practice / exam

This page contains the reliably extracted subset, not the complete original paper.

Questions and published explanations below are available without starting a test. Some questions may not have a published solution yet.

Question 85 MCQ · 1.0 marks

Net profit for the month of April is:
  1. $5920
  2. $5275
  3. $5322
  4. $5800       **RL** **Section Id :** 64065345317 **Section Number :** 5 **Section type :** Online **Mandatory or Optional :** Mandatory **Number of Questions :** 12 **Number of Questions to be attempted :** 12 **Section Marks :** 40 **Display Number Panel :** Yes **Section Negative Marks :** 0 **Group All Questions :** No **Enable Mark as Answered Mark for Review and** Yes **Clear Response :** **Maximum Instruction Time :** 0

A published solution is not available for this question yet.

Question 87 MCQ · 0.0 marks

[[IMAGE:19e4e51306e3f6f5_3_0]]
Source diagram or notation
  1. Useful Data has been mentioned above.
  2. This data attachment is just for a reference & not for an evaluation.

A published solution is not available for this question yet.

Question 88 MSQ · 2.0 marks

Select correct statements about UCB1 algorithm:
  1. Each arm is selected atleast twice before any arm is selected third time.
  2. Each arm is selected atleast once before any arm is selected second time.
  3. Constant c controls degree of exploration, higher its value, higher the exploration.
  4. Constant c controls degree of exploration, higher its value, lower the exploration.

A published solution is not available for this question yet.

Question 89 MSQ · 2.0 marks

For the value iteration algorithm, which of the following statements are correct?
  1. [[IMAGE:19e4e51306e3f6f5_4_1]]
    Source diagram or notation
  2. [[IMAGE:19e4e51306e3f6f5_4_2]]
    Source diagram or notation
  3. [[IMAGE:19e4e51306e3f6f5_4_3]]
    Source diagram or notation
  4. [[IMAGE:19e4e51306e3f6f5_4_4]]
    Source diagram or notation

A published solution is not available for this question yet.

Question 90 MCQ · 2.0 marks

Choose the correct statement(s) regarding explore-exploit dilemma:
  1. Always exploring is not optimal.
  2. Always exploiting is optimal.
  3. None of these.

A published solution is not available for this question yet.

Question 91 MCQ · 2.0 marks

Which of the following is the correct Bellman equation for deterministic transitions? The symbols have the usual meaning.
  1. [[IMAGE:19e4e51306e3f6f5_5_5]]
    Source diagram or notation
  2. [[IMAGE:19e4e51306e3f6f5_5_6]]
    Source diagram or notation
  3. [[IMAGE:19e4e51306e3f6f5_5_7]]
    Source diagram or notation
  4. [[IMAGE:19e4e51306e3f6f5_5_8]]
    Source diagram or notation

A published solution is not available for this question yet.

Question 92 MCQ · 2.0 marks

Consider the following statements and select the correct option. **Assertion:** Monte Carlo value function approximation methods do not need knowledge of the model to be implemented. **Reason:** Monte Carlo value function approximation methods require only a way to sample trajectories from the environment and aggregate the results.
  1. Assertion and Reason are both true and Reason is a correct explanation of Assertion.
  2. Assertion and Reason are both true and Reason is not a correct explanation of Assertion.
  3. Assertion is true but Reason is false.
  4. Assertion is false but Reason is true.

A published solution is not available for this question yet.

Question 93 NAT · 2.0 marks

[[IMAGE:19e4e51306e3f6f5_7_9]] Based on the above data, answer the given subquestions.
What is the probability of choosing arm A2 at timestamp t = 6?
Source diagram or notation

    A published solution is not available for this question yet.

    Question 94 MCQ · 2.0 marks

    [[IMAGE:19e4e51306e3f6f5_7_9]] Based on the above data, answer the given subquestions.
    At time stamp t = 6, suppose the arm with least estimate so far is pulled and the reward is ln(4). Which of the following is correct after timestamp t = 6?
    Source diagram or notation
    1. Arm A1 is optimal arm.
    2. Arm A2 is optimal arm.
    3. Arm A3 is optimal arm.
    4. An optimal arm can not be determined.
    5. There is a tie for optimal arm.

    A published solution is not available for this question yet.

    Question 95 NAT · 2.0 marks

    [[IMAGE:19e4e51306e3f6f5_8_10]]
    Source diagram or notation

      A published solution is not available for this question yet.

      Question 96 NAT · 3.0 marks

      [[IMAGE:19e4e51306e3f6f5_9_11]]
      Source diagram or notation

        A published solution is not available for this question yet.

        Question 97 MSQ · 2.0 marks

        [[IMAGE:19e4e51306e3f6f5_10_12]] Based on the above data, answer the given subquestions.
        Consider the following deterministic policies in table (1) : [[IMAGE:19e4e51306e3f6f5_11_13]] Which of the following are optimal policies?
        Source diagram or notationSource diagram or notation
        1. π1
        2. π2
        3. π3
        4. π4
        5. Can not be determined.

        A published solution is not available for this question yet.

        Question 98 MSQ · 2.0 marks

        [[IMAGE:19e4e51306e3f6f5_10_12]] Based on the above data, answer the given subquestions.
        Refer to table (1) and choose the correct statements from the following: [[IMAGE:19e4e51306e3f6f5_12_14]]
        Source diagram or notationSource diagram or notation
        1. π1 = π2
        2. π2 < π3
        3. π1 ≤ π4
        4. π3 ≥ π4
        5. None of these

        A published solution is not available for this question yet.

        Question 99 NAT · 2.0 marks

        [[IMAGE:19e4e51306e3f6f5_10_12]] Based on the above data, answer the given subquestions.
        [[IMAGE:19e4e51306e3f6f5_12_15]]
        Source diagram or notationSource diagram or notation

          A published solution is not available for this question yet.

          Question 100 NAT · 3.0 marks

          [[IMAGE:19e4e51306e3f6f5_10_12]] Based on the above data, answer the given subquestions.
          [[IMAGE:19e4e51306e3f6f5_13_16]]
          Source diagram or notationSource diagram or notation

            A published solution is not available for this question yet.

            Question 101 MSQ · 2.0 marks

            [[IMAGE:19e4e51306e3f6f5_10_12]] Based on the above data, answer the given subquestions.
            [[IMAGE:19e4e51306e3f6f5_13_17]]
            Source diagram or notationSource diagram or notation
            1. 1 and 2.
            2. 1 and 3.
            3. 2 and 3.
            4. 2 and 5.
            5. 2 and 4.
            6. 4 and 5.

            A published solution is not available for this question yet.

            Question 102 NAT · 3.0 marks

            [[IMAGE:19e4e51306e3f6f5_14_18]] Based on the above data, answer the given subquestions.
            What will be the value of v(hot) after one round of value iteration? Assuming v(hot) and v(cold) are initialized with 0. Note the value function is updated synchronously.
            Source diagram or notation

              A published solution is not available for this question yet.

              Question 103 NAT · 3.0 marks

              [[IMAGE:19e4e51306e3f6f5_14_18]] Based on the above data, answer the given subquestions.
              What will be the value of v(cold) after one round of value iteration? Assuming v(hot) and v(cold) are initialized with 0. Note the value function is updated synchronously.
              Source diagram or notation

                A published solution is not available for this question yet.

                Question 104 NAT · 4.0 marks

                [[IMAGE:19e4e51306e3f6f5_14_18]] Based on the above data, answer the given subquestions.
                What will be the value of v(hot) + v(cold) after **two** rounds of value iteration? Assuming v(hot) and v(cold) are initialized with 0. Note the value function is updated synchronously.
                Source diagram or notation

                  A published solution is not available for this question yet.