2

In Sutton & Barto (2nd edition), the following is mentioned on page 150 (p. 172 of the pdf), section 7.4:

the importance sampling ratio has expected value one (Section 5.9) and is uncorrelated with the estimate.

How can we prove the importance sampling ratio is uncorrelated with the estimate?

nbro
  • 39,006
  • 12
  • 98
  • 176
user529295
  • 359
  • 1
  • 10

1 Answers1

1

Sutton and Barto explain it themselves in section 5.9. I post it with a bit of context. The equation you're looking for is 5.13.Excerpt from Section 5.9

tnfru
  • 348
  • 1
  • 12