For questions related to the concept of time-step, for instance, in Markov decision processes or reinforcement learning.
Questions tagged [time-step]
1 questions
7
votes
2 answers
What is a time-step in a Markov Decision Process?
The "discounted sum of future rewards" (or return) using discount factor $\gamma$ is
$$\gamma^1 r_1 +\gamma^2 r_2 + \gamma^3 r_2 + \dots \tag{1}\label{1}$$
where $r_i$ is the reward received at the $i$th time-step.
I am confused as to what…
Abhishek Bhatia
- 427
- 2
- 5
- 15