For questions related to tile coding, a form of coarse coding that is particularly well suited for use on sequential digital computers and for efficient online learning.
Questions tagged [tile-coding]
5 questions
4
votes
1 answer
How does uniform offset tiling work with function approximation?
I get the fundamental idea of how tilings work, but, in Barton and Sutton's book, Reinforcement Learning: An Introduction (2nd edition), a diagram, on page 219 (figure 9.11), showing the variations of uniform offset tiling has confused me.
I don't…
quest ions
- 384
- 1
- 8
4
votes
0 answers
When using hashing in tile coding, why are memory requirements reduced and there is only a little loss of performance?
In the book "Reinforcement Learning: An Introduction" (2018) Sutton and Barto explain, on page 221, a form of tile coding using hashing, to reduce memory consumption.
I have two questions about that:
How can this approach reduce memory consumption?…
F.M.F.
- 311
- 3
- 7
2
votes
0 answers
Does coarse coding with radial basis function generate fewer features?
I am learning about discretization of the state space when applying reinforcement learning to continuous state space. In this video the instructor, at 2:02, the instructor says that one benefit of this approach (radial basis functions over tile…
farhanhubble
- 181
- 4
1
vote
0 answers
Can someone explain to me this implementation of Tile Coding using Hash Tables?
The code below is adapted from this implementation.
from math import floor
basehash = hash
class IHT:
"Structure to handle collisions"
def __init__(self, sizeval):
self.size = sizeval
self.overfullCount = 0
…
Bazman
- 111
- 2
0
votes
1 answer
Unclear paragraph in Sutton-Barto on "Tile Coding"
Sutton-Barto (Tile Coding, page 218):
For example, choosing $\alpha = 1/n$, where n is the number
of tilings, results in exact one-trial learning. If the example $s\to v$ is trained on, then
whatever the prior estimate, $\hat{v}(s,w_t)$, the new…
DSPinfinity
- 301
- 1
- 8