For questions about discrete state spaces, in the context of reinforcement learning or other AI sub-fields.
Questions tagged [discrete-state-spaces]
3 questions
3
votes
1 answer
Does DQN generalise to unseen states in the case of discrete state-spaces?
In my understanding, DQN is useful because it utilises a neural network as a q-value function approximator, which, after the training, can generalise to unseen states.
I understand how that would work when the input is a vector of continuous values,…

Redox
- 33
- 2
2
votes
0 answers
How to find good features for a linear function approximation in RL with large discrete state set?
I've recently read much about feature engineering in continuous (uncountable) feature spaces. Now I am interested what methods exist in the setting of large discrete state spaces. For example consider a board game with grid as a basic layout. Each…

s1624210
- 121
- 1
1
vote
1 answer
How do you evaluate a k-medoids cluster model?
So I'm planning on clustering a bunch of observation data using k-medoids. There are seven attributes for each instance and the data is numerical and discrete. I'm a little uncertain of how to evaluate the model to find the correct number of…