Questions tagged [discrete-state-spaces]

For questions about discrete state spaces, in the context of reinforcement learning or other AI sub-fields.

3 questions
3
votes
1 answer

Does DQN generalise to unseen states in the case of discrete state-spaces?

In my understanding, DQN is useful because it utilises a neural network as a q-value function approximator, which, after the training, can generalise to unseen states. I understand how that would work when the input is a vector of continuous values,…
2
votes
0 answers

How to find good features for a linear function approximation in RL with large discrete state set?

I've recently read much about feature engineering in continuous (uncountable) feature spaces. Now I am interested what methods exist in the setting of large discrete state spaces. For example consider a board game with grid as a basic layout. Each…
1
vote
1 answer

How do you evaluate a k-medoids cluster model?

So I'm planning on clustering a bunch of observation data using k-medoids. There are seven attributes for each instance and the data is numerical and discrete. I'm a little uncertain of how to evaluate the model to find the correct number of…