For questions related to hierarchical reinforcement learning algorithms.
Questions tagged [hierarchical-rl]
11 questions
7
votes
1 answer
What are options in reinforcement learning?
According to a lecture (week 10) about Reinforcement Learning [1], the concept of an option allows searching the state space of an agent much faster. The lecture was hard to follow because many new terms were introduced in a short time. For me, the…
user11571
5
votes
1 answer
Should I model my problem as a semi-MDP?
I have a system (like a bank) that people (customers) are entered into the systems by a Poisson process, so the time between the arrival of people (two consecutive customers) will be a random variable. The state of the problem is related to just the…
Amin
- 471
- 2
- 11
4
votes
1 answer
How can I design a hierarchy of agents each of which with different goals?
I read some light material earlier about the possibility of building a hierarchy of agents, where the agents at the leaves solve primitive tasks while higher-level agents are optimized for orchestrating direct-descendant agents.
According to my…
A.Rashad
- 251
- 1
- 14
2
votes
2 answers
How can I design a reinforcement learning model for a game with multiple complex actions taken at a time?
I have a steady hex-map and turn-based wargame featuring WWII carrier battles.
On a given turn, a player may choose to perform a large number of actions. Actions can be of many different types, and some actions may be performed independently of each…
Carrier Battles
- 89
- 7
2
votes
0 answers
What are the limitations of hierarchical reinforcement learning?
Hierarchical Reinforcement Learning is suited to tackle many complex problems such as robotics manipulation. Sticking to this example, the basic idea is that instead of learning a sequence of robotic joint motions, we can learn a sequence of high…
Rexcirus
- 1,131
- 7
- 19
2
votes
0 answers
Where does the hierarchical reinforcement learning framework name "MAXQ" come from?
I've been researching different frameworks for hierarchical RL (mainly options, HAMs, and MAXQ) and noticed that both options and HAMs have names that relate to how they function. I can't seem to find anything stating how MAXQ got its name and I was…
Scorks
- 21
- 2
2
votes
0 answers
Alternatives to Hierarchical RL for centralized control tasks?
Consider a problem where the agent must learn to control a hierarchy of agents acting against another such agent in a competitive environment. The agents on each team need to learn cooperate in order to compete with the other agents.
A hierarchical…
iceburger
- 121
- 1
1
vote
1 answer
How to detect entities in Montezuma's Revenge environment
I'm thinking of implementing "Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation" paper. In this paper authors used some custom object detector for entity detection(eg: Key, rope, ladder, etc) but…
noob_rl
- 13
- 2
1
vote
0 answers
Hierarchical reinforcement learning for combinatorial complexity
I want to try a hierarchical reinforcement learning (HRL) approach to hard logical problems with combinatorial complexity, i.e. games like chess or Rubik's cube. The majority of HRL papers I have found so far focus either on training a control…
Tomasz Odrzygozdz
- 11
- 2
0
votes
1 answer
Is there an approach where the output of one neural network is used to choose the next neural network?
I'd like to design a deep learning architecture in which the output of a primary neural network $M_{\theta}$ determines which neural network $N^i_{\alpha}$ in a set of secondary networks $\mathcal{N}$ to use next. For example, $M_{\theta}$ could be…
Wowee
- 1
0
votes
0 answers
How to train a hierarchical DQN to play the Montezuma's Revenge game?
Would anybody share the experience on how to train a hierarchical DQN to play the Montezuma's Revenge game? How should I design the reward function? How should I balance the anneal rate of the two-level?
I've been trying to train an agent to solve…
zhma
- 1
- 1