Questions tagged [apprenticeship-learning]

For questions related to apprenticeship learning (also known as learning from demonstration), which is the process of learning by observing an expert, thus it can be thought of as a form of supervised learning.

5 questions

votes

1 answer

In imitation learning, do you simply inject optimal tuples of experience $(s, a, r, s')$ into your experience replay buffer?

Due to my RL algorithm having difficulties learning some control actions, I've decided to use imitation learning/apprenticeship learning to guide my RL to perform the optimal actions. I've read a few articles on the subject and just want to confirm…

asked Aug 27 '18 at 18:41

Rui Nian

votes

1 answer

What does the number of required expert demonstrations in Imitation Learning depend on?

I just read the following points about the number of required expert demonstrations in imitation learning, and I'd like some clarifications. For the purpose of context, I'll be using a linear reward function throughout this post (i.e. the reward can…

reinforcement-learning apprenticeship-learning inverse-rl imitation-learning

asked Aug 13 '20 at 11:01

stoic-santiago

1,121
5
18

votes

1 answer

Do all expert trajectories have the same starting state in apprenticeship learning?

In the apprenticeship learning algorithm described by Ng et al. in Apprenticeship Learning via Inverse Reinforcement Learning, they mention that expert trajectories come in the form of $\{s_0^i, s_1^i\, ...\}_{i=1}^m$. However, they also mentioned…

reinforcement-learning papers rewards apprenticeship-learning

asked Mar 27 '20 at 09:08

calveeen

1,251
7
17

votes

1 answer

What does the notation ${s'\sim T(s,a,\cdot)}$ mean?

I have been seeing notations on Expectations with their respective subscripts such as $E_{s_0 \sim D}[V^\pi (s_0)] = \Sigma_{t=0}^\infty[\gamma^t\phi(s_t)]$. This equation is taken from https://ai.stanford.edu/~ang/papers/icml04-apprentice.pdf and…

reinforcement-learning notation expectation apprenticeship-learning

asked Mar 29 '20 at 15:33

calveeen

1,251
7
17

vote

0 answers

Does apprenticeship learning require prospective data?

I am thinking of applying apprenticeship learning on retrospective data. From looking at this paper by Ng https://ai.stanford.edu/~ang/papers/icml04-apprentice.pdf which talks about apprenticeship learning, it seems to me that at the 5th step of the…

reinforcement-learning rewards apprenticeship-learning

asked Feb 19 '20 at 11:32

calveeen

1,251
7
17