For questions that involve the pseudocode of artificial intelligence algorithms.
Questions tagged [pseudocode]
10 questions
3
votes
1 answer
Understanding the pseudocode of uniform-cost search from the book "Artificial Intelligence: A Modern Approach"
On page 84 of Russell & Norvig's book "Artificial Intelligence: A Modern Approach Book" (3rd edition), the pseudocode for uniform cost search is given. I provided a screenshot of it here for your convenience.
I am having trouble understanding the…
anonuser01
- 321
- 1
- 3
- 13
2
votes
1 answer
Is value iteration stopped after one update of each state?
In section 4.4 Value Iteration, the authors write
One important special case is when policy evaluation is stopped after just one sweep (one update of each state). This algorithm is called value iteration.
After that, they provide the following…
Alex
- 23
- 3
2
votes
1 answer
Why does this Keras implementation of the DDPG algorithm update the critic's network using the gradient but the pseudocode doesn't?
I'm trying to understand the DDPG algorithm using Keras
I found the site and started analyzing the code, I can't understand 2 things.
The algorithm used to write the code presented on the page
In the algorithm image, updating the critic's network…
Hubert
- 21
- 1
2
votes
3 answers
Can you provide some pseudocode examples of what constitutes an AI?
After years of learning, I still can't understand what is considered to be an AI. What are the requirements for an algorithm to constitute Artificial Intelligence? Can you provide pseudocode examples of what constitutes an AI?
Zheer
- 121
- 3
1
vote
1 answer
In the DQN paper, why do we have both $\max_{a'}$ and $\max_{a}$ in the pseudocode?
I was reading this article https://www.cs.toronto.edu/~vmnih/docs/dqn.pdf and in it there is an algorithm of deep q learning with experience replay as follows:
On line 12, when the algorithm is setting the values for y_j, the second line says:
I'm…
Ness
- 216
- 1
- 8
1
vote
1 answer
Can this be a possible deep q learning pseudocode?
I am not using replay here. Can this be a possible deep q learning pseudocode?
s - state
a - action
r - reward
n_s - next state
q_net - neural network representing q
step()
{
get s,a,r,n_s
q_target[s,a]=r+gamma*max(q_net[n_s,:])
…
Joel Joseph
- 75
- 8
0
votes
1 answer
Where can I find Norvig's version of the pseudocode for the A* search algorithm?
Can anybody point me to a link to Peter Norvig's version of the A* pseudocode. I've googled it interminably but found nothing.
It's the version that uses the Unexplored/Frontier/Explored data structures. I've looked at other versions (one from CMU),…
Fred Friendly
- 3
- 2
0
votes
1 answer
Why don't we bootstrap terminal state in n-step temporal difference prediction update equation?
In the algorithm below, when $\tau + n \geq T$, shouldn't the algorithm bootstrap with the value of the next state? For instance, when $T=5, \tau=3, \& \; n=2$, we don't bootstrap the sample return with $V_{(\tau+n)}$, i.e., $V_5$ or the terminal…
user529295
- 359
- 1
- 10
0
votes
1 answer
Does a differential evolution algorithm mutate its population during a generation?
I'm implementing a differential evolution algorithm and when it comes to evolving a population, the page I am referencing is vague on how the new population is generated.
https://en.wikipedia.org/wiki/Differential_evolution#Algorithm
The algorithm…
gator
- 75
- 6
0
votes
2 answers
Pseudocode for CNN with Bounding Box and Classifier
I've been looking at various bounding box algorithms, like the three versions of RCNN, SSD and YOLO, and I have noticed that not even the original papers include pseudocode for their algorithms. I have built a CNN classifier and I am attempting to…
MasterYoda
- 109
- 1
- 5