Most Popular

1500 questions
5
votes
2 answers

Is it possible to classify data using a genetic algorithm?

Is it possible to classify data using a genetic algorithm? For example, would it be possible to sort this database? Any example in Matlab?
5
votes
1 answer

How do I use a taxonomy and the support vector machine for question classification?

I am going to develop an open-domain natural language question-answering (NLQA) system, and will use the support vector machine (SVM) as the machine learning (ML) model for question classification. The data that I have is from a cube, containing…
5
votes
1 answer

In the field of Deep Learning research, what considerations do researchers take into account when inventing new neural network models?

I am not a researcher, but I am curious to know what considerations are relevant to take into account during research for the invention of a new neural network model, and what relevant knowledge researchers typically possess in the area. And an…
5
votes
2 answers

Is an embedding a representation of a word or its meaning?

What does the term "embedding" actually mean? An embedding is a vector, but is that vector a representation of a word or its meaning? Literature loosely uses the word for both purposes. Which one is actually correct? Or is there anything like: A…
hanugm
  • 3,571
  • 3
  • 18
  • 50
5
votes
2 answers

What are the best hyper-parameters to tune in reinforcement learning?

Obviously, this is somewhat subjective, but what hyper-parameters typically have the most significant impact on an RL agent's ability to learn? For example, the replay buffer size, learning rate, entropy coefficient, etc. For example, in "normal"…
5
votes
2 answers

What does Brooks mean by "representation"?

For a class, I'm reading Brooks' "Intelligence without representation". The introduction is dedicated to slating representation as a focus for AI development. I've read that representation is the problem of representing information symbolically, in…
Jansky
  • 153
  • 2
5
votes
4 answers

What are the typical sizes of practical/commercial artificial neural networks?

I'm interested in artificial neural networks (ANN) and I wonder how big ANNs in practical use are, for example, Tesla Autopilot, Google Translate, and others. The only thing I found about Tesla is this one: "A full build of Autopilot neural…
5
votes
2 answers

Why can't cognitive architectures achieve general intelligence?

Newbie here. I recently read about cognitive architectures (see: https://en.wikipedia.org/wiki/Cognitive_architecture). They are supposed to be modeled after the human mind and represent a promising approach towards artificial general intelligence…
Anonymous
  • 69
  • 1
5
votes
1 answer

Are neurons instantly feed forward when input arrives?

Let's say I have a neural network with 5 layers, including the input and output layer. Each layer has 5 nodes. Assume the layers are fully connected, but the 3rd node in the 2nd layer is connected to the 5th node in the 4th layer. All these numbers…
5
votes
1 answer

What are the major differences between multi-armed bandits and the other well-known algorithms (DQN, A3C, PPO, etc)?

I have studied in the past different algorithms, i.e. DQN, DDQN, REINFORCE, A3C, PPO, TRPO, so on. I am doing an internship this summer where I have to use a multi-armed bandit (MAB). I am a bit confused between MAB and the other above…
5
votes
1 answer

Why object detection algorithms are poor in optical character recognition?

OCR is still a very hard problem. We don't have universal powerful solutions. We use the CTC loss function An Intuitive Explanation of Connectionist Temporal Classification | Towards Data Science Sequence Modeling With CTC | Distill which is very…
5
votes
1 answer

What does "statistical efficiency" mean in this context?

Consider the following statement(s) from Deep Learning book (p. 333, chapter 9: Convolutional Networks) by Ian Goodfellow et al. Convolution is thus dramatically more efficient than dense matrix multiplication in terms of the memory requirements…
hanugm
  • 3,571
  • 3
  • 18
  • 50
5
votes
1 answer

Does the policy iteration convergence hold for finite-horizon MDP?

Most RL books (Sutton & Barto, Bertsekas, etc.) talk about policy iteration for infinite-horizon MDPs. Does the policy iteration convergence hold for finite-horizon MDP? If yes, how can we derive the algorithm?
5
votes
3 answers

Does gradient descent in deep learning assume a smooth fitness landscape?

I've come across the concept of fitness landscape before and, in my understanding, a smooth fitness landscape is one where the algorithm can converge on the global optimum through incremental movements or iterations across the landscape. My question…
Joebevo
  • 159
  • 5
5
votes
1 answer

In MCTS, what to do if I do not want to simulate till the end of the game?

I'm trying to implement MCTS with UCT for a board game and I'm kinda stuck. The state space is quite large (3e15), and I'd like to compute a good move in less than 2 seconds. I already have MCTS implemented in Java from here, and I noticed that it…