Artificial Intelligence Stack Exchange
Artificial Intelligence Stack Exchange

Questions tagged [efficiency]

For questions about efficiency of ML/AI algorithms solving a particular problem.

Efficiency of an ML/AI algorithm may be benchmarked on many aspects especially:

  • Time Complexity
  • Space Complexity
  • Accuracy
  • Processor Requirements
  • Simplicity of Understanding, etc

Algorithm Efficiency

Big O, how do you calculate/approximate it?

22 questions
11
votes
1 answer

Why is the merged neural network of AlphaGo Zero more efficient than two separate neural networks?

AlphaGo Zero contains several improvements compared to its predecessors. Architectural details of Alpha Go Zero can be seen in this cheat sheet. One of those improvements is using a single neural network that calculates move probabilities and the…
Demento
  • 1,684
  • 1
  • 7
  • 26
7
votes
2 answers

Can neural networks efficiently solve the traveling salesmen problem?

Can neural networks efficiently solve the traveling salesmen problem? Are there any research papers that show that neural networks can solve the TSP efficiently? The TSP is an NP-hard problem, so I suspect that there are only approximate solutions…
Gottfried William
  • 343
  • 1
  • 11
5
votes
2 answers

Is it possible to guide a reinforcement learning algorithm?

I have just started to study reinforcement learning and, as far as I understand, existing algorithms search for the optimal solution/policy, but do not allow the possibility for the programmer to suggest a way to find the solution (to guide their…
Cristian M
  • 249
  • 2
  • 6
4
votes
1 answer

Transposition table is only used for roughly 17% of the nodes - is this expected?

I'm making a Connect Four game using the typical minimax + alpha-beta pruning algorithms. I just implemented a Transposition Table, but my tests tell me the TT only helps 17% of the time. By this I mean that 17% of the positions my engine comes…
Inertial Ignorance
  • 501
  • 3
  • 13
3
votes
1 answer

Which are more memory efficient: uninformed or informed search algorithms?

I have extensively researched now for three days straight trying to find which algorithm is better in terms of which algorithm uses up more memory. I know uninformed algorithms, like depth-first search and breadth-first search, do not store or…
JoeyB
  • 467
  • 1
  • 5
  • 15
3
votes
1 answer

A comparison of Expert Systems and Machine Learning approaches in terms of run-time-efficiency and time/space complexity

For part of a paper I am writing on Clinical Decision Support Systems (computer-aided medical decision making, e.g. diagnosis, treatment), I am trying to compare Expert Systems with systems based on Machine Learning approaches (Deep Learning,…
Chris
  • 25
  • 4
2
votes
1 answer

Are there any load balancing approaches for employee cases based on complexity score?

In working with a social services agency that provides a continuum of programs across the behavioral health and child welfare spectrum the need to adequately manage individual worker and total program caseloads has become increasingly difficult due…
patrick
  • 31
  • 1
2
votes
0 answers

Are there any successful applications of transformers of small size (<10k weights)?

In the problems of NLP and sequence modeling, the Transformer architectures based on the self-attention mechanism (proposed in Attention Is All You Need) have achieved impressive results and now are the first choices in this sort of…
spiridon_the_sun_rotator
  • 2,454
  • 8
  • 16
2
votes
0 answers

How to train/update neural networks faster without a decrease in performance?

I noticed that there are many studies in recent years on how to train/update neural networks faster/quicker with equal or better performance. I find the following methods(except the chips arms race): using few-shot learning, for instance,…
Lerner Zhang
  • 877
  • 1
  • 7
  • 19
2
votes
2 answers

In the multi-head attention mechanism of the transformer, why do we need both $W_i^Q$ and ${W_i^K}^T$?

In the Attention is all you need paper, on the 4th page, we have equation 1, which describes the self-attention mechanism of the transformer architecture $$ \text { Attention }(Q, K, V)=\operatorname{softmax}\left(\frac{Q K^{T}}{\sqrt{d_{k}}}\right)…
Uğurcan Özalp
  • 23
  • 3
2
votes
0 answers

What is the most efficient data type to store probabilities?

In ML we often have to store a huge amount of values ranging from 0 to 1, mostly being probabilities. The most common data structure to do so seems to be a floating point? Indeed, the range of floating points is huge. This makes them imprecise in…
Ray Walker
  • 451
  • 3
  • 8
2
votes
2 answers

Using AI to enhance customer service

I'm trying to find out how AI can help with efficient customer service, in fact call routing to the right agent. My usecase is given context of a query from a customer and agents' expertise, how can we do the matching? Generally, how is this problem…
Tina J
  • 973
  • 6
  • 13
2
votes
1 answer

Why is informed search more efficient than uninformed search?

Why does informed search more efficiently finds a solution than an uninformed search?
Lexi
  • 109
  • 7
1
vote
0 answers

How to improve the efficiency of the backtracking search in CSPs?

Backtracking search is the basic uninformed search algorithm for constraint satisfaction problems (CSPs). How could we improve the efficiency of the backtracking search in CSPs?
Abbas Ali
  • 566
  • 3
  • 10
  • 17
1
vote
0 answers

Do NNs suffer from lack of efficiency in network structure and suggesting training parameters?

I am working on dynamical systems using Optimal Control theory and trying to find the connection between this field and Machine Learning. Consider a simple 2-layer Neural Network (NN) where the activation function is considered as $y = x+x^2 $ (I…
Mehdi Moghadasian
  • 11
  • 1
1
2