Artificial Intelligence Stack Exchange
Artificial Intelligence Stack Exchange

Questions tagged [hardware-evaluation]

Use for objective evaluations and assessments of computing devices and components, including CPUs, GPUs, etc., based on architecture and performance statistics. Opinions may be suitable for comments, but not for formal answers.

The idea here is that the architecture of hardware is a "known quantity" and performance can be statistically evaluated.

Distinct from "recommendations", although there may be some overlap.

With so many options, it is useful to get analyses of hardware components backed up by facts and data.

10 questions
11
votes
3 answers

What size of neural networks can be trained on current consumer grade GPUs? (1060,1070,1080)

Is it possible to give a rule of thumb estimate about the size of neural networks that are trainable on common consumer-grade GPUs? For example, the Emergence of Locomotion (Reinforcement) paper trains a network using tanh activation of the neurons.…
pascalwhoop
  • 305
  • 1
  • 8
11
votes
1 answer

What is the reason AMD Radeon is not widely used for machine learning and deep learning?

What is the reason AMD Radeon is not widely used for machine learning and deep learning? Is it mainly an issue of lack of software? Or is Radeon's GPU not as good as NVIDIA's?
noviceFedora
  • 147
  • 1
  • 5
6
votes
2 answers

In 2016, can $1000.00 buy enough operations per second to be approximately equal to the computational power of a human brain?

In The Age of Spiritual Machines (1999), Ray Kurzweil predicted that in 2009, a \$1000 computing device would be able to perform a trillion operations per second. Additionally, he claimed that in 2019, a \$1000 computing device would be…
DJG
  • 173
  • 4
5
votes
3 answers

Can I do deep learning with the 1060 or the 1070 ti?

Before I start, I want to let you know that I am completely new to the field of deep learning! Since I need a new graphics card either way (gaming you know) I am thinking about buying the GTX 1060 with 6GB or the 1070 ti with 8GB. Because I am not…
S.Matthias
  • 59
  • 1
  • 1
  • 2
4
votes
1 answer

What are the minimum computing resources needed to train a machine learning algorithm?

For a school project, I would like to investigate a paper on either reinforcement learning or computer vision. I am particularly interested in DQN, RNNs, CNNs or LSTMs. I would eventually like to implement any of these. However, I also need to take…
Wizard
  • 303
  • 1
  • 2
  • 6
3
votes
2 answers

What is the difference between a normal processor and a processor designed for AI?

What is the difference between a normal processor and a processor designed for AI?
user9947
3
votes
1 answer

What type of reinforcement learning can I do restricted to ~200MB on an average smartphone?

This concerns a set of finite, non-trivial, combinatorial games [M] in the form of an app. A sample game can be found here. Because this is a mass market product, we can't take up too much space, and the AI needs to be able to run locally since…
DukeZhou
  • 6,237
  • 5
  • 25
  • 53
1
vote
1 answer

For an LLM model, how can I estimate its memory requirements based on storage usage?

It is easy to see the amount of disk space consumed by an LLM model (downloaded from huggingface, for instance). Just go in the relevant directory and check the file sizes. How can I estimate the amount of GPU RAM required to run the model? For…
ahron
  • 131
  • 6
1
vote
2 answers

Does fp32 & fp64 performance of GPU affect deep learning model training?

I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single precision and double precision performance of GPU affect deep…
Ruchit Dalwadi
  • 325
  • 3
  • 11
-1
votes
1 answer

What amount of ressources is involved in building an image recognition system?

I would like to have an order of magnitude of ressources required to build an image recognition system. Let say you want to build a startup company which main product will have to distinguish 20 different kinds of objects (bottle, dogs, car,…
bokan
  • 389
  • 2
  • 8