For questions about scalability related to software architectures and methods.
Questions tagged [scalability]
5 questions
13
votes
1 answer
How would DeepMind's new differentiable neural computer scale?
DeepMind just published a paper about a differentiable neural computer, which basically combines a neural network with a memory.
The idea is to teach the neural network to create and recall useful explicit memories for a certain task. This…
BlindKungFuMaster
- 4,185
- 11
- 23
1
vote
0 answers
LSTM - MAPE Loss Function gives Better Results when Data is De-Scaled before Loss Calculation
I am building an LSTM for predicting a price chart. MAPE resulted in the best loss function compared to MSE and MAE. MAPE function looks like this
$$\frac{1}{N}\sum^N_{i=0}\frac{|P_i - A_i|}{A_i}$$
Where $P_i$ is the current predicted value and…
user134132523
- 11
- 1
1
vote
0 answers
How do you scale your ML problems?
While I have limited resource usually to train my machine learning models, I often find that my hyperparameter optimization procedure is not necessary using all my GPU and CPU, and that is because the results also depend on the batch size in my…
boomkin
- 119
- 1
0
votes
0 answers
Why is my super-computer scale PPO not scaling well?
Hi I basically have PPO as implemented in stable-baselines3 and so far it is not scaling well at all which is very concerning. The basic parallelism strategy is very similar to OpenAI five's training strategy: each worker has PPO with batch size…
profPlum
- 360
- 1
- 9
0
votes
1 answer
Object Detection: Can I modify this script to support larger images (Scaled YOLOv4)?
I am looking at training the Scaled YOLOv4 on TensorFlow 2.x, as can be found at this link. I plan to collect the imagery, annotate the objects within the image in VOC format, and then use these images/annotations to train the large-scale model. If…
ihb
- 129
- 1
- 10