Artificial Intelligence Stack Exchange
Artificial Intelligence Stack Exchange

Questions tagged [underfitting]

For questions related to the concept of underfitting in machine learning, which occurs when a machine learning model is not able to learn.

See e.g. https://machinelearningmastery.com/overfitting-and-underfitting-with-machine-learning-algorithms/ for more info regarding overfitting and underfitting ML models.

10 questions
8
votes
1 answer

Is there a connection between the bias term in a linear regression model and the bias that can lead to under-fitting?

Here is a linear regression model $$y = mx + b,$$ where $b$ is known as $y$-intercept, but also known as the bias [1], $m$ is the slope, and $x$ is the feature vector. As I understood, in machine learning, there is also the bias that can cause the…
Sivaram Rasathurai
  • 316
  • 1
  • 10
5
votes
1 answer

Why would the application of boosting prevent underfitting?

"Why would the application of boosting prevent underfitting?" I read in some paper that applying boosting would prevent you from underfitting. Why is that? Source: https://www.cs.cornell.edu/courses/cs4780/2015fa/web/lecturenotes/lecturenote13.html
jennifer ruurs
  • 579
  • 2
  • 8
3
votes
0 answers

Are there principled ways of tuning a neural network in case of overfitting and underfitting?

Whenever I tune my neural network, I usually take the common approach of defining some layers with some neurons. If it overfits, I reduce the layers, neurons, add dropout, utilize regularisation. If it underfits, I do the other way around. But…
Fasty
  • 151
  • 5
1
vote
0 answers

Underfitting a single batch: Can't cause autoencoder to overfit multi-sample batches of 1d data. How to debug?

TL;DR I am unable to overfit batches with multiple samples using autoencoder. Fully connected decoder seems to handle more samples per batch than conv decoder, but then also fails when number of samples increases. Why is this happening, and how to…
Gulzar
  • 729
  • 1
  • 8
  • 23
1
vote
2 answers

Is my GRU model under-fitting given this plot of the training and validation loss?

I was running my gated recurrent unit (GRU) model. I wanted to get an opinion if my loss and validation loss graph is good or not, since I'm new to this and don't really know if that is considered underfitting or not
AliY
  • 123
  • 4
1
vote
1 answer

TensorFlow estimator DNNClassifier fails to fit simple data

The ready-to-use DNNClassifier in tf.estimator seems not able to fit these data: X = [[1,2], [1,12], [1,17], [9,33], [48,49], [48,50]] Y = [ 1, 1, 1, 1, 2, 3 ] I've tried with 4 layers but it's fitting to 83% (=5/6…
Dee
  • 1,283
  • 1
  • 11
  • 35
1
vote
2 answers

Which model is better given their training and validation errors?

Below you have the plots of the training and validation errors for two different models. Both plots show the RMSE values for the validation dataset versus the number of training epochs. It is observed that models get lower RMSE value as training…
NaveganTeX
  • 155
  • 7
0
votes
2 answers

How do you interpret this train vs test accuracy scores? is the model under or over fitting?

What does this difference in train and test accuracy mean?
ProgrammingBot
  • 19
  • 1
0
votes
0 answers

If the model always underfits, do I really need a larger model?

I train my neural network on random points generated for a data set that theoretically consists of approximately $1.8 * 10^{39}$ elements. I sample (generate) tens of thousands of random points on each epoch with uniform distribution. For every…
sOvr9000
  • 53
  • 6
0
votes
0 answers

Identifying if a model is over or under-fitting via graphs

I am working on a Neural Network and have plotted the performance of my model. However the plots seem not to fit the "trends" (which help you identify the issue with your model) presented in this illustration. Here is the performance of my model The…
jr123456jr987654321
  • 235
  • 1
  • 7