For questions related to the concept of boosting in machine learning, which is a collection of ensemble learning methods.
Questions tagged [boosting]
9 questions
5
votes
3 answers
How do weak learners become strong in boosting?
Boosting refers to a family of algorithms which converts weak learners to strong learners. How does it happen?
Legend
- 103
- 3
5
votes
1 answer
Why would the application of boosting prevent underfitting?
"Why would the application of boosting prevent underfitting?"
I read in some paper that applying boosting would prevent you from underfitting. Why is that?
Source:
https://www.cs.cornell.edu/courses/cs4780/2015fa/web/lecturenotes/lecturenote13.html
jennifer ruurs
- 579
- 2
- 8
3
votes
1 answer
Are there tabular datasets where deep neural networks outperform traditional methods?
Are there (complex) tabular datasets where deep neural networks (e.g. more than 3 layers) outperform traditional methods such as XGBoost by a large margin?
I'd prefer tabular datasets rather than image datasets, since most image dataset are either…
Clara
- 31
- 1
2
votes
0 answers
Why don't ensembling, bagging and boosting help to improve accuracy of Naive bayes classifier?
You might think to apply some classifier combination techniques like ensembling, bagging and boosting but these methods would not help. Actually, “ensembling, boosting, bagging” won’t help since their purpose is to reduce variance. Naive Bayes has…
Sivaram Rasathurai
- 316
- 1
- 10
0
votes
0 answers
How do we determine what is correct and what not in Adaboost
In Adaboost, how is it determined what is correct and what not?
In the following example from StatQuest (in youtube), what correct is
and what incorrect makes sense in real life. But what if we have a problem
where we doesn't know that? What…
kobo
- 3
- 2
0
votes
1 answer
Can i train xgboost on multiple time series csv files at the same time?
I built an xgboost model to predict stock it now trains on 1 stock at a time its a csv file I use pandas to load it.
Is there a way to train the model on multiple stocks at the same time? What would be the best approach?
I don't need code just…
AJB
- 1
- 1
0
votes
1 answer
How to specify categorical features in cat boost?
I have a dataset (pandas data frame) with all features of type int32 containing continuous values except one feature state_number, its data type is int32, but it represents different states of a network (category). The feature state_number has 11…
Zal
- 7
- 3
0
votes
1 answer
Multiclass Ensemble Methods with weak classifiers under 50%
Normally, when using an ensemble method, such as baggin or boosting, in binary classification, there is a reqauirment that each weak classifier have accuracy better than 50%.
In the multiclass claaification setting, this is often infeasible. Is…
chessprogrammer
- 2,215
- 2
- 12
- 23
0
votes
1 answer
What ensemble methods are used in the state-of-the-art models?
What ensemble methods are used in the state-of-the-art models?
When I surveyed the state-of-the-art methods of classification and detection, e.g. ImageNet, COCO, etc., I noticed that are few or even no references to the use of ensemble methods like…
Terence Hsu
- 36
- 4