In the decision tree algorithm, why do we use a weighted average of child entropies when we calculate information gain? What is wrong about using the arithmetic mean of entropies?
Asked
Active
Viewed 83 times
3
-
Hi and welcome to AI SE! There are different decision tree algorithms. Which one are you referring to? – nbro May 13 '20 at 20:22
-
@nbro Thank you! Well, in more general sense rather than particular one. It's part of an exercise to be honest... – Krushe May 13 '20 at 22:08