Inductive Bias in ID3

Note H is the power set of instances X

$\rightarrow$Unbiased?

Not really...

• Preference for short trees, and for those with high information gain attributes near the root

• Bias is a preference for some hypotheses, rather than a restriction of hypothesis space H

• Occam's razor: prefer the shortest hypothesis that fits the data