Hypothesis Space Search by ID3

• Hypothesis space is complete!
  • Target function surely in there...

• Outputs a single hypothesis (which one?)
  • Can't play 20 questions...

• No back tracking
  • Local minima...

• Statisically-based search choices
  • Robust to noisy data...

• Inductive bias: approx ``prefer shortest tree''