next up previous
Next: Up: Previous:

Inductive Bias


Informal: Any preference on the space of all possible hypotheses other than consistency with training examples

Formal Definition:

The inductive bias of L is any minimal set of assertions B such that for any target concept c and corresponding training examples Dc

\begin{displaymath}(\forall x_i \in X) [(B \wedge D_c \wedge x_i) \vdash L(x_i,D_c)]

where $A \vdash B$ means A logically entails B