next up previous
Next: Up: Previous:

Information Gain


Gain(S,A) = expected reduction in entropy due to sorting on A



\begin{displaymath}Gain(S,A) \equiv Entropy(S)\ - \sum_{v \in Values(A)} \frac{\vert S_{v}\vert}{\vert S\vert} Entropy(S_{v}) \end{displaymath}


\psfig{figure=figures/dt-s1.ps}