Overfitting, and how to recognise it in your own work

overfitting

Overfitting is tuning a rule until it describes the noise in a particular history rather than anything that repeats. It is the central failure of strategy development because it is indistinguishable from progress while you are doing it: every adjustment improves the result you can see, and the improvement comes from the part that will not recur.