Durkheim Project Data Analysis Report
Table 5: Training Confusion Matrix, Group 1 vs. Group 2
['[EMPTY]', 'Predicted Grp 1', 'Predicted Grp 2']
Running the the classifier once, for a given set of parameters, results in a single model being created. The precise model, and its accuracy, depends on the training parameters, such as run-time, the number of features selected, the number of representations comprising the model, and other variables. In all cases (for all parameter settings), the resulting model fits the training data very well. When this model is evaluated on the test set, the accuracy and other measures are, of course, sharply lower. In essence, the model is over-fit on the train set.