Predicting the Industry of Users on Social Media
Table 5: Kappa scores and double fault results of the base classifiers on development data.
['Text', '0.245', '0.338', '0.357', '0.366']
Lower values, especially values below 30%, mean smaller agreement. Since all five classifiers have better-than-baseline accuracy, this low agreement suggests that their predictions could potentially be combined to achieve a better accumulated result. The lower those numbers are, the greater the accuracy potential of any meta-classification scheme that combines those classifiers. Once again, the low double fault measure values suggest potential gain from a combination of the base classifiers into an ensemble of models.