Exploring sentence informativeness
Table 3: FastText classifier’s probability to belong to the target word’s class compared with human annotation for a set of sentences. The target word is the verb "tell".
['[BOLD] Sentence', '[BOLD] Human score', '[BOLD] Classifier score']
The first two are definitions, assigned high informativeness scores by the annotators; however, the classifier does not recognize the first one as a highly informative sentence. The last sentence is instead classified as a tell-sentence with a very high probability even though humans did not find it informative.