EMNLP’18 Zero-Shot Open Entity Typing as Type-Compatible Grounding
Table 4: Comparing systems where no labels (types) are seen a priori (§4.3).
['Approach', '[ITALIC] F1typema', '[ITALIC] F1typemi']
We compare the quality of open typing, in which the target type(s) have not been seen before. We compare our system to OTyper, which relies on supervised data to create representations for each type; however, it is not restricted to the observed types. For each fold, mentions of only one type are used for evaluation, and the rest are used for training OTyper. To be able to evaluate on unseen types (only for this experiment), we use modified metrics F1typema and F1typemi In this experiment, we focus on a within-domain setting, and show the results of transfer across genres in the next experiments. We observe a significant margin between Zoe and other systems, including OTyper.