PoMo: Generating Entity-Specific Post-Modifiers in Context
Table 2: Percent agreement with AIDA-light’s named entity disambiguation results.
['[EMPTY]', '[BOLD] AIDA Succ.', '[BOLD] Agreement']
We evaluate this simple heuristic by comparing the results to using an off-the-shelf entity linking system AIDA-light Nguyen et al. We find that AIDA-light agrees with our entity linking in 91.2% of the cases. AIDA-light is able to link 94.3% of the entities we found from NYTimes, but for CNN and DailyMail, it links only 87.0% and 86.34% of the entities, respectively. This decrease is likely due to the fact that AIDA-light was last updated in 2014 while the CNN/DailyMail datasets contain articles collected until the end of April 2015. On the other hand, NYTimes articles range from 1987 to 2007. Our heuristic seems to be reasonably reliable as it does not depend on anything else but the data sources: news articles and Wikidata.