Evaluating the word-expert approach for Named-Entity Disambiguation
Table 14: Performance on the 2010 test data, for our best dictionary and supervised classifier, broken down also for the news and web subsets.
['[EMPTY]', '[ITALIC] news', '[ITALIC] web', '[ITALIC] full']
Following the development phase, we tested our best dictionary and supervised classifier on the hidden (2010 test) dataset. This final evaluation confirmed that the heuristic dictionary already performs quite well (at 75%) overall, and that trained classifiers can tap into further improvements (scoring close to 85%). The improvement is larger on news, which is again more challenging that the web dataset. The results are similar to those of development, except for web, where results have dropped around 5 points.