Are We There Yet? Evaluating State-of-the-Art Neural Network based Geoparsers Using EUPEG
Table 4. Evaluation results on Ju2016
['Geoparser', 'accuracy', 'mean', 'median', 'acc@161', 'AUC']
Results on Ju2016 Ju2016 is a corpus containing short sentences retrieved from various Web pages. This dataset was created by Ju et al. This corpus contains 5,441 entries in total and the average length of each entry is 21 words. This is a very difficult dataset, because the sentences are short (limited contextual information), place names are ambiguous, and upper and lower cases are not differentiated (all words are converted to lower case). Since this is an automatically created dataset, not all place mentions are annotated and as a result, precision, recall, and F1 score cannot be used as performance metrics.