One-to-X analogical reasoning on word embeddings: a case for diachronic armed conflict prediction from news texts
Table 2: Average recall of diachronic analogy inference
['[BOLD] Dataset', '[BOLD] @1', '[BOLD] @5', '[BOLD] @10']
A replication experiment In Table 2 we replicate the experiments from (Kutuzov et al., 2017) on both sets. It follows their evaluation scheme, where only the presence of the correct armed group name in the k nearest neighbours of the ˆi mattered, and only conflict areas were present in the yearly test sets. Essentially, it measures the recall @k, without penalizing the models for yielding incorrect answers along with the correct ones, and never asking questions having no correct answer at all (e.g., peaceful locations). The performance is very similar on both sets,