Studying the Wikipedia Hyperlink Graphfor Relatedness and Disambiguation
Table 2: Partial view of dictionary entry for “gotham”. The probability is calculated as the ratio between the frequency and the total count.
['Article', 'Freq.', 'Prob.']
We built our dictionary from the same Wikipedia dump, using article titles, redirections, disambiguation pages, and anchor text. Mention strings are lowercased and all text between parentheses is removed. If an anchor links to a disambiguation page, the text is associated with all possible articles the disambiguation page points to. Each association between a mention and article is scored with the prior probability, estimated as the number of times that the mention occurs in an anchor divided by the total number of occurrences of the mention as anchor. Note that our dictionary can disambiguate any mention, just returning the highest-scoring article.