Doctoral Advisor or Medical Condition:Towards Entity-specific Rankingsof Knowledge Base Properties[Extended Version]Conference version published at ADMA 2017
Table 6: Interestingness scores in varying contexts.
['[EMPTY]', 'sport', 'Setup 1 0.65', 'Setup 2 0.80', 'Difference +0.15']
The setups were given to 20 crowdworkers each. For each of the 6 player-property pairs (Ronaldo/Gogia and sport/website/spouse), we then measured the difference in interestingness as stated by the crowd. In each of the 6 cases, the properties achieved a higher interestingness when presented with the 7 unimportant ones first, with an average score difference of 0.19 per pair. For instance, for Ronaldo, the property spouse received an interestingness score of 0.35 in Setup 1, and 0.50 in Setup 2. In total, out of the 120 votes given in each setup, in Setup 1, 51 were given for interesting, while in Setup 2, 74 were given for interesting. This leads us to the conclusion that pointwise interestingness scores are highly dependent on the context in which they are presented, and that without specific setups that ensure stability of context, pointwise scores collected today cannot be interpreted easily interpreted tomorrow.