Demand-Weighted Completeness Prediction for a Knowledge Base
Table 4: Results for the three methods for the D3large dataset using the intersection metric. The difference between the methods is similar to the Jaccard measure above.
['Model', 'Freq.', 'Regr.', 'NN']
These show a similar trend to the Jaccard scores, with lower absolute values from the stricter evaluation metric. Although the Jaccard measure shows correct relation set prediction with a precision of 0.700, predicting the proportions for those relations accurately remains a difficult problem. The best value we achieved was 0.398.