AliCoCo: Alibaba E-commerce Cognitive Concept Net
Table 3. Experimental results of different sampling strategy in hypernym discovery.
['Strategy', 'Labeled Size', 'MRR', 'MAP', 'P@1', 'Reduce']
When it achieves similar MAP score in four active learning strategies, we can find that all the active learning sampling strategies can reduce labeled data to save considerable manual efforts. UCS is the most economical sampling strategy, which only needs 325k samples, reducing 35\% samples comparing to random strategy. It indicates that high confident negative samples are also important in the task of hypernym discovery.