IntentsKB: A Knowledge Base of Entity-Oriented Search Intents
Table 2. Refiner categorization results.
['Feature Set', 'Accuracy']
Our dataset consists of 4,490 instances labelled with one of the four intent categories. For obtaining the search results exploited by many features, we utilize the Google Search API. In a preliminary round, we experimented with a variety of classifiers. Results are reported only for the best performing classifier, which is Random Forests. We used the following parameters: the number of trees is 100 and the maximum depth of the trees is approximately the square root of the feature set used in that setting. We find that semantic features perform better than lexical features. When combining the two, the resulting performance is inferior to using semantic features alone. Therefore, we only the use semantic feature group in the remainder of our experiments.