An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extraction
Table 4: Ablation study of the scoring method of Algorithm 1 on Krapivin dataset. “Only gs,es,rs” means we do not use the scorer. “Only scorer” represents we directly use the scores predicted by the scorer as the final importance scores.
['Scoring Method', 'Total F1@10', 'Present F1@5', 'Absent R@10']
From this table, we note that after removing the scorer (i.e., “Only gs,es,rs”), both present and absent keyphrase prediction performance become worse, which demonstrates the effectiveness of the combination with the scorer. Moreover, if we totally ignore the previously obtained retrieval, extraction and generation scores, and only use the scorer to predict the final keyphrase importance score (i.e., “Only scorer”), we find the performance decreases dramatically, which indicates the indispensability of the previously obtained retrieval, extraction, and generation scores.