Keyphrase Generation: A Text Summarization Struggle
Table 3: Rouge scores of predicted keyphrases by various methods
['[BOLD] Method', '[BOLD]  Hulth (500) Krapivin (400) Meng (20K) OAGK (100K)  [ITALIC]  [BOLD] R [BOLD] 1 [ITALIC]  [BOLD] F [BOLD] 1', '[BOLD]  Hulth (500) Krapivin (400) Meng (20K) OAGK (100K)  [ITALIC]  [BOLD] R [BOLD] L [BOLD] F [BOLD] 1', '[BOLD]  Hulth (500) Krapivin (400) Meng (20K) OAGK (100K)  [ITALIC]  [BOLD] R [BOLD] 1 [ITALIC]  [BOLD] F [BOLD] 1', '[BOLD]  Hulth (500) Krapivin (400) Meng (20K) OAGK (100K)  [ITALIC]  [BOLD] R [BOLD] L [BOLD] F [BOLD] 1', '[BOLD]  Hulth (500) Krapivin (400) Meng (20K) OAGK (100K)  [ITALIC]  [BOLD] R [BOLD] 1 [ITALIC]  [BOLD] F [BOLD] 1', '[BOLD]  Hulth (500) Krapivin (400) Meng (20K) OAGK (100K)  [ITALIC]  [BOLD] R [BOLD] L [BOLD] F [BOLD] 1', '[BOLD]  Hulth (500) Krapivin (400) Meng (20K) OAGK (100K)  [ITALIC]  [BOLD] R [BOLD] 1 [ITALIC]  [BOLD] F [BOLD] 1', '[BOLD]  Hulth (500) Krapivin (400) Meng (20K) OAGK (100K)  [ITALIC]  [BOLD] R [BOLD] L [BOLD] F [BOLD] 1']
Abs works slightly better reaching scores from 10.24 to 14.75 %. PointCov is the best of the text summarizers producing keyphrase predictions that are usually clean and concise with few repetitions. This is probably the merit of the coverage mechanism. There is still a considerable gap between PointCov and CopyRnn. CopyRnn is still the best but PointCov is close. Abs scores are also comparable to those of Maui and Yake!. TopicRank, Merge and Inject are again the worst.