Description Based Text Classification with Reinforcement Learning
Table 6: Error rates for different RL initialization strategies.
['[EMPTY]', 'Yahoo Answer', 'AAPD']
As can be seen, generally, initialization matters. The extractive model is more immune to initialization strategies, even random initialization achieves acceptable performances. This is because of the smaller search space for extractive models relative to abstractive models. For the random initialization of the abstractive model, we are not able to make it converge within a reasonable amount of time.