Attentive Representation Learning with Adversarial Training for Short Text Clustering
TABLE II: The default settings for ARL-Adv.
['[ITALIC] K', '|D [ITALIC] batch|', '[ITALIC] α', '[ITALIC] ϵ']
We have also tried to leverage the power of BERT to initialize the word embeddings and fine-tune BERT along with the training of ALR-Adv. However, no improved performance is observed in the local tests of several hyper-parameter settings. K is the dimenstion of embeddings, and |Dbatch| is the size of a batch. Unless otherwise stated, the results will be reported under this setting.