On the Feasibility of Automated Detection of Allusive Text Reuse
Table 3: Comparison of soft cosine using FastText embeddings (SCemb), word2vec embeddings (SCw2v) and a random similarity baseline (SCrnd).
['Metric', 'Lemma', 'Model  [ITALIC] SCemb', 'Model  [ITALIC] SCw2 [ITALIC] v', 'Model  [ITALIC] SCrnd']
In order to test the specific contribution of the similarity function used to estimate S, we compare results with soft cosine using a random similarity matrix (Srnd) defined by Eq. set on Si,j={1i= j∼N(0.5,0.05)otherwise (10) We also investigate the effect of the word embedding algorithm by comparing to SCemb based on word2vec embeddings Mikolov et al. Moreover, a random approach produces strong results, only underperforming the word2vec model by a small margins, which questions the usefulness of the semantic relationships induced by word2vec for the present task.