Explainable Authorship Verification in Social Media via Attention-based Similarity Learning This work was in significant parts performed on a high performance computing cluster at Bucknell University through the support of the National Science Foundation, Grant Number 1659397.
TABLE II: Average verification error rates and standard deviations for the test set over a 5-fold cross-validation. Only results for which the systems reported a high reliability are considered.
['labels', '[ITALIC] d( [ITALIC]  [BOLD] y1, [ITALIC]  [BOLD] y2)≤ [ITALIC] τs and  [ITALIC] d( [ITALIC]  [BOLD] y1, [ITALIC]  [BOLD] y2)≥ [ITALIC] τd Hrsn', '[ITALIC] d( [ITALIC]  [BOLD] y1, [ITALIC]  [BOLD] y2)≤ [ITALIC] τs and  [ITALIC] d( [ITALIC]  [BOLD] y1, [ITALIC]  [BOLD] y2)≥ [ITALIC] τd Hrsn', '[ITALIC] d( [ITALIC]  [BOLD] y1, [ITALIC]  [BOLD] y2)≤ [ITALIC] τs and  [ITALIC] d( [ITALIC]  [BOLD] y1, [ITALIC]  [BOLD] y2)≥ [ITALIC] τd AdHominem', '[ITALIC] d( [ITALIC]  [BOLD] y1, [ITALIC]  [BOLD] y2)≤ [ITALIC] τs and  [ITALIC] d( [ITALIC]  [BOLD] y1, [ITALIC]  [BOLD] y2)≥ [ITALIC] τd AdHominem']
In addition to overall error rate counts, we are also reporting the degree to which the Siamese network topologies are able to decide with a high level of reliability. If the feature vector tuples (y1,y2)=(\includegraphics[width=7.74pt]{% pics/A.eps},\includegraphics[width=7.74pt]{pics/A.eps}) or (y1,y2)=(\includegraphics[width=7.74pt]{% pics/A.eps},\includegraphics[width=8.6pt]{pics/B.eps}) of two texts have a distance d(y1,y2) below τs or above τd then we may assume that the system attaches a high reliability to its decision. If the distance is between τs and τd, however, then we may still arrive at a decision by comparing the distance to τs+τd2, but the decision would carry much less “confidence”. We are separately reporting on the performance of AdHominem and Hrsn regarding cross-topic and same topic cases. With both Siamese topologies we may reduce the error rate below 1%. It should be noted, however, that this holds for only a limited number of cases in our test set.