Unsupervised Latent Tree Induction with Deep Inside-Outside Recursive Autoencoders
Table 2: NLI unsupervised unlabeled binary constituency parsing comparing to CoreNLP predicted parses. PRPN F1 was calculated using the parse trees and results provided by Htut et al. (2018). F1 median and max are calculated over five random seeds and the top F1 value in each column is bolded. Note that we use median rather than mean in order to compare with previous work.
['[BOLD] Model', 'F1 [ITALIC] median', 'F1 [ITALIC] max', '[ITALIC] δ']
Using the heuristic, DIORA greatly surpasses both variants of PRPN. A second caveat is that SNLI Bowman et al. Syntactic parsers often suffer significant performance drops when predicting outside of the newswire domain that the models were trained on.