Do Neural Models Learn Systematicity of Monotonicity Inference in Natural Language?
Table 7: All results on embedding monotonicity.
['[BOLD] Train', '[BOLD] Test', '[BOLD] BERT', '[BOLD] LSTM', '[BOLD] TreeLSTM']
This indicates that all models partially generalize to inferences containing embedded clauses one level deeper than the training set, but fail to generalize to inferences containing embedded clauses two or more levels deeper.