Multi-branch Attentive TransformerThis work is conducted at Microsoft Research Asia.
Table 10: MRPC validation accuracy w.r.t. ρ.
['[ITALIC] ρ', '0.1', '0.2', '0.3', '0.4', '0.5']
Drop branch also plays a central role on NLU tasks. We take the MRPC task as an example. MRPC achieves the best result at ρ=0.3.