Multi-Source Domain Adaptation with Mixture of Experts
Table 5: Distribution of the metric values α on average for all tokens in the SANCL test set.
['Target', 'Source Twitter', 'Source Emails', 'Source Web']
As we can see, our model (MoE-A) effectively learns to decrease the weights on Twitter, demonstrating again its ability to alleviate negative transfer.