Continual and Multi-Task Architecture Search
Table 5: Comparison of MAS cell on DiDeMO task.
['Cell Structure', 'Performance on DiDeMo M', 'Performance on DiDeMo C', 'Performance on DiDeMo B', 'Performance on DiDeMo R']
In these experiments, we first find the best ENAS cell structures for the individual MSR-VTT and MSVD tasks, and use these cell structures for training the DiDeMo task. Next, we find a single cell structure by training ENAS on both MSR-VTT and MSVD datasets jointly. It is clear that the multi-task cell performs better than other cell structures, where the multi-task cell performance is comparable w.r.t. the DiDeMo-ENAS cell and better than the other single-task and LSTM cell structures. This shows that a cell learned on multiple tasks is more generalizable to other tasks.