Shortcut Sequence Tagging
Table 4: Comparsion of shortcut block combinations. Dense compositions (Type 2 and 5) performs better than sparse ones.
['[BOLD] Type', '[BOLD] Dev', '[BOLD] Test']
5.1.6 Comparison of Shortcut Block Compositions We find that shortcut block with span 1 (Type 2 and 5) perform better than other spans (Type 1, 3 and 4). In experiments, we use Type 2 as our default configuration since it is much easier to compute than Type 5.