Extending a Parser to Distant Domains Using a Few Dozen Partially Annotated Examples
Table 3: Parsing performance on Brown verticals. MSP refers to the Minimal Span Parser (Stern et al., 2017a). Charniak refers to the Charniak parser with reranking and self-training (Charniak, 2000; Charniak and Johnson, 2005; McClosky et al., 2006a). MSP + Stanford POS tags refers to MSP trained and tested using part-of-speech tags predicted by the Stanford tagger (Toutanova et al., 2003).
['[BOLD] Section', '[BOLD] F1  [BOLD] RSP', '[BOLD] F1  [BOLD] MSP + Stanford POS tags', '[BOLD] F1  [BOLD] MSP + gold POS tags', '[BOLD] F1  [BOLD] Charniak']
To determine whether this increased portability is because of the parser architecture or the use of ELMo vectors, we also run MSP on the Brown verticals. We learned that most of the improvement can be attributed to the ELMo word representations. In fact, even if we use MSP with gold POS tags, the average performance is 3.4% below RSP.