Eliciting Knowledge from Experts: Automatic Transcript Parsing for Cognitive Task Analysis
Table 2: Performance of sequence labeling models, evaluated on manual matching testset. LM-LSTM-CRF is shown as w/ LM, with different character level hidden size.
['Model', 'Tok. Acc.', 'Men. P', 'Men. R', 'Men. F1']
Evaluation. The LM-LSTM-CRF which contains character level language model is even worse (shown as w/ LM in table, with different character level hidden size). One reason could be the neural models require a large scale dataset to train, while our dataset does not meet this requirement.