Annotating and Extracting Synthesis Processof All-Solid-State Batteries from Scientific Literature
Table 5: F1 scores of the sequence labeling models with Mat-ELMo on the development dataset by type. Material and Property indicate macro-averaged F1 scores of each fine-grained types, respectively. ALL is the macro-averaged scores of three coarse-grained types (i.e., Material, Operation, and Property in this table).
['Types', 'F1', 'P', 'R']
Among the Material types, Material-Start achieved the highest F1 score of 0.887. The F1 score of Operation was 0.821, which was higher than the average. Among the Property types, Property-Time achieved the highest F1 score of 0.928. However, the F1 score of Material-Intermedium was 0.105 in the sequence tagging, which were 11 phrases incorrectly detected as Material-Start, and 21 phrases as Material-Final out of the 36 phrases. This may be because it is difficult to extract Material-Intermedium without understanding the whole structure of the synthesis process.