DocParser: Hierarchical Structure Parsing of Document Renderings
Table 3: Performance in predicting hierarchical relations (as measured by F1).
['[EMPTY]', 'IoU=0.5 Baseline', 'IoU=0.5 WS', 'IoU=0.5 WS+FT', 'IoU=0.65 Baseline', 'IoU=0.65 WS', 'IoU=0.65 WS+FT', 'IoU=0.8 Baseline', 'IoU=0.8 WS', 'IoU=0.8 WS+FT']
The best performance (across all Ψ) is achieved by DocParser WS+FT with an IoU of 0.5: it registers an F1 score of 0.481. Here the use of weak supervision with fine-tuning yields consistent improvements. In particular, for an IoU of 0.5, it outperforms the F1 score of the default system (F1 of 0.377) by 0.104. This amounts to a relative improvement of 27.6 %. Again a smaller IoU threshold of 0.5 seems beneficial. As structure parsing builds on the prior detection of document entities, higher IoU thresholds further reduce the overall parsing performance.