DocParser: Hierarchical Structure Parsing of Document Renderings
Table 2: Comparison of entity detection (average precision).
['AP', 'IoU=0.5 Baseline', 'IoU=0.5 WS', 'IoU=0.5 WS+FT', 'IoU=0.65 Baseline', 'IoU=0.65 WS', 'IoU=0.65 WS+FT', 'IoU=0.8 Baseline', 'IoU=0.8 WS', 'IoU=0.8 WS+FT']
Entity Detection For IoU=0.5, the default DocParser achieves a mAP of 50.4. This is higher than DocParser WS with a mAP of 35.6. We attribute this to the fact that several entity categories from arXivdocs-target are not part of arXivdocs-weak. Notably, the fine-tuned system DocParser WS+FT results in significant performance improvements: it obtains a mAP of 69.1, which, in comparison to the default DocParser, is an improvement by 37.1%. On top of that, DocParser WS+FT outperforms consistently the default DocParser system across all measured IoU thresholds. Using IoU thresholds above 0.5 leads to a performance decrease. Even though higher IoUs should generally correspond to better matches with the ground truth, they can penalize ambiguous cases and thus a correct detection. In sum, this confirms the effectiveness of our weak supervision in bolstering the overall performance. For DocParser WS+FT, we observe an especially good performance for detecting tables (i. e., table and tabular categories). This is owed to our strong initialization of our system due to the high quality and the large number of samples in our scalable weak supervision.