Identification of Tasks, Datasets, Evaluation Metrics, and Numeric Scores for Scientific Leaderboards Construction
Table 6: Ablation experiments results of TDMS-IE for Task + Dataset + Metric prediction.
['Document Representation', 'Macro P', 'Macro R', 'Macro F1', 'Micro P', 'Micro R', 'Micro F1']
To understand the effect of ExpSetup and TableInfo in document representation DocTAET for predicting TDM triples, we carry out an ablation experiment. We train and test our system with DocTAET containing only Title+Abstract, Title+Abstract+ExpSetup, and Title+Abstract+TableInfo respectively. We observe that both ExpSetup and TableInfo are helpful for predicting TDM triples. It also seems that descriptions from table captions and headers (TableInfo) are more informative than descriptions of experiments (ExpSetup).