Towards Question Format Independent Numerical Reasoning: A Set of Prerequisite Tasks
Table 2: Example questions where domain knowledge is required to answer a question.
['[BOLD] Question', '[BOLD] Knowledge Required', '[BOLD] Answer']
: This dataset includes problems which need the usage of rule-like numeric domain knowledge such as formulae. This sets a higher bar on the ability of a model to use numeric knowledge. In this dataset, we add a significant number of questions belonging to few simple concepts. This can help in assessing the capability of language models to solve science questions involving a small number of concepts. However, our dataset creation framework can be easily extended to create questions from a larger set of concepts. We create chemistry questions covering the concepts of balancing the reactions and molecular weight computation of compounds. We create such questions from a set of 90 reactions and 53 compounds. From Physics, we create numerical questions involving the speed, distance and time.