Generating Politically-Relevant Event Data
Table 3: Data source type and size
['Dataset', 'Sentences']
Each of the “soft-labelled” datasets has QuadClass labels applied to them by PETRARCH2. The use of PETRARCH2 is necessary in order to generate enough training samples for the various classification algorithms to gain leverage over the classification task. The English corpus consists of data scraped from various online news media sites. The Arabic corpus labels are obtained via the use of a sentence-aligned English/Arabic corpus. Thus, if a sentence is labelled as Material Conflict in the English corpus, that label is transferred to the aligned sentence in the Arabic corpus. If multiple alignments occur the label is transferred to each of the relevant sentences. These datasets provide information for three experiments: English-language, Arabic-language, and machine translated English.