Improving CAT Tools in the Translation Workflow:New Approaches and Evaluation
Table 3: Cohen’s κ measuring agreement for the selected suggestion, editing time and number of edits.
['[EMPTY]', '[BOLD] Selected suggestions T1', '[BOLD] Selected suggestions T2', '[BOLD] Selected suggestions T3', '[BOLD] Editing time T1', '[BOLD] Editing time T2', '[BOLD] Editing time T3', '[BOLD] Number of edits T1', '[BOLD] Number of edits T2', '[BOLD] Number of edits T3']
Editing time and the selection of a specific suggestion (MT, TM, or translation from scratch) are parameters on which the translators do not agree. We computed Pearson’s correlation coefficient ρ, to test whether the total number of edits (with a low κ) is influencing the post-editing time (with a high κ). We achieved a ρ value of 0.10, not allowing us for a clear interpretation concerning correlation.