Data Cleaning for XML Electronic Dictionaries via Statistical Anomaly Detection
TABLE IV: Overlap of the anomalies most strongly proposed by the length ratio and the transliteration systems.
['Number of Proposed Errors', 'Number of Common Results', 'Percent']
This table allows us to evaluate the similarity between the two systems. The two systems do not have a high degree of similarity; for example, only 4 of the top 100 anomalies detected by the length ratio system also appear in the top 100 anomalies detected by the transliteration system. The low levels of overlap indicate that the systems have complementary behavior. This complementary behavior can be leveraged to build improved hybrid systems.