Exploratory Analysis of Highly Heterogeneous Document Collections
Table 3: LDA performance with respect to military critical technologies. Low precision (in bold) and general intolerance to false negatives in this domain motivate our use of multiple information facets.
['[BOLD] Critical Technology', '[BOLD] Precision', '[BOLD] Recall', '[BOLD] F-Score']
LDA Performance on Critical Technologies. A true positive is defined as placement into an appropriately labeled cluster having a majority of the documents pertaining to the same militarily critical topic (as judged by a SME). Critical documents placed into clusters with largely non-critical and possibly unrelated documents are considered false negatives. Non-critical documents appearing in a cluster of largely critical documents are considered false positives. Note the low precision for Technology-Z resulting from 84 of the 89 critical documents being placed into a larger cluster of non-critical documents. Since these non-critical documents were indirectly related to the topic covered by Technology-Z, LDA was unable to distinguish them from the truly critical documents. All 89 of these critical documents, however, were ultimately located with help from other facets such as Top Folders and Top Discovered Keywords.