Adaptation of a Lexical Organization forSocial Engineering Detection and Response Generation
Table 3: Impact of lexical resources on ask/framing detection: Thesaurus, STYLUS, LCS+
['[BOLD] Thesaurus', '[BOLD] P', '[BOLD] R', '[BOLD] F']
The GT is used to measure the precision/recall/F of three of three variants of ask detection output (Ask, Framing, and Top Ask) corresponding to our three lexica: Thesaurus, STYLUS, and LCS+. LCS+ is favored (with statistical significance) against the two very strong baselines, Thesaurus and STYLUS. F-scores increase for STYLUS over Thesaurus, and for LCS+ over STYLUS.