Explaining Queries over Web Tables to Non-Experts
Table 4: User Study - Success Rates
['[BOLD] distinct questions', '[BOLD] explanations', '[BOLD] avg. success']
S7SS2SSS0Px1 User Study Our user study was conducted using anonymous workers recruited through the the Amazon Mechanical Turk (AMT) crowdsourcing platform. Focusing on non-experts, our only requirements were that participants be over 18 years old and reside in a native English speaking country. For each question, workers were shown explanations (utterances, highlights) of the top-7 candidate queries generated. Candidates were randomly ordered, rather than ranked by the parser scores, so that users will not be biased towards the parser’s top query. Given a question, participants were asked to mark the correct candidate query, or None if no correct query was generated.