Question Understanding Tool (QUAID)
The Question Understanding Tool (QUAID) is a software tool that assists survey methodologists, social scientists, and designers of questionnaires in improving the wording, syntax, and semantics of questions. The tool identifies potential problems that respondents might have in comprehending the meaning of questions on questionnaires. These problems can be scrutinized by researchers when they revise questions to improve question comprehension and, thereby, enhance the reliability and validity of answers. QUAID tool picks up problems related to unfamiliar technical term, vague or imprecise relative term, vague or ambiguous noun phrase, complex syntax and working memory overload. The output of QUAID was compared with ratings of language experts who evaluated a corpus of questions on the five classes of problems. The corpus consisted of 505 questions on 11 surveys developed by the US Census Bureau. Analyses of hit rates, false alarm rates, d’ scores, recall scores, and precision scores revealed that QUAID was able to identify these five problems with questions.
QUAID can be accessed here: Question Understanding Tool