Interpreting Evidence and Data Questions and Answers Flashcards
7 cards from real Watson-Glaser Critical Thinking Appraisal practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Interpreting Evidence and Data Questions and Answers flashcards as text
A clinical trial reports that a new drug reduced symptoms in 40% of patients compared to 30% on placebo. The p-value is 0.04. What is the most accurate interpretation?
Answer: The result is statistically significant, suggesting the difference is unlikely due to chance, though clinical importance should also be assessed
Statistical significance at p<0.05 indicates the result is unlikely to be random chance, but clinical significance (the size and practical value of the effect) must also be evaluated.
A graph shows violent crime falling every year for a decade. A politician says 'our new policing program, launched 2 years ago, is working.' What is the key interpretive issue?
Answer: Crime was already declining before the program started, so attributing the trend to the program is premature
The pre-existing downward trend existed before the intervention, making it impossible to credit the program without isolating its specific effect.
A study finds that people who floss daily have fewer heart attacks. Before concluding flossing protects the heart, what must be considered?
Answer: People who floss daily may share other health habits that reduce heart attack risk
Daily flossing may be a marker of overall health-consciousness, meaning better diet, exercise, and other habits — not flossing itself — could explain the outcome.
A report states that School X's test scores improved 20 points after adopting a new curriculum. However, 30% of the lowest-scoring students transferred out that year. What does this suggest?
Answer: The score increase may be partly or entirely explained by a change in the student population, not the curriculum
When lower-performing students leave a group, average scores rise mechanically — this is sometimes called compositional change or a selection effect.
A researcher publishes data showing a positive result. Ten other teams tested the same hypothesis and found no effect, but did not publish. What problem does this illustrate?
Answer: Publication bias, where positive results are more likely to be published, making the evidence base misleadingly favorable
Publication bias skews the literature toward positive findings, making interventions appear more effective than the full body of evidence would support.
A data table shows that 9 out of 10 dentists recommend Brand X toothpaste. What question is most important to ask before accepting this as strong evidence?
Answer: How the dentists were selected, how many were surveyed, and what question they were actually asked
Survey results depend critically on sampling method, sample size, and exact question wording — all of which affect the validity and generalizability of the statistic.
A company's accident rate dropped from 8% to 4% after mandatory safety training. An analyst notes that the company also hired a new safety officer at the same time. What should the analyst conclude?
Answer: The improvement cannot be attributed solely to training because the safety officer's role is a confounding variable
When multiple changes occur simultaneously, isolating the effect of any single variable requires study designs that separate those variables.