Research & Evidence-Based Practice Flashcards
7 cards from real Software Testing practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Research & Evidence-Based Practice flashcards as text
Which research method involves observing software teams in their natural work environment without manipulating variables?
Answer: Ethnographic study
Ethnographic studies observe practitioners in their real environment to understand behaviors and practices without researcher intervention.
When a testing research paper reports a 'p-value < 0.05', what does this conventionally indicate?
Answer: The result is statistically significant under the null hypothesis at a 5% threshold
A p-value below 0.05 means there is less than a 5% probability of observing the result if the null hypothesis were true, meeting the conventional significance threshold.
What is 'publication bias' and why is it relevant to evidence-based software testing?
Answer: The tendency for positive results to be published more often, skewing the available evidence
Publication bias inflates apparent effectiveness of techniques because negative or null results are less likely to be published.
In a survey-based software testing study, what is 'response bias'?
Answer: Participants answer in ways they believe are expected rather than reflecting their true experience
Response bias occurs when participants skew answers toward socially desirable or expected responses rather than honest ones.
What does 'effect size' measure in a software testing experiment, and why does it matter beyond p-values?
Answer: The practical magnitude of a difference between groups, independent of sample size
Effect size quantifies how large a difference is in practical terms, whereas a p-value only indicates whether it is statistically distinguishable.
Which of the following is a key advantage of using 'case studies' in software testing research?
Answer: They capture rich contextual details from real industrial projects
Case studies provide in-depth, contextual insights from actual projects, revealing practical nuances that controlled experiments may miss.
What is the role of a 'research protocol' in a systematic mapping study of software testing techniques?
Answer: It documents the search strategy, inclusion/exclusion criteria, and data extraction process before the study begins
A research protocol pre-specifies the methodology to ensure reproducibility and reduce researcher bias in systematic mapping studies.