Quality Assurance & Compliance Flashcards
7 cards from real CAP practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Quality Assurance & Compliance flashcards as text
Before presenting analytics results, an analyst realizes a key assumption of the chosen statistical method was violated. The quality-conscious response is to:
Answer: Assess the impact, use an appropriate alternative method or caveat the results
Violated assumptions must be evaluated and either remedied with suitable methods or transparently disclosed as limitations.
Which scenario represents a conflict of interest that a CAP professional must disclose?
Answer: Evaluating a software vendor in which the analyst holds a significant financial stake
A personal financial interest in an entity being evaluated compromises objectivity and must be disclosed.
What is the purpose of a champion-challenger framework in model governance?
Answer: Continuously comparing the production model against candidate alternatives under controlled conditions
Champion-challenger testing benchmarks the incumbent model against challengers to ensure the best-performing model is in production.
A data scientist wants to test a model on real customer records in a shared development environment. What compliance-aligned practice should be applied?
Answer: Use masked, anonymized, or synthetic data in non-production environments
Non-production environments should use de-identified or synthetic data to prevent unauthorized exposure of personal information.
During final review, an analyst notices the executive summary overstates model certainty compared to the technical findings. The correct action is to:
Answer: Revise the summary so stated confidence matches the analytical evidence
Communications must accurately reflect the strength and uncertainty of the underlying analysis.
Which metric-tracking practice best supports early detection of data drift in a deployed model?
Answer: Monitoring input feature distributions over time against training baselines
Comparing live input distributions to training baselines flags drift before it degrades outcomes.
A regulator requests evidence that an analytics model was independently validated. Which artifact best satisfies this request?
Answer: A validation report authored by a party independent of the model's developers
Independent validation requires review by parties without a stake in the model's development, documented in a formal report.