Quality Assurance & Compliance Flashcards
7 cards from real CAP practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Quality Assurance & Compliance flashcards as text
During model deployment, an analytics team discovers the production data pipeline delivers a feature in a different unit than the training data used. What quality assurance practice would most likely have caught this earlier?
Answer: Data validation checks comparing training and production schemas
Schema and data validation checks between training and production environments catch unit or format mismatches before deployment.
A CAP-certified analyst is asked to reuse customer data collected for billing purposes in a new marketing propensity model. What compliance concern should be addressed first?
Answer: Whether the original consent and purpose of collection permits this new use
Purpose limitation requires confirming that data collected for one purpose may lawfully and ethically be used for another.
Which technique is most appropriate for verifying that an analytics model's outputs remain reliable after it has been in production for six months?
Answer: Ongoing performance monitoring against holdout or fresh labeled data
Continuous monitoring against current labeled data detects drift and degradation that static tests cannot.
An analyst finds that a predictive hiring model systematically scores applicants from one demographic group lower despite similar qualifications. Under professional ethics standards, what is the appropriate first step?
Answer: Document and report the disparity to stakeholders before continued use
Ethical practice requires transparently documenting and escalating potential bias rather than concealing or ignoring it.
What is the primary purpose of maintaining an audit trail in an analytics project?
Answer: To enable reconstruction and verification of how results were produced
Audit trails record data sources, transformations, and decisions so results can be reproduced and verified.
A financial services analytics team must comply with regulations requiring model explainability. Which model governance artifact best supports this requirement?
Answer: Model documentation describing inputs, methodology, assumptions, and limitations
Comprehensive model documentation is the standard governance artifact demonstrating how and why a model makes decisions.
During quality review, two analysts independently run the same analysis script on the same data and get different results. What is the most likely quality issue to investigate first?
Answer: Uncontrolled environment differences such as software versions or random seeds
Non-reproducible results from identical inputs usually stem from environment, dependency, or seed differences.