Science and Validation Flashcards

An organization is conducting a validation study for a new Performance Profile. They administer the PeopleAnswers assessment to their current top-performing employees and simultaneously gather performance review data from their managers. What specific type of validity is being established in this scenario?

Answer: Concurrent Validity

Concurrent validity is established when the results of a new test correlate well with the outcomes of an established measure administered at approximately the same time. In this case, the assessment scores (the new test) are being compared against current performance data (the established measure), making it a concurrent validation study.

Which of the following best describes the psychometric concept of 'reliability' in the context of the PeopleAnswers/Infor Talent Science assessment?

Answer: The assessment results are consistent and repeatable if a candidate were to take it multiple times.

Reliability refers to the consistency of a measure. In psychometrics, a reliable assessment will produce similar results under consistent conditions. If a candidate took the assessment on Monday and again on Wednesday, the results should be very similar, indicating the test is reliable or consistent.

A company is concerned about potential bias in their hiring process. How does the science behind PeopleAnswers/Infor Talent Science help mitigate this risk and support fair hiring practices?

Answer: By using scientifically validated, data-driven models that are analyzed for adverse impact against protected groups.

The platform is built by I/O psychologists using scientific models and is designed for fair, evidence-based hiring. A key part of the validation process for any legally defensible assessment is conducting adverse impact analyses to ensure the tool does not disproportionately screen out members of protected classes as defined by the EEOC.

A validation study for a sales role reveals a strong positive correlation between high scores on the 'Ambition' trait and high quarterly sales numbers. This finding is an example of what?

Answer: Predictive Validity

Predictive validity is a form of criterion-related validity that shows how accurately an assessment can forecast a future outcome. In this case, the assessment trait ('Ambition') is shown to predict a future business outcome (sales performance), demonstrating its predictive validity for that specific role.

According to the Uniform Guidelines on Employee Selection Procedures (UGESP), if an assessment procedure results in a selection rate for a protected group that is less than four-fifths (80%) of the rate for the group with the highest selection rate, it is considered evidence of:

Answer: Adverse Impact

The UGESP established the "four-fifths" or "80 percent" rule as a rule of thumb for determining if there is evidence of adverse impact. Adverse impact occurs when a seemingly neutral employment practice disproportionately excludes members of a protected group.

An organization is building a new Performance Profile. The process involves having I/O psychologists analyze the duties and competencies relevant to the job and then mapping those to specific behavioral traits measured by the assessment. This process is primarily ensuring the assessment has what?

Answer: Job-Relatedness and Content Validity

Content validity refers to how well an assessment measures all relevant parts of the intended construct. By analyzing job duties and competencies, the psychologists ensure the Performance Profile is built upon traits that are directly related to the job. This job-relatedness is a foundational principle for creating a legally and scientifically defensible selection process.