CSA Panel Training & Management 2 — Questions and Answers
Question 1: In panel performance monitoring using ANOVA, a large and significant 'panelist × product interaction' term most likely indicates that:
- Panelists agree closely on how products differ from each other
- Panelists disagree on the relative rank order of products across attributes (Correct answer)
- The products evaluated are too similar to differentiate
- The panel has excellent calibration and repeatability
Correct answer: Panelists disagree on the relative rank order of products across attributes
A significant panelist × product interaction means different panelists perceive the relationships among products differently, signaling poor panel agreement that requires retraining.
Question 2: Which multivariate statistical technique is most commonly used to visualize inter-panelist agreement and identify outlying panelists in descriptive analysis data?
- Chi-square analysis
- Principal Component Analysis (PCA) (Correct answer)
- Mann-Whitney U test
- Kaplan-Meier analysis
Correct answer: Principal Component Analysis (PCA)
PCA reduces the multidimensional attribute data to a few principal components, allowing the analyst to visualize whether panelists cluster together (agreement) or scatter (disagreement) in the score space.
Question 3: Panel calibration in the context of descriptive sensory analysis primarily refers to:
- Adjusting the environmental conditions of sensory booths to ISO standards
- Ensuring panelists apply scale anchors consistently and reach agreement on attribute intensities (Correct answer)
- Updating the panel's attribute vocabulary on a defined schedule
- Calibrating preparation equipment such as balances and pipettes
Correct answer: Ensuring panelists apply scale anchors consistently and reach agreement on attribute intensities
Panel calibration focuses on aligning panelists' use of the rating scale so that a given intensity perceived by one panelist corresponds to the same numerical rating used by all others.
Question 4: When a panelist consistently assigns higher intensity ratings to all attributes compared to the rest of the panel session after session, the most appropriate management response is to:
- Remove the panelist from the study immediately to avoid data contamination
- Provide individual feedback and retraining using reference standards to realign scale use (Correct answer)
- Apply a mathematical correction factor to that panelist's scores before analysis
- Reassign the panelist to consumer acceptance testing where absolute scale use is less critical
Correct answer: Provide individual feedback and retraining using reference standards to realign scale use
Individual feedback sessions using physical reference standards allow the panelist to realign their scale anchors with the group, preserving panel size and retaining trained talent.
Question 5: The concept of 'panel drift' in longitudinal sensory studies refers to:
- Changes in product formulation that occur between study time points
- Gradual, cumulative shifts in how panelists use scales or define attributes over time (Correct answer)
- Day-to-day variation in panelist scores due to circadian rhythm effects
- Random measurement error that increases as the study duration lengthens
Correct answer: Gradual, cumulative shifts in how panelists use scales or define attributes over time
Panel drift is a systematic, directional change in scoring patterns across time rather than random error, often caused by evolving use of references or unconscious recalibration within the group.
Question 6: A control chart applied to sensory panel data is most useful for:
- Displaying the frequency distribution of scores across all panelists at one time point
- Monitoring an individual panelist's scores over time to detect trends or sudden shifts in performance (Correct answer)
- Comparing two panels on the same product set
- Determining the minimum number of panelists needed for statistical significance
Correct answer: Monitoring an individual panelist's scores over time to detect trends or sudden shifts in performance
Control charts plot individual measurements against time with control limits derived from historical data, making them ideal for detecting out-of-control performance in ongoing panels.
Question 7: Which measure is used to evaluate a panelist's within-session repeatability in a replicated descriptive analysis design?
- The panelist main effect F-ratio
- The residual (error) variance from replicated ANOVA (Correct answer)
- The product × session interaction term
- The between-panelist standard deviation
Correct answer: The residual (error) variance from replicated ANOVA
The residual or error term in a replicated ANOVA captures the within-panelist variation across replicates of the same product, directly reflecting individual repeatability.
CSA Panel Training & Management 2
In panel performance monitoring using ANOVA, a large and significant 'panelist × product interaction' term most likely indicates that: