
The assessor as a measuring instrument
In sensory analysis the "instrument" is a human being, and the result depends on who exactly evaluates the product. ISO 8586:2023 "Sensory analysis — Selection and training of sensory assessors" distinguishes qualification levels:
| Assessor type | Who they are | Suitable tasks |
|---|---|---|
| Naive assessor | A person with no selection criteria or experience | Consumer tests (hedonics, CATA) |
| Initiated assessor | Has already taken part in sensory tests | Preliminary discrimination tests, QC in/out |
| Selected assessor | Has passed sensory-ability screening | Discrimination tests, batch screening |
| Trained assessor | Trained in specific methods and scales | Descriptive analysis (QDA, profiling) |
| Expert sensory assessor | Trained + proven long-term performance and deep category knowledge | Certification of reference standards, lexicon development, arbitration of disputed batches |
Typical panel sizes: a trained descriptive panel — 8–12 assessors (2–3 replicates), discrimination tests — 24–30 selected assessors, consumer hedonic tests — from 100 respondents with no training. Training an expert panel takes months — it is an investment, not a one-off campaign.
Screening: whom to admit to the panel
Selecting candidates is a multi-stage filter. Each step has an objective pass criterion.
- Questionnaire and interview — health, allergies, medication, smoking, motivation, time availability. Contraindications and unreliable attendance are screened out.
- Basic tastes (ISO 3972) — recognition of sweet (sucrose), sour (citric acid), salty (NaCl), bitter (caffeine) and umami (monosodium glutamate) in aqueous solutions; ranking concentration series by intensity.
- Smell (ISO 5496) — identification and ranking of odours (vanillin, lemon, clove, etc.), including with a pinched nose to separate taste from retronasal olfaction.
- Discrimination ability — a series of triangle tests on real products: the score is evaluated with a binomial criterion (calculator below).
- Descriptive ability — the skill of verbalizing sensations: "this is not just sweet, it is a caramel sweetness with a note of burnt sugar".
Training to ISO 8586:2023
Training turns a selected assessor into a "calibrated instrument". The programme builds from the general to the specific:
Sensory ABC: basic tastes and odours, the concept of intensity, working with scales, booth rules (no perfume, no talking, spitting).
Discrimination practice: triangle tests and ranking on category products with increasing difficulty; calibration on deliberately different samples.
Lexicon and references: the panel collectively builds a descriptor vocabulary (ISO 11035) and anchors a physical reference standard and its scale position for each descriptor.
Method training: practising the specific method (profiling, TDS) on training samples; comparing individual scores with the panel consensus.
Qualification: a candidate is admitted to working sessions if their scores are reproducible (repeatability across replicates), agree with the panel and discriminate between products. Then comes permanent monitoring.
The full cycle of preparing a descriptive panel usually takes from 2–3 months to half a year of regular sessions (1–3 per week). Saving on training means measuring noise instead of the product.
Panel performance monitoring: ISO 11132
A trained panel does not "work forever" — its metrology is controlled per ISO 11132:2021 through three criteria:
- Discrimination ability — does the assessor find differences between products: the p-value of the "product" factor in their individual ANOVA for each attribute.
- Agreement with the panel — do their scores correlate with the panel means; revealed through the "assessor × product" interaction.
- Repeatability — the spread of their scores for the same sample across replicates (individual MSE).
At the whole-panel level, additional tracking includes panel control samples from session to session, control charts of means and — for deep analysis — the MAM model (Mixed Assessor Model), which separates assessors into "core" ones, "scalers" (using the scale differently) and outliers.
Ethics, safety and panel retention
- Informed consent and the right to refuse any sample and leave the panel at any time without giving reasons and without sanctions; allergy and atopy screening before the first tasting (IFST, 2025 edition).
- Risk assessment before the test: special categories — novel foods, unapproved ingredients, products past their shelf life in shelf-life tests (microbiological safety is confirmed by a microbiologist, not by the assessor). Products returned from retail are not allowed for tasting.
- Minimizing deception: if the design requires concealing the test purpose, this is justified and recorded in advance; after the study, assessors are debriefed.
- Tasting hygiene: room-temperature water and neutral palate cleansers (unsalted crackers, bread) between samples; spitting is mandatory for long series and for products with carry-over effects.
- Workload limits: as a rule, no more than 6–8 samples per session for taste tests; no more than 1–2 sessions per day; no tasting during a cold and within an hour after eating, coffee or smoking.
- Motivation: regular feedback on personal performance (Compusense's feedback calendar is strong at this), a clear schedule and recognition of the panel's role in company decisions — otherwise the panel "burns out" within a year.
- Assessor data is personal data: storage and processing under Federal Law 152-FZ, anonymization in reports (codes instead of names).
Further reading
- IFST Guidelines for Ethical and Professional Practices (2025 edition, PDF) — a direct link to the guideline text: consent, risk assessment, assessor health. PDF
- Elgaard L. et al. A Comparison of Two Sensory Panels Trained with Different Feedback Calibration Range Specifications (2019) — how feedback calibration accelerates panel training; open access. article · OA
- The SensoMineR package for R — an open tool for panel monitoring: p–MSE profiles, consensus, repeatability (see the ISO 11132 section). tool
Test yourself
Three questions on panels
1. Quantitative descriptive analysis (QDA) requires a panel of…
QDA is a calibrated-panel method: 8–12 trained assessors, individual scores, replicates, ANOVA. A hundred consumers are needed for hedonic testing, not for profiling.
2. Under ISO 11132, an assessor's repeatability is evaluated through…
MSE across replicates is repeatability; p(product) is discrimination ability; correlation/interaction is agreement. Three different criteria.
3. A candidate completed a series of 15 triangle tests with 8 correct answers. Do they pass screening at α = 0.05?
Check with the calculator above: at n = 15, p₀ = 1/3 the critical number is 9; P(X ≥ 8) ≈ 0.089 > 0.05. "More than a third" is not enough — a statistical margin is needed.
Where to seat the panel and how to serve the samples
Module 03 covers facilities per ISO 8589, blind codes, balanced serving designs and the tasting plan generator.