This document gives guidelines for assessing the overall performance of a quantitative descriptive panel and the performance of each panel member.<\/p>\n
This document is applicable to the validation of the training of individual assessors or panels, as well as to the performance monitoring of established panels.<\/p>\n
This document does not apply to the panel performance for descriptive methods where the individual scores of each assessor are not recorded, where there is no single list of attributes that is common to all the assessors, or where dominance rather than intensity is measured. Consequently, the performance of descriptive panels using methods such as consensus profile, free-choice profile, flash profile and temporal dominance of sensations (TDS) are out of scope.<\/p>\n
The methods specified in this document are for monitoring and assessing the ability of a panel and its assessors to discriminate between products, the agreement between assessors of the same panel and the repeatability of these assessors in their intensity scoring.<\/p>\n
Reproducibility, including both the comparison between panels and the comparison within the same panel of several evaluations conducted under different conditions (i.e. separated in time), is out of scope of this document.<\/p>\n
The methods specified in this document can be used, in full or a selection only, by the panel leader to appraise continuously the performance of panels or individual assessors. The methods listed are not exhaustive and other appropriate methods can also be used.<\/p>\n
| PDF Pages<\/th>\n | PDF Title<\/th>\n<\/tr>\n | ||||||
|---|---|---|---|---|---|---|---|
| 1<\/td>\n | 30444194 <\/td>\n<\/tr>\n | ||||||
| 53<\/td>\n | A-30382889 <\/td>\n<\/tr>\n | ||||||
| 54<\/td>\n | National foreword <\/td>\n<\/tr>\n | ||||||
| 56<\/td>\n | European foreword <\/td>\n<\/tr>\n | ||||||
| 58<\/td>\n | Foreword <\/td>\n<\/tr>\n | ||||||
| 60<\/td>\n | Introduction <\/td>\n<\/tr>\n | ||||||
| 61<\/td>\n | 1 Scope 2 Normative references 3 Terms and definitions <\/td>\n<\/tr>\n | ||||||
| 63<\/td>\n | 4 Principle 4.1 Two possible approaches 4.1.1 General 4.1.2 Performance measurement via a dedicated procedure <\/td>\n<\/tr>\n | ||||||
| 64<\/td>\n | 4.1.3 Ongoing monitoring via routine product profiling 4.2 Indicators of panel or individual assessor performance <\/td>\n<\/tr>\n | ||||||
| 65<\/td>\n | 4.3 Statistical analyses 5 Prerequisites 5.1 Experimental conditions 5.2 Qualification of assessors 6 Performance measurement via a dedicated procedure 6.1 Sample and attribute selection 6.2 Experimental designs 6.2.1 General <\/td>\n<\/tr>\n | ||||||
| 66<\/td>\n | 6.2.2 Randomized block design 6.2.3 Balanced and random designs 6.2.4 Same order design <\/td>\n<\/tr>\n | ||||||
| 67<\/td>\n | 6.3 Statistical analyses <\/td>\n<\/tr>\n | ||||||
| 69<\/td>\n | 6.4 Performance of the overall panel \u2014 Interpretation of statistical output 6.4.1 Key attribute discrimination 6.4.2 Agreement at panel level <\/td>\n<\/tr>\n | ||||||
| 70<\/td>\n | 6.4.3 Repeatability of the panel 6.5 Performance of individual assessors \u2014 Interpretation of statistical output 6.5.1 Discrimination ability of an assessor 6.5.2 Repeatability of an assessor 6.5.3 Consistency of an assessor <\/td>\n<\/tr>\n | ||||||
| 71<\/td>\n | 6.5.4 Agreement among assessors 6.5.5 Bias \u2014 Different use of scale 6.6 Performance issues 6.6.1 General <\/td>\n<\/tr>\n | ||||||
| 72<\/td>\n | 6.6.2 Panel 6.6.3 Individual assessor 6.7 Experimental design for following up the performance over time 7 Procedure for ongoing monitoring via routine product profiling 7.1 Attribute selection 7.2 Statistical analyses 7.3 Following up the performance over time 7.4 Statistical analysis of data over time <\/td>\n<\/tr>\n | ||||||
| 73<\/td>\n | 7.5 Statistical analysis of complete profiles <\/td>\n<\/tr>\n | ||||||
| 74<\/td>\n | Annex A (informative) Example of a practical application <\/td>\n<\/tr>\n | ||||||
| 82<\/td>\n | Bibliography <\/td>\n<\/tr>\n<\/table>\n","protected":false},"excerpt":{"rendered":" Tracked Changes. Sensory analysis. Methodology. Guidelines for the measurement of the performance of a quantitative descriptive sensory panel<\/b><\/p>\n |