Professional Documents
Culture Documents
Amd-01
1. Introduction
This report presents the results of the inter-laboratory comparison / proficiency testing program round PTS-
021, involving the temperature calibration of Digital Thermometer with thermocouple probe (K-Type) of with
twelve nos. of laboratories participating.
Inter-Laboratory proficiency testing program for calibration laboratories are valuable means for assessing
laboratories’ abilities to competently perform the prescribed calibration. Proficiency testing program provides
objective evidence that a laboratory can achieve the level of accuracy for which it is accredited or nominated.
Also provides a means for improving the quality and performance of laboratories and offers a unique chance
to verify their results together with their uncertainty calculation.
Temperature calibration is a crucial quantity in the establishment of traceability for the measurements which are
fundamental to the testing carried out by the industry. This strengthens the confidence among the national and
regional calibration services, the confidence of the laboratory in its own measurements and the customer’s
confidence in the services offered by the calibration laboratory.
This scheme (102-TCS) is conducted by Global Proficiency Testing Company, based in Dubai, United Arab
Emirates during the first quarter of year 2023. Participating in this kind of proficiency testing programs is
mandatory requirement of ISO 17025: 2017 for accredited laboratories and an essential aspect of laboratory
practice in all areas of testing, calibrations and inspections. Participation in proficiency testing schemes
provides laboratories with an objective means of assessing and demonstrating the reliability of the calibration
data they produce.
Participating in PT scheme is not the only, but one of the main quality assurance elements to assess
laboratory’s ability to perform calibrations competently. Therefore, accreditation bodies require accredited
laboratories to regularly participate in inter-laboratory proficiency testing programs to prove their ability to
perform calibrations accurately. Participation in PT Scheme is prerequisite of all accrediting bodies for granting
accreditation. The results from the Proficiency Testing Program can be useful for participating labs,
accreditation bodies, end users and various other organizations who use services of the labs. Successful
participation in a specific proficiency testing program can be a valid evidence of competence for that exercise.
Similarly, unsuccessful performance may reflect a random departure from a laboratory’s normal state of
competence.
3. Experimental Design
This program was designed for calibration laboratories (accredited or not or candidate for accreditation) having
calibration of thermometer in their scope of services. This proficiency testing scheme was organized in
accordance with the requirements of ISO 17043: 2010 and the results processing and participant performance
evaluation was conducted according to the guidelines as set in ISO 13258: 2022.
Results (as reported by participants) with corresponding summary statistics are presented in Section 12 of this
report including performance scores and illustrated graphically.
In this round of the PT Scheme total twelve participants took part. Participant’s locations are as given below.
• 7 participants are from Emirates of Dubai
• 2 participants are from the Emirates of Sharjah.
• 1 participant from Abu Dhabi.
• 1 participant from KSA.
• 1 participant from Qatar.
All of the participants are not accredited for this calibration. Some are candidates for accreditation in this task.
This is a Sequential participation schemes (sometimes known as measurement comparison schemes) involve
the proficiency test item being circulated successively from one participant to the next (i.e. sequential
participation), or occasionally circulated back to the proficiency testing provider for rechecking as explained in
ISO 17043: 2010: Annex A2. Model 1 in Figure A.1 provides a brief summary of this type of design.
As per requirements of this design a reference laboratory that is capable of providing a metrologically traceable
assigned value with sufficiently small measurement uncertainty and reliability for the proficiency calibration item
was used for this scheme. The reference lab was requested to carry out initial calibration of artefact. After that
the artefact was circulated to all participants one by one to calibrate the digital thermometer using their own
reference equipment which they used to calibrate the thermometers of their customers. Once the last participant
has performed their calibration the thermometer is sent back to the reference laboratory to make sure that the
artefact remains stable during the circulation period of the PT round.
Each participant was sent detailed “Instructions to participants” in advance to follow for calibration of the artefact
in this round of PT.
4. Artefact Description
The Artefact (digital thermometer) was having a range of -40 ºC to 1090 ºC with 0.1 ºC readability.
Asset Number of the artefact is DT-01 with serial no. 59820445WS, Make: Fluke and Model: Fluke -51-2 50HZ
PTS-021: Calibration of digital thermometer scheme “102-TCS” Page 2 of 17
Global Proficiency Testing Company, Office 3100, Schon Business Park, DIP-1, Dubai, United Arab Emirates.
Phone # +971-56-3405687 email: info@gptc.ae, Website: www.gptc.ae
Set points for calibration readings were -10 ºC, 3 ºC, 50 ºC, 250 ºC, 500 ºC, 750 ºC. during this round (PTS-
021) of PT.
The participants were allowed to calibrate all or leave any readings set point as per their requirements or
capability.
All participants were requested not to make any adjustment in artefact or change the settings except “zero
setting” during the calibrations.
5. Method of Calibration
The participants were advised to follow their routine / accredited methods for this calibration.
6. Calibration Results
The calibration results of artefact, which were submitted by all participating laboratories, are summarized in
Table 4 to Table 9 given in Section 12 of this report along with their lab code.
7.1 Reference Laboratory: - Metrology Department of Dubai Central Laboratory was given the role of the
reference laboratory (RL). The reference lab has better CMC than all the participants of this round of PT.
The reference laboratory is accredited by (EIAC) and its accreditation certificate number is LB-CAL- 001.
EIAC is one of the signatories to the Multilateral Agreement (MLA) for the recognition of calibration
certificates. The thermometer was calibrated by DCL at their premises of main laboratories.
7.2 Method of data analysis: - The purpose of this proficiency testing was to conduct an assessment of
laboratories performance by comparing their results with each other and against a reference value.
Quantitative analysis of test results is carried out in accordance with the recommendations of IS0 17043:
2010 “Conformity Assessment — General Requirements for Proficiency Testing” and ISO 13528: 2022
“Statistical Methods for the use in proficiency testing by inter-laboratory comparisons”. in accordance with
international practice, measurement performance has been assessed on the basis of En scores for each
measurement. En scores can be useful when an objective for the proficiency testing scheme is to evaluate
a participant’s ability to have results close to the assigned value within their claimed expanded uncertainty.
This statistic is conventional for proficiency testing in calibration.
All calculations were carried out on unrounded data values, therefore apparently some minor difference
can be observed however the values are correct. The Assigned values (“𝑥𝑥𝑅𝑅𝑅𝑅𝑅𝑅 “) and Uncertainty of Stability
were derived from Ref. Lab values as mentioned in below Clause 7.6.
Although the Uncertainty of stability was zero or almost negligible except at the set-point of 250 °C where
some instability (0.9°C difference) was observed, however all these observed uncertainty values were
added in the average expanded uncertainty of reference lab for performance evaluation (En-scores
calculations) (Table 1)
7.3 Consistency Check of Data: - Apparently all received data from participants was quite consistent and
there were no such values which can be considered as blunder. Also, the Reference values are
independent from the participants values, therefore owing to this fact Grubbs test (ISO 5725-2) was not
necessary to perform on data.
7.5 Graphical presentation of data: - Obtained En-Score for each participant is graphically presented in X-Y
scatter plot for easy visualization of data and to compare with En Action limits of ±1. Also, the results of
each participant’s measurement were plotted against the reference lab results and reference lab’s
uncertainty as X-Y scatter plots along participant’s reported “expanded uncertainties” for easy comparison
and understanding. Refer to Fig 2 to Fig 13. Stability analysis of the artefact during the period of round is
illustrated in Fig.1.
7.6 Stability Testing: - To ensure the stability of the artefact (Digital Thermometer) during the whole period of
this PT round (PTS-019), As mentioned above in clause 7.1 an accredited reference laboratory (DCL),
which was not part of the participants, calibrated the artefact (Thermometer) at the beginning and at the
end of the round (certificate ref. 569615 & 610836). The reference values were derived by taking the
averages of before and after calibration results from the Reference Lab. (Table 1). Difference in initial and
final readings were minor however the uncertainty of stability (Ustability) was calculated at each set-point
using the formula-1 and added to the final expanded uncertainty of reference lab to calculate the final
uncertainty of reference lab (Final U), which is considered during participant’s evaluation.
𝑈𝑈𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 = �
�𝑅𝑅𝑅𝑅𝑅𝑅𝑏𝑏𝑏𝑏𝑏𝑏𝑏𝑏𝑏𝑏𝑏𝑏 − 𝑅𝑅𝑅𝑅𝑅𝑅𝑎𝑎𝑎𝑎𝑎𝑎𝑎𝑎𝑎𝑎 �²
12
……………………Formula-1 *
*This Formula is Reported by Proficiency Testing Australia, Report No. 608–Mass Proficiency Testing Program–Round One May 2009
-10 -9 -9.1 -9.05 -1.0 -0.9 -0.95 0.2 0.2 0.20 0.029 0.229
3 3.6 3.6 3.6 0.6 0.6 0.60 0.2 0.2 0.20 0.000 0.20
250 249.9 250.8 250.35 -0.1 0.8 0.35 0.2 0.2 0.20 0.260 0.46
500 499.9 500.3 500.1 -0.1 0.3 0.10 0.9 0.9 0.90 0.115 1.02
750 754.2 754.3 754.25 4.2 4.3 4.25 2.5 2.5 2.50 0.029 2.53
4.0
3.0
Deviation (°C)
2.0 Initial
Cablibration
1.0
0.0 Final
Calibration
-1.0
-2.0
-50 0 50 100 150 200 250 300 350 400 450 500 550 600 650 700 750 800
Calibration Set Points (°C)
9. Calculation of En Scores
Monitoring of laboratory’s performance is conducted as per ISO/IEC 13528: 2022, based on the matching and
comparison with reference values of RL by means of En Scores. For all results this value has been calculated
as per the formula -2 as given below.
𝒙𝒙 − 𝑿𝑿𝑹𝑹𝑹𝑹𝑹𝑹
𝑬𝑬𝒏𝒏 =
�𝑼𝑼𝟐𝟐 𝑳𝑳𝑳𝑳𝑳𝑳 + 𝑼𝑼𝟐𝟐 𝑹𝑹𝑹𝑹𝑹𝑹 ……………………………Formula-2
9.1 As per guidelines of ISO 17043: 2010: Annex B.4.1 the statistical determination of performance based on
En -Score is done as given below.
for En Scores:
For all results the En Score has been calculated using above formula 2. A result to be acceptable the En Score
(also called En number) should be equal to or less than 1, consequently, the Red Highlighted values in table-3
are unsatisfactory / outlier results (i.e En ≤ 1 = satisfactory and En > 1 = unsatisfactory). These participants are
requested to investigate the root cause of the outlier results, implement appropriate corrective action and a
report shall be available for reviewing/checking by assessment team from accrediting body during their nearest
next assessment visit.
Satisfactory
Unsatisfactory
x Not participated
11. References
11.1 ISO 13528: 2022 Statistical Methods for the Use in Proficiency Testing by Inter-Laboratory Comparisons.
11.2 ISO/IEC 17043: 2010 - Conformity Assessment — General Requirements for Proficiency Testing.
11.3 ISO 5752: Part 2: Accuracy (trueness and precision) of measurement methods and results.
11.4 ISO Guide 35: 2017 Reference materials - Guidance for characterization and assessment of homogeneity
and stability
11.5 IUPAC-2006 The International Harmonized Protocol for the Proficiency Testing of Analytical Chemistry
Laboratories
Lab Nominal Av. Ref. Final Ref. Avg Ref. Error Lab's Reading Lab's "U" Lab - Ref
Lab's En
Code Temp. (°C) Reading (°C) "U" (°C) (°C) (°C) (°C) (°C)
Fig.2
Temperature Data (-10 °C): X-Y Scatter plot, En Scores against Action limit
1.5
1.0
0.5
En Score
0.0
-0.5
-1.0
-1.5
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Temperature (-10 °C) Lower Action Limit Upper Action Limit Xref
-8.6
-8.7
-8.8
-8.9
-9
-9.1
-9.2
-9.3
-9.4
-9.5
-9.6
-9.7
-9.8
-9.9
-10
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Lab's Reading (°C) Av. Ref. Reading (°C) Final Ref. "U" (°C)
Av. Ref.
Lab Nominal Final Ref. Avg Ref. Lab's Reading Lab's "U" Lab - Ref
Reading Lab's En
Code Temp. (°C) "U" (°C) Error (°C) (°C) (°C) (°C)
(°C)
1.0
0.5
0.0
En Score
-0.5
-1.0
-1.5
-2.0
-2.5
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Temperature (3 °C) Lower Action Limit Upper Action Limit Xref
Fig. 5
Temp. 3 °C: Lab's Results & Exp. uncertainty against Ref. Value & Expanded Uncertainty
4.6
4.4
4.2
Lab's Temperature Readings (3 °C)
4
3.8
3.6
3.4
3.2
3
2.8
2.6
2.4
2.2
2
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Lab Nominal Av. Ref. Final Ref. Avg Ref. Lab's Reading Lab's "U" Lab - Ref
Lab's En
Code Temp. (°C) Reading (°C) "U" (°C) Error (°C) (°C) (°C) (°C)
Fig. 6
Temperature Data (50 °C): X-Y Scatter plot, En Scores against Action limit
2.0
1.5
1.0
0.5
En Score
0.0
-0.5
-1.0
-1.5
-2.0
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Temperature (50 °C) Lower Action Limit Upper Action Limit Xref
50.5
50.4
50.3
50.2
50.1
50.0
49.9
49.8
49.7
49.6
49.5
49.4
49.3
49.2
49.1
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Lab's Reading (°C) Av. Ref. Reading (°C) Ref U±
1.0
0.5
0.0
-0.5
-1.0
-1.5
-2.0
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Temperature (250 °C) Lower Action Limit Upper Action Limit Xref
Fig. 9
250 °C : Lab's Results & expanded uncertainty against Ref. Value & Expanded Uncertainty
252.25
252
Lab's Temperature Readings (250 °C)
251.75
251.5
251.25
251
250.75
250.5
250.25
250
249.75
249.5
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Fig. 10
Temperature Data (500 °C): X-Y Scatter plot, En Scores against Action limit
2.0
1.5
1.0
0.5
En Score
0.0
-0.5
-1.0
-1.5
-2.0
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Temperature (500 °C) Lower Action Limit Upper Action Limit Xref
501.5
501
500.5
500
499.5
499
498.5
498
497.5
497
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Lab's Reading (°C) Av. Ref. Reading (°C) Ref U±
Nominal Av. Ref. Final Ref. "U" Avg Ref. Lab's Reading Lab's "U" Lab - Ref.
Lab Code Lab's En
Temp. (°C) Reading (°C) (°C) Error (°C) (°C) (°C) (°C)
0
-0.5
-1
-1.5
-2
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Temperature (750 °C) Lower Action Limit Upper Action Limit Xref
Fig. 13
Temp. 750 °C : Lab's Results & expanded uncertainty vs Ref. Lab & Expanded Uncertainty
758
757
Lab's Temperature Readings (750 °C)
756
755
754
753
752
751
750
Lb284
Lb285
Lb286
Lb287
Lb288
Lb289
Lb290
Lb291
Lb292
Lb293
Lb294
Lb300
Note: This report is amended on July 7, 2023 because of a typing error in table-3 on page 07 of 17 of this report, where performance
scores were corrected for Lb293.