You are on page 1of 37

AC7101/1 REV.

G∆2
Issued 1993-05
161Thorn Hill Road
Warrendale, PA 15086-7527
AUDIT CRITERIA
Revised 28-JAN-2019

Editorial ‘∆’ Change 09-JUL-2019

Superseding AC7101/1 REV. F


Nadcap
AUDIT CRITERIA FOR MATERIALS TESTING LABORATORIES
GENERAL REQUIREMENTS FOR ALL LABORATORIES
K*TO BE USED ON AUDITS STARTING ON OR AFTER 05-MAY-2019*

1. SCOPE

This Audit Criteria was developed by the Nadcap Materials Testing Laboratories Task Group
(MTLTG), for the evaluation of testing facilities for Nadcap Materials Testing Laboratories
Accreditation Program. While the criteria in this checklist may appear redundant with
ISO/IEC 17025 and/or 9100 audit criteria, the Task Group determined that its aerospace
auditors needed to assess compliance from the aerospace perspective. This Audit Criteria is
applicable to all laboratories. Supplemental checklists provide additional detailed criteria on
the specific test methods. Quality systems requirements for MTL Audits are covered in
Section 2 of this document.

The MTL Audit Handbook and the corresponding Handbook Supplements for each checklist
provide many details to ensure a successful audit experience. The Handbook and
Supplements should be used as companions to the Audit Criteria. The Handbook and
Supplements are located on www.eAuditNet.com under Resources → Documents → Audit
Criteria → Materials Testing Laboratories (AC7101/AC7006) → Handbooks & Guides.

Written customer requirements always take precedence over Nadcap audit criteria.

This section is for the use of auditors, as necessary, for notes during the audit. No NCRs will
be written against section 1.

1.1 Audit Category

Initial

Full Scope – Reaccreditation

SV1 – Reaccreditation

SV2 – Reaccreditation

PRI operating procedures provide that "This report is published by PRI to advance the state of technical, engineering, and quality
sciences. The use of this report is entirely voluntary, and its applicability and suitability for any particular use, including any patent
infringement arising there from, is the sole responsibility of the user."

PRI values your input. To provide feedback on this document, please contact the appropriate commodity staff engineer.
(Contact information is located at http://www.eauditnet.com under “Contact Us”.)
Copyright 2019 Performance Review Institute. All rights reserved.
t-frm-15 08-Oct-2019
Nadcap AC7101/1 Revision G∆2 - 2 -

Add Scope

Verification

Self/Internal Audit

1.2 Audit Scope

AC7006

AC7101/1

AC7101/2

AC7101/3

AC7101/4

AC7101/5

AC7101/6

AC7101/7

AC7101/9

AC7101/11

AC7102/8

AC7109/5

AC7110/13

AC7110/13S

1.3 OPEN / CLOSE Meeting Attendance

Any additional Auditor Objective Evidence

2. ACCREDITATION REQUIREMENTS

2.1 The laboratory demonstrates compliance to an acceptable quality YES NO


system as defined in PD 1100, OP 1114, and OP 1114 Appendix MTL.

2.1.1 The following is to be documented by the Auditor. (At least one


acceptable quality system is required to be confirmed/documented.)

2.1.1.1 (INFO) ISO/IEC 17025 SECTION NA

2.1.1.1.1 (INFO) Auditing/Accreditation Agency: _______________

2.1.1.1.2 (INFO) Certificate Issue Date: _______________


Nadcap AC7101/1 Revision G∆2 - 3 -

2.1.1.1.3 (INFO) Certificate Expiration Date: _______________

2.1.1.2 (INFO) AC7006 SECTION NA

2.1.1.2.1 (INFO) Auditing/Accreditation Agency: Performance Review Institute

2.1.1.2.2 (INFO) Certificate Issue Date: _______________

2.1.1.2.3 (INFO) Certificate Expiration Date: _______________

2.1.1.3 (INFO) 9100 SECTION NA


Plus, completion of AC7101/1 Appendix A. (Only acceptable for captive
labs)

2.1.1.3.1 (INFO) Auditing/Certifying Agency: _______________

2.1.1.3.2 (INFO) Certificate Issue Date: _______________

2.1.1.3.3 (INFO) Certificate Expiration Date: _______________

2.1.1.4 (INFO) AC7004 SECTION NA


(Only acceptable in some cases – see notes below.)

2.1.1.4.1 (INFO) Auditing/Accreditation Agency: Performance Review Institute

2.1.1.4.2 (INFO) Certificate Issue Date: _______________

2.1.1.4.3 (INFO) Certificate Expiration Date: _______________

2.1.1.5 (INFO) The name and address of the facility matches that on the YES NO
certificate?

2.1.1.6 (INFO) The above certificate/information has been reviewed, recorded


in this checklist, and verified by the auditor.
Nadcap Materials Testing Laboratories recognizes quality systems
approvals in the form of ISO/IEC 17025 accreditation by an ILAC
Approved source (www.ilac.org) or AC7006 issued by the Materials
Testing Laboratories Task Group.
For captive laboratories, Nadcap Materials Testing Laboratories also
recognizes 9100 certifications by registrars that are approved and listed
in the IAQG Oasis database (www.iaqg.org/oasis). Note: 9100
accredited captive laboratories must also meet the requirements of
AC7101/1 Appendix A. Where no recognized quality systems approvals
exist, Nadcap requires assessment using AC7006 Audit Criteria
Equivalent to ISO/IEC 17025. MTL Suppliers performing only specimen
machining for mechanical testing (AC7101/7 test code Z, Z3 only) shall
have a quality system in accordance with Nadcap PD1100 (e.g.
AC7004, AC7006, 9100 or ISO/IEC 17025).
Nadcap AC7101/1 Revision G∆2 - 4 -

2.2 The following information is available:

2.2.1 Personnel Information: A summary or summaries of personnel which YES NO


perform the accredited test methods. The information shall include the
following:
•Name and job title
•Test codes
•Qualifications (education, training or examinations)
•Years of laboratory testing experience

2.2.2 Procedure Information: A summary or summaries of procedures used YES NO


to perform the accredited test methods. The information shall include
the following:
• Test type
• Test code or method
• Identification of procedures used for testing
• Current revision of procedures at time of current audit

2.2.3 IRR/PT Information: A summary or summaries of IRR/PT activity which YES NO


support the accredited test methods. The information shall include the
following:
• Test type
• Test code or method
• Name of proficiency testing provider
• Reference of the last PT report (for quick retrieval of the report during
audit)
oDate(s) PT was performed
oDescription of any outliers
• Reference of the last IRR/operators report (for quick retrieval of the
report during audit)
oDate(s) IRR was performed
oDescription of any outliers
• Reference of the last IRR/equipment report (for quick retrieval of the
report during audit)
oDate(s) IRR was performed
oDescription of any outliers

2.3 Procedure(s) are used to ensure Nadcap notification in accordance YES NO


with OP 1107.

2.4 Self-Audit:

2.4.1 Did the Auditee upload a copy of their completed self-audit, and other YES NO
pre-audit documents as applicable, to eAuditNet at least 30 days prior
to the audit, utilizing the version of the checklist(s) applicable to this
audit?

2.4.2 For each question in the self-audit checklist, has the auditee identified YES NO
where the means of compliance or evidence of compliance may be
found. Evidence constitutes, for example, reference to a procedure,
checklist or the physical location of evidence.
Nadcap AC7101/1 Revision G∆2 - 5 -

2.4.3 Does the self-audit include Observation of Test as defined in OP 1114 YES NO
Appendix MTL?
The MTL TG requires documentation of at least one (1) Observation of
Test for each Test Code within the auditees’ scope of accreditation.
The self-audit shall include all audit criteria within the auditees’ scope
of accreditation.

2.5 INFORMATION FOR AUDITOR: A minimum of one Observation of YES NO


Test is performed by the PRI auditor for each testing method in the
scope of accreditation within the course of two audits. Each test was
performed in accordance with the applicable procedures and/or test
specification.
Note: Observations of Test will be documented by the PRI auditor in
the “Job Tracker” in eAuditNet.

2.6 INFORMATION FOR AUDITOR: A minimum of three job audits were YES NO
performed by the PRI auditor.
It is expected the PRI auditor will choose the Jobs to be included in the
review.
Note: Job Audits are not documented in the “Job Tracker” in eAuditNet.

2.6.1 Job audits meet requirements below:

2.6.1.1 Laboratory received and documented customer requirements. YES NO

2.6.1.2 Test requirements are accurately documented in laboratory testing YES NO


documentation (routers/travelers/other ways to communicate testing
requirements to test operators.

2.6.1.3 Laboratory performed required testing in accordance with its YES NO


procedures and/or customer requirements.

2.6.1.4 Certificate and report unit conversions are in accordance with YES NO
documentation for the methods of data unit conversion, if applicable,
or different from test specification.

2.6.1.5 Certificate and report rounding methods are in accordance with YES NO
documentation for rounding method if not defined by / referenced by, or
different from test specification.

3. FACILITY (GENERAL)

3.1 Environmental conditions in the laboratory are in accordance with test YES NO
technical requirements such as to facilitate correct performance of the
tests and/or calibrations.

3.2 Environmental conditions are monitored, controlled and recorded as YES NO NA


required by the laboratory’s quality management system, international
standard, test standard and customers requirements.

3.3 Cleanliness of the test area minimizes contamination. YES NO


Nadcap AC7101/1 Revision G∆2 - 6 -

3.4 Employees demonstrate compliance to applicable safety program. YES NO

3.5 Facility operations affecting specific testing:

3.5.1 Procedures ensure notification of customers in the event of interruption YES NO


due to power outage, equipment failure, or other condition that has an
effect on the test results being reported.

4. QUALITY SYSTEM DOCUMENT (MANUAL)

4.1 Procedures are used to ensure records are available within the YES NO
customer’s required time frame. If no requirement, a time frame shall
be defined by the laboratory.

4.2 A procedure is used to control records (technical data and test reports) YES NO
generated by the laboratory in compliance with customer requirements
including record retention policy.

4.3 Records (technical data) are maintained, traceable to each certification, YES NO
such that the laboratory could reproduce the test method or identify
incorrectly tested material.

4.4 Current revisions of laboratory test procedures are used. YES NO

4.5 Laboratory management defines responsibility for the review and YES NO
approval of test results, training and qualification of personnel, and
procedures.

5. QUALITY ASSURANCE FUNCTION (Q.A.)

5.1 The Q.A. function in the laboratory has stop-work/stop-ship authority. YES NO

5.2 The Q.A. function participates in the organization or planning of YES NO


equipment definition and selection.

5.3 The Q.A. function participates in the organization or planning of YES NO


maintenance and calibration of test facilities and equipment.

5.4 The Q.A. function participates in the management (creation, revision, YES NO
implementation, etc.) of test procedures.

5.5 The Q.A. function has authority to require the implementation, YES NO
extension or modification of internal technical documents.

5.6 The Q.A. function oversees training and qualification of personnel. YES NO

5.7 The Q.A. function participates in the organization or planning of YES NO


subcontractor selection and survey.

6. TRAINING AND QUALIFICATION OF PERSONNEL


Nadcap AC7101/1 Revision G∆2 - 7 -

6.1 Qualification and training of laboratory personnel complies with YES NO


laboratory quality manual and/or procedures, applicable customer
requirements and is documented.

6.2 Qualification of laboratory personnel includes documented periodic YES NO


“observations of test” for each operator and Nadcap test code
(including machining and specimen preparation) to assess the
employee’s adherence to procedures used for Nadcap test codes.

6.3 Individual training records and supporting procedures indicate YES NO


participation in inter-operator comparison as defined by the laboratory.

6.4 Operators are trained to recognize proper operation of the equipment. YES NO

6.5 Operators are trained to recognize a properly executed analysis or test, YES NO
to distinguish between valid and invalid test data, and to justify
invalidating data.

6.6 If degreed personnel “or equivalent” are required, definition of YES NO


“equivalent” is documented.

7. EVALUATION, APPROVAL, AND SURVEY OF SUBCONTRACTORS SECTION NA

7.1 Subcontractor evaluation is based on Nadcap or ILAC-approved YES NO


ISO/IEC 17025 accreditation, customer qualification list, or all of the
following:
•An initial survey by the Q.A. function for a Quality Management
System based on an internationally recognized standard.
•Documented periodic on-site surveys by the Q.A. function.
•100% inspection is acceptable or sampleInspection of product/service
as per customer requirements.

7.2 Access to subcontractor facilities is provided to the laboratory for YES NO


quality audits if requested.

7.3 Applicable quality assurance requirements specified in the contract are YES NO
transmitted to subcontractors.

8. PROCEDURE SYSTEM

8.1 Procedure(s) are used for calibration of all Measuring and Test YES NO
Equipment (M&TE) used for testing or producing results.

8.2 A procedure is used to review the requirements presented to the YES NO


laboratory, however defined. The procedure addresses:
•how the requirements are assessed
•how the requirements are effectively communicated to the laboratory
•how the laboratory determines if the requirements can be met
Note: For captive labs, this pertains to how the requirements are
directly communicated to the laboratory and does not include full
traceability through the company to end-customer requirements.
Nadcap AC7101/1 Revision G∆2 - 8 -

8.3 Procedures are used to ensure the use of ASTM E 29 for determination YES NO
of rounding conformance to specification requirements unless
otherwise stated in the certification or report.

8.4 Procedures define methods and test specifications used to perform YES NO NA
data unit of measure conversions.

8.5 Procedures are used to ensure all software programs and equipment YES NO NA
automation used to calculate results are validated, prior to initial use.
On legacy equipment a validation shall be defined in a lab procedure.

8.5.1 Documented evidence of validation is demonstrated. YES NO NA

8.6 Commercial spreadsheets (as example Excel) or similar lab-generated YES NO NA


spreadsheets or macros, which are used to calculate results, are
validated by the laboratory.

8.6.1 Documented evidence of validation is demonstrated. YES NO NA

8.7 Procedures are used to ensure purchased equipment control software YES NO NA
has revision control and that only a validated revision is used for testing
and data analysis/compilation/reporting.

8.8 Procedures are used to ensure lab-generated/modified software, used YES NO NA


for recording, calculation, or conversion of test results, has revision
control and validation.

8.9 Procedures that are used for each test method reference the source of YES NO
the requirement. For example: specific industry standard(test
specification) or customer specification.

8.10 Procedures contain detail such that a test can be consistently YES NO
repeated.

8.11 Details required to reproduce non-standard tests are documented and YES NO NA
traceable to the test report/results.

8.12 Procedures are used to ensure technical revisions of standards YES NO


publications (e.g. ASTM, EN, ISO and any other revision controlled
documents used within test method procedures) in the laboratory’s
scope of accreditation are implemented/incorporated within six months
from the date the revised standard/document is published. If the
standard has not previously been utlilzed for testing, the test standard
shall be reviewed before first use (the 6 month implementation period
does not apply for the initial review). A record of revision review is
maintained which includes date of reference document revision, date of
laboratory incorporation, brief summary of actions taken to
demonstrate the revision review was completed. No documented
revision review is required for non-technical revisions (i.e. “reaffirmed”
standards).
Nadcap AC7101/1 Revision G∆2 - 9 -

9. EQUIPMENT CALIBRATION AND MAINTENANCE

9.1 Calibration

9.1.1 Calibration cycle extension: When calibration frequencies are changed, YES NO NA
procedures are used in accordance with NCSL (National Conference of
Standard Laboratories), recommended Practice 1, or other recognized
statistical review process to support the extended time interval. Any
calibration cycle extensions are in accordance with standard methods
or customer requirements.

9.1.2 Calibration: The laboratory uses a calibration schedule with frequencies YES NO
in accordance with manufacturers’ recommendations, AppendixF, or
the individual checklist requirements for all internal and external
calibrations performed on testing equipment. This schedule documents
duration between calibrations (frequency) and responsibility for
calibration (source).

9.1.3 Calibration: Procedures are used during calibration certificate review to YES NO
ensure the following:
•calibration certificates document the name and address of the agency
performing the calibration (if an external supplier is used).
• calibration suppliers approved by the laboratory’s quality
management system are used (if an external supplier is used).
•description(s) of equipment and operating range(s), including the
precision of the instrument, are documented on the calibration
certificate.
• primary standards or equipment are documented on the calibration
certificate and are traceable to a national standard.
• the calibration method is documented on the calibration certificate.
• the date of calibration is documented on the calibration certificate.
• the "as found" and "as left" conditions are documented on the
calibration certificate when the instrument was adjusted or repaired
during the course of calibration.
• the calibration personnel are documented on the calibration
certificate.
• the environmental conditions are documented on the calibration
certificate where required by standard/spec/customer.

9.1.4 Calibration: Calibration status is identified for each test machine or YES NO
associated laboratory equipment requiring calibration.

9.1.5 Calibration: Procedures are used to address the calibration and use of YES NO NA
“employee-owned” Measuring and Test Equipment (M&TE).

9.1.6 Calibrations not performed by the laboratory are performed by an YES NO NA


ISO/IEC 17025 accredited source. Alternatively calibration may be
performed by an OEM using ISO/IEC 17025 compliant procedures
(certified reference used for calibration shall be references to an
International Standard(s) i.e. NIST). The laboratory is responsible for
verifying compliance.
Nadcap AC7101/1 Revision G∆2 - 10 -

9.1.7 Calibrations performed by an internal calibration department (or YES NO NA


laboratory) shall use a documented procedure for calibration in
accordance with calibration requirements in ISO/IEC 17025 (certified
reference used for calibration shall be traceable to an International
Standard(s) i.e. NIST).

9.2 Maintenance

9.2.1 Maintenance: Procedures are used to ensure planned maintenance of YES NO


measuring equipment is performed to ensure proper functioning and in
order to prevent contamination or deterioration.

9.2.2 Maintenance: Procedures are used to ensure maintenance records YES NO


identify the maintenance plan, maintenance activities to date, any
damage, malfunction, modification, adjustment or repair to the
equipment.

9.2.3 Maintenance: Procedures are used to identify equipment which is out YES NO
of service.

9.2.4 Maintenance: Procedures are used to assess the possible effect on YES NO
test values when maintenance is performed to address a malfunction of
calibrated equipment.

10. SPECIMEN IDENTIFICATION AND TRACKING SYSTEM

10.1 Unique identification is assigned to each test specimen in accordance YES NO


with a procedure. The identification is retained throughout the life of
the test specimen and is traceable to the final documentation.

10.2 Transfer of work outside the laboratory for sub-contracted processes is YES NO
performed in accordance with procedures which ensure (1) traceability
of documents/records with test articles is maintained and (2)
verification that work performed was in accordance with purchase order
requirements.

11. REPLACEMENT TESTING AND RE-TESTING

11.1 Procedures are used to define and ensure retesting is performed in YES NO
accordance with material specification or customer requirements.

11.2 Procedures are used to ensure replacement tests are recorded and YES NO
cross-referenced with the original tests, including explanations where
applicable.
Note: Only a single replacement test is required in response to an
invalid test. See definitions in Audit Handbook.

11.3 Procedures are used to ensure records of invalid tests are reviewed YES NO
periodically for trends which could indicate test process deterioration.
The auditee shall define and document the period of review and what
constitutes a trend.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 11 -

11.4 Procedures are used to respond to defined criteria for test process YES NO
deterioration which required corrective action.

12. CERTIFICATE OF TEST/CERTIFICATE OF CONFORMANCE/TEST REPORTS

12.1 The certificate of test/test report meets the requirements of the YES NO NA
applicable test specification or/and customer requirements.

12.2 The certificate of test/test report includes the name and address of the YES NO
laboratory, and the location where the tests and/or calibrations were
executed, if different from the address of the laboratory.

12.3 The certificate of test/test report includes the name and address of the YES NO NA
customer.

12.4 The certificate of test/test report includes identification of the test article YES NO
and if provided identification and issue(s)/revision(s) of the material
specification(s) used for conformance disposition. (Example: Inco 718,
AMS5662 Rev H).

12.5 The certificate of test/test report identifies the testing specification or YES NO
procedure used, if not called out by the material specification. Non-
standard practices shall be documented.

12.6 The certificate of test/test report includes the numerical results of all YES NO
tests and inspections performed for which the material specification
establishes numerical requirements.

12.7 Test values on the certificate of test/test report are reported to the YES NO
number of digits according to the test method or material specification
resolution or other documented customer requirements. If there are
multiple requirements called out for comformance, the most stringent
resolution shall be reported.

12.8 The certificate of test/test report includes descriptions of the results YES NO NA
(e.g., conform/non-conform) of all tests for which the material
specification or customer specification/requirement does not establish
numerical requirements.

12.9 Any unusual observations are noted on the certificate of test/test report YES NO NA
(and identified as such, e.g. as “Observation”) in accordance with
customer requirement.

12.10 Test results for all specimens in the same set are included on the same YES NO
certificate of test/test report; that is, separate certificates of test/test
reports are not issued for conforming versus nonconforming material.

12.11 The certificate of test/test report includes appropriate description of test YES NO
specimens (quantity, form, and condition, etc), when applicable, and all
identification necessary to assure traceability of laboratory report to the
material supplier/customer records (e.g., sample number, heat
number, lot number, P.O. number).

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 12 -

12.12 The certificate of test/test report includes a statement that it shall not YES NO
be reproduced except in full without the written approval of the
laboratory.

12.13 The certificate of test/test report includes each page numbered "page YES NO
__ of__ ".

12.14 The certificate of test/test report includes unique identification traceable YES NO
to the laboratory identification system.

12.15 Procedures are used to address errors, corrections, and modifications YES NO
to certifications and test reports. Corrected or modified reports shall be
re-issued, and the lab shall have a method of identifying the change(s).
Manual/hand-written corrections to reports are not permitted.

12.16 The certificate of test/test report includes re-test values, and values YES NO
known to be nonconforming (i.e., when compared against mandatory
specification values), and they shall be clearly identified as such.

12.17 The certificate of test/test report includes documentation of all test YES NO
articles provided to the laboratory for testing. Example of test without
results: "Specimen 4A253: No Test - broke in grips”. Test values from
replaced specimens are not required to be reported.

12.18 The certificate of test/test report is traceable to the request to perform YES NO
work.

12.19 The certificate of test/test report includes a statement of conformity, YES NO


acceptance limits (when mandated by the customer), and source of the
acceptance limits (e.g. specification, drawing, purchase order, etc.). If
there are no acceptance limits, it is annotated for information only or
similar wording, unless otherwise mandated by the customer.

12.20 The certificate of test/test reports includes description(s) of any YES NO


applicable thermal treatments performed by the laboratory.

12.21 Computer generated certificates of test/test reports require either (a) YES NO
an actual or facsimile signature, or (b) a letter accompanying the
certificate, signed by the laboratory's representative attesting that the
laboratory is using a computerized system, the typed name on the
document is an authorized employee, and the laboratory is responsible
for the information it contains. If a laboratory uses computer-generated
certificates with an actual or facsimile signature, or typed name, the
system has security (password or other identity control) to ensure the
name on the document represents the individual who performed the
indicated function.

12.22 The certificate of test/test report documents a statement of YES NO


conformance when testing is performed for conformance to material
specifications.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 13 -

12.23 Procedures are used to detect and correct transcription errors prior to YES NO
the release of the certificate/test report.

12.24 Procedures are used to address revision of certificates of test/test YES NO


reports and notification of customers if errors in the certificate and/or
errors in testing are found after the certificate of test/test report has
been issued. Customers are notified in the manner and within the time
period defined by the customer or laboratory procedure in the absence
of a customer requirement.

13. PROFICIENCY TESTING AND INTERNAL ROUND ROBIN REQUIREMENTS

Participation in proficiency testing (PT) and internal round robins (IRR)


is required. Frequency and performance requirements are given in
AC7101/1 Appendix B. Selection of proficiency test providers is
described in AC7101/1 Appendix C. Testing protocol for IRR is
described in AC7101/1 Appendix D.
Note: SPC or Gage R&R may be performed in lieu of IRR, see
AC7101/1 Appendix D.

13.1 Internal Round Robin Testing

13.1.1 The internal round robin program meets the established requirements YES NO
as described in AC7101/1 Appendix D. If Gage R&R and/or SPC
and/or Calibration Method are used in lieu of IRR, these meet the
requirements as described in AC7101/1 Appendix D.

13.1.2 Internal round robin programs are in place to compare testing YES NO NA
equipment used for the same test/method, if required. (See AC7101/1
Appendix B for frequency and requirements). If Gage R&R and/or SPC
and/or Calibration Method are used in lieu of IRR, these meet the
requirements as described in AC7101/1 Appendix D.

13.1.3 Internal round robin programs are in place to compare testing YES NO NA
personnel performing the same test/method, if required. (See
AC7101/1 Appendix B for frequency and requirements). If Gage R&R
and/or SPC are used in lieu of IRR, these meet the requirements as
described in AC7101/1 Appendix D.

13.1.4 Participation in the internal round robin program meets the frequency YES NO
requirements for all test codes held by the laboratory as described in
AC7101/1 Appendix B. If Gage R&R and/or SPC and/or Calibration
Method are used in lieu of IRR, these meet the requirements as
described in AC7101/1 Appendix D.

13.1.5 Procedures are used to ensure participation in Internal Round Robin YES NO
Programs and/or Gage R&R and/or SPC and/or Calibration Method –
including analysis of the results against defined acceptance criteria.

13.2 Proficiency Testing

13.2.1 Procedures ensure participation in Proficiency Testing Program(s) YES NO

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 14 -

13.2.2 The laboratory used a Proficiency Testing provider in accordance with YES NO
AC7101/1 Appendix C.

13.2.3 The participation of the laboratory in Proficiency Testing Program(s) is YES NO


documented.

13.2.4 Participation in the Proficiency Testing meets the frequency YES NO


requirements for all test codes held by the laboratory (see Table 1 of
AC7101/1 Appendix B).

13.3 Statistical Analysis

13.3.1 Statistical analysis and correlation of the data are performed and YES NO
documented for both internal round robin testing (or Gage R&R, SPC
and/or Calibration when used in lieu of IRR) and proficiency testing, if
applicable. It is the host facility’s duty to provide a statistical
evaluation of the data in the final report, if applicable.

13.3.2 Procedure(s) are used for investigation of outliers. YES NO

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 15 -

A. APPENDIX A – ADDITIONAL QUESTIONS FOR CAPTIVE LABORATORIES CERTIFIED


TO 9100 IN LIEU OF ISO/IEC 17025

A.1 QUALITY SYSTEM DOCUMENT

A.1.1 Quality System Document: If the laboratory is part of an organization YES NO


performing activities other than testing and/or calibration, the
responsibilities of key personnel in the organization that have an
involvement or influence on the testing and/or calibration activities of
the laboratory shall be defined in order to identify potential conflicts of
interest.

A.1.2 Quality System Document: The laboratory has arrangements to ensure YES NO
that its management and personnel are free from any undue internal
and external commercial, financial, and other pressures and influences
that may adversely affect the quality of their work.

A.1.3 Quality System Document: The laboratory has policies and procedures YES NO
to avoid involvement in any activities that would diminish confidence in
its competence, impartiality, judgment or operational integrity.

A.1.4 Quality System Document: Written policy addressing errors in testing is YES NO
established through the Quality Systems Documentation.

A.1.5 Quality System Document: Procedures define the responsibility for YES NO
review and approval of test results, authorization of re-testing, and
preparation or approval of test procedures.

A.2 UNCERTAINTY

A.2.1 Estimation of Uncertainty of Measurement: A calibration laboratory, or YES NO NA


a testing laboratory performing its own calibrations, shall have and shall
apply a procedure to estimate the uncertainty of measurement for all
calibrations.

A.2.2 Estimation of Uncertainty of Measurement: For non-standard tests, or YES NO NA


those tests developed by the laboratory for which there is no published
method, the Estimated Uncertainty for the test shall be determined for
any test whose frequency is ten times or more in a six month period,
and to which the requirements of the appropriate AC 7101 checklist
apply. In certain cases, the nature of the test method may preclude
rigorous, metrologically and statistically valid, calculation of uncertainty
of measurement. In these cases, the laboratory shall at least attempt
to identify all the components of uncertainty and make a reasonable
estimation, and shall ensure that the form of reporting of the result
does not give a wrong impression of the uncertainty. Reasonable
estimation shall be based on knowledge of the performance of the
method and on the measurement scope and shall make use of, for
example, previous experience and validation data.

A.2.3 Estimation of Uncertainty of Measurement: When estimating the YES NO


uncertainty of measurement, all uncertainty components which are of
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 16 -

importance in the given situation shall be taken into account using


appropriate methods of analysis.

A.3 UNAUTHORIZED PERSONNEL

A.3.1 The laboratory is secure from unauthorized personnel. Access to and YES NO
use of areas affecting the quality of tests and/or calibrations shall be
controlled. The laboratory shall determine the extent of control based
on its particular circumstances.

A.4 SELECTION OF METHODS

A.4.1 Selection of Methods: When the customer does not specify the method YES NO
to be used, the laboratory shall select appropriate methods that have
been published either in international, regional, or national standards,
or by reputable technical organizations, or in relevant scientific texts or
journals, or as specified by the manufacturer of the equipment.
Laboratory-developed methods or methods adopted by the laboratory
may also be used if they are appropriate for the intended use and if
they are validated. The customer shall be informed as to the method
chosen. The laboratory shall confirm that it can properly operate
standard methods before introducing the tests and calibrations. If the
standard method changes, the confirmation shall be repeated.

A.4.2 Selection of Methods: The laboratory shall inform the customer when YES NO
the method proposed by the customer is considered inappropriate or
out of date.

A.5 TEST REPORTS

A.5.1 When opinions and interpretations are included, the laboratory shall YES NO
document the basis upon which the opinions and interpretations have
been made. Opinions and interpretations shall be clearly marked as
such in a test report.

A.6 RECORDS

A.6.1 Procedures are used to control and secure records. YES NO

A.7 CONTROL OF TEST MATERIALS

A.7.1 Procedures are used to control all test materials from the point of YES NO
entering the laboratory through the final disposition.

A.8 ERRORS IN TESTING

A.8.1 Errors in Testing: Specific responsibility (individual or title) for YES NO


notification of affected customers is documented.

A.9 CALIBRATION

A.9.1 Applicable to non-ISO/IEC 17025 calibration source: Procedures are YES NO


used to ensure standards are calibrated compliant to ISO/IEC 17025

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 17 -

and segregated and controlled to prevent use for anything other than
calibration.

A.10 PROCEDURES

A.10.1 Procedures are used to ensure correct versions of the test procedures YES NO
are used at the time of testing and obsolete procedures/documents are
unavailable for use in testing.

A.10.2 Procedures are used for issue, change management, review and YES NO
approval of documents/procedures issued to personnel. Personnel
authorized for this activity are documented such that names and roles
and responsibilities are clear.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 18 -

B. APPENDIX B – PROFICIENCY TESTING AND INTERNAL ROUND ROBIN FREQUENCY


REQUIREMENTS

TABLE 1 – FREQUENCIES FOR PROFICIENCY (PT) / INTERNAL ROUND ROBIN (IRR)


TESTING PROGRAMS
Note: PT and IRR requirements are listed here by checklist. Some checklists do not have
PT/IRR requirements.
Note: Where SPC is used in lieu of IRR, it is recognized that this is a continual process. The
expectation of the MTL task group is that the laboratory follows a documented process to
review SPC results at a minimum at the frequencies given below for IRR, and that this
review is documented.
Note: Where Gage R&R is used in lieu of IRR, the frequencies defined below for IRR apply.

AC7101/2 – Chemical Analysis:


B.1.
CODE TEST TYPE Proficiency Testing Frequency
AC7101/2 – Chemical Analysis¹
D Wet Chemistry Every 2 Years
F Atomic Emission Spectroscopy
F1 Direct Current plasma (DCP) Every 2 Years
F2 Inductively Coupled Plasma (ICP) Every 2 Years
F3 Spark/Arc (OES) Every 2 Years
F4 Glow Discharge (GD) Every 2 Years
F5 High Temperature Hollow Cathode Every 2 Years
G Combustion or Fusion
G1 Carbon Every 2 Years²
G2 Hydrogen Every 2 Years
G3 Nitrogen Every 2 Years²
G4 Oxygen Every 2 Years²
G5 Sulfur Every 2 Years²
S X-Ray Fluorescence (XRF) Every 2 Years
V Mass Spectroscopy Every 2 Years
W Atomic Absorption
W1 Flame (AAS) Every 2 Years
W2 Graphite Furnace (GFAA) Every 2 Years

Notes for Chemistry Analysis PT Requirements

¹Proficiency Testing programs to include all applicable alloy families (Ni, Co, Al, Ti, Fe, Cu and Mg) within 6 Years
Maximum .
²Proficiency Testing for the analysis of C, S, O, and N in Ni, Co, and Fe, in accordance with ASTM E1019, is considered a
single alloy family as the test method is the same.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 19 -

B.2.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment
AC7101/2 – Chemical Analysis¹
D Wet Chemistry Every 2 Years Every 2 Years
F Atomic Emission Spectroscopy
F1 Direct Current plasma (DCP) Every 2 Years Every 2 Years
Inductively Coupled Plasma
F2 Every 2 Years Every 2 Years
(ICP)
F3 Spark/Arc (OES) Every 2 Years Every 2 Years
F4 Glow Discharge (GD) Every 2 Years Every 2 Years
F5 High Temperature Hollow Cathode Every 2 Years Every 2 Years
G Combustion or Fusion
G1 Carbon Every 2 Years² Every 2 Years²
G2 Hydrogen Every 2 Years Every 2 Years
G3 Nitrogen Every 2 Years² Every 2 Years²
G4 Oxygen Every 2 Years² Every 2 Years²
G5 Sulfur Every 2 Years² Every 2 Years²
S X-Ray Fluorescence (XRF) Every 2 Years Every 2 Years
V Mass Spectroscopy Every 2 Years Every 2 Years
W Atomic Absorption
W1 Flame (AAS) Every 2 Years Every 2 Years
W2 Graphite Furnace (GFAA) Every 2 Years Every 2 Years

Notes for Chemistry Analysis IRR Requirements

¹Internal Round Robin programs to include all applicable alloy families (Ni, Co, Al, Ti, Fe, Cu and Mg) within 6 Years
Maximum . Not applicable to C, S, O, and N.

²Internal Round Robin programs for the analysis of C, S, O, and N in Ni, Co, and Fe, in accordance with ASTM E1019, is
considered a single alloy family as the test method is the same.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 20 -

AC7101/3 – Mechanical Testing:


B.3.
CODE TEST TYPE Proficiency Testing Frequency
AC7101/3 – Mechanical Testing
A Room Temperature Tensile Every 2 Years
B Elevated Temperature Tensile Every 2 Years
C Stress Rupture Every 2 Years¹
XA Creep Every 2 Years¹
CT Compression Testing Not Required
KR Curve (Resistance to Fracture) Testing Not Required
N Impact Testing Not Required
O High Cycle Fatigue Every 5 Years
P Fracture Toughness Every 5 Years
Y Low Cycle Fatigue Every 5 Years
XE Crack Propagation/Crack Growth Testing Every 5 Years
XN Bend Testing Not Required

Notes for Mechanical Testing PT Requirements


¹If a PT is performed for Creep, then Stress Rupture PT is not required.

B.4.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment

AC7101/3 – Mechanical Testing


A Room Temperature Tensile Every 2 Years² Every 2 Years²
B Elevated Temperature Tensile Every 2 Years Every 2 Years
C Stress Rupture Every 2 Years¹ Every 5 Years¹²⁴
XA Creep Every 2 Years² Every 5 Years²⁴
CT Compression Testing Not Required Not Required
KR Curve (Resistance to Fracture) Testing Not Required Not Required
N Impact Testing Not Required Not Required
O High Cycle Fatigue Every 5 Years² Every 5 Years²³⁴
P Fracture Toughness Every 5 Years² Every 5 Years²³
Y Low Cycle Fatigue Every 5 Years² Every 5 Years²³⁴
XE Crack Propagation/Crack Growth Testing Every 5 Years² Every 5 Years²³⁴
XN Bend Testing Not Required Not Required

Notes for Mechanical Testing IRR Requirements


¹If an IRR is performed for Creep, then Stress Rupture IRR is not required. (Note: And all operators/equipment are the
same.)
²If an IRR is performed for elevated temperature, then IRR is not required for room temperature. (Note: and provided all
operators/equipment are the same).
³In cases where the number of machines are 30 or greater, see Appendix D3.1 for exceptions to frequency.
⁴Proposed plan based on Calibration data : In lieu of Equipment IRR for the same range of operation, laboratory may opt to
perform “high / low range equipment study” using calibration data that includes highest reported calibration deviation %
equipment results compared to lowest reported calibration deviation % equipment results minimally.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 21 -

AC7101/4 – Metallography and Microindentation Hardness:


B.5.
CODE TEST TYPE Proficiency Testing Frequency
AC7101/4 – Metallography and Microindentation Hardness
L0 Metallographic Evaluation Not required
L1 Microindentation Hardness Every 2 Years¹
L2 Alloy Depletion Not Required
L3 Oxidation/Corrosion Layers Not Required
L4 Casting (Mold) Reactions Not Required
L5 Microindentation (Surface-case depth) Every 2 Years¹
L5X Microindentation (Surface) (ARP1820) Not Required
L6 Nitriding Not Required
L7 IGA / IGO Not Required
L8 Alpha Case: Wrought L8 or L9 Every 2 years
L9 Alpha Case: Castings L8 or L9 Every 2 years
L10 Carburization/Decarburization Not Required
L11 Grain Size Measurement Every 2 Years
L12 Inclusion Rating Not Required
L13 Replication Not Required
XL Macro Examination Not Required

Notes for Metallography and Microindentation Hardness PT Requirements


¹If Case Depth utilized Microindentation hardness (L5), separate PT for Microindentation (L1) is not required.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 22 -

B.6.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment

AC7101/4 – Metallography and Microindentation Hardness


L0 Metallographic evaluation Not required Not required
L1 Microindentation Hardness Every 2 Years¹ Not Required
L2 Alloy Depletion Every 2 Years Not Required
L3 Oxidation/Corrosion Layers Every 2 Years Not Required
L4 Casting (Mold) Reactions Every 2 Years Not Required
L5 Microindentation (Surface-case depth) Every 2 Years¹ Not Required
L5X Microindentation (Surface) (ARP1820) Every 2 Years Not Required
L6 Nitriding Every 2 Years Not Required
L7 IGA / IGO Every 2 Years Not Required
L8 or L9
L8 Alpha Case: Wrought Not Required
Every 2 Years
L8 or L9
L9 Alpha Case: Castings Not Required
Every 2 Years
L10 Carburization/Decarburization Every 2 Years Not Required
L11 Grain Size Measurement Every 2 Years Not Required
L12 Inclusion Rating Every 2 Years Not Required
L13 Replication Every 2 Years Not Required
XL Macro Examination Every 2 Years Not Required

Notes for Metallography and Microindentation Hardness IRR Requirements


¹If Case Depth utilized Microindentation hardness (L5), separate IRR for Microindentation (L1) is not required.

AC7101/5 – Hardness:
B.7.
CODE TEST TYPE Proficiency Testing Frequency
AC7101/5 – Hardness (Macro)
M1 Hardness (Brinell) Every 2 Years
M2 Hardness (Rockwell) Every 2 Years
M3 Hardness (Vickers) Every 2 Years

Notes for Hardness PT Requirements – No Notes.

B.8.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment

AC7101/5 – Hardness (Macro)


M1 Hardness (Brinell) Every 2 Years Every 2 Years
M2 Hardness (Rockwell) Every 2 Years Every 2 Years
M3 Hardness (Vickers) Every 2 Years Every 2 Years

Notes for Hardness IRR Requirements – No Notes.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 23 -

AC7101/6 – Corrosion: No PT/IRR Requirements

AC7101/7 – Mechanical Testing Specimen Preparation: No PT Requiements refer to AC7101/7 section11

For process validation:


Mechanical Testing Specimen Preparation IRR (Operator/Equipment Process Validation) Requirements –Internal round
robin requirements can be met using the annual process validation as referenced in AC7101/7 section 11, using
alternating equipment and operators, so that all operators and equipment are validated. Reference Appendix D1

AC7101/9 – Test Specimen Response/Capability to Heat Treat: No PT/IRR Requirements

AC7101/11 – Fastener Testing


B.9.
CODE TEST TYPE Proficiency Testing Frequency
AC7101/11 – Fastener Testing
15 Torque – Tension Not Required
31 Torque – Locking, Torque-Out Not Required
40L2 Metallography – Alloy Depletion Not Required
40L3 Metallography – Oxidation / Corrosion Not Required
40L7 Metallography – IGA / IGO Not Required
Metallography –Alpha Case: Wrought
40L8 Every 2 Years
Titanium
Metallography – Decarburization /
40L10 Not Required
Carburization
40L25 Metallography – Grain Size Every 2 Years
6-M2 Hardness – Rockwell Every 2 Years
6-M3 Hardness – Vickers Every 2 Years
6-L5 Hardness – Microindentation Hardness Every 2 Years⁴
8-P Tensile Test – Proof Load (nuts / screws) Not Required
8-A Tensile Test – Axial Tensile Every 2 Years²³
8-W Tensile Test – Wedge Tensile Every 2 Years²³
18 Tensile Test – Elevated TempTensile Every 2 Years³
10 Stress Rupture Every 2 Years¹
11 Fatigue Every 5 Years
13 Shear Strength – Double Shear Every 2 Years
5 Stress Durability – External Threads Not Required
14 Stress Durability – Internal Threads Not Required
Q Corrosion – Salt Spray Not Required
QF Corrosion – Copper Sulfate Not Required

Notes for Fastener Testing PT Requirements

General: See also AC7101/11 Table 1 regarding assignment of test codes


General: Any of the above PT requirements, if not fastener specific, can be met through other accredited checklists (does
not apply to fatigue).

¹For labs performing stress rupture PT on fasteners, time to fracture must be reported. A result of discontinued is not a
valid result to determine proficiency. Machined specimens may be used in lieu of fasteners under the same guidelines as
AC7101/3.
²Only one room temperature tensile PT is required. Separate participation is not required for axial or wedge.
³Yield, Reduction of Area, and percent Elongation required if reporting results required by customer is limited to ultimate
tensile strength for fasteners.
⁴If case depth utilized Microindentation hardness, separate PT for Microindentation hardness is not required.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 24 -

B.10.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment
AC7101/11 – Fastener Testing
15 Torque – Tension Every 2 Years Not Required
31 Torque – Locking, Torque-Out Every 2 Years Not Required
40L2 Metallography – Alloy Depletion Every 2 Years Not Required
40L3 Metallography – Oxidation / Corrosion Every 2 Years Not Required
40L7 Metallography – IGA / IGO Every 2 Years Not Required
Metallography –Alpha Case: Wrought
40L8 Every 2 Years Not Required
Titanium
Metallography – Decarburization /
40L10 Every 2 Years Not Required
Carburization
40L25 Metallography – Grain Size Every 2 Years Not Required
6-M2 Hardness – Rockwell Every 2 Years Every 2 Years
6-M3 Hardness – Vickers Every 2 Years Every 2 Years
6-L5 Hardness – Microindentation Hardness Every 2 Years⁴ Every 2 Years⁴
8-P Tensile Test – Proof Load (nuts / screws) Not Required Not Required
8-A Tensile Test – Axial Tensile Every 2 Years²³ Every 2 Years²³
8-W Tensile Test – Wedge Tensile Every 2 Years²³ Every 2 Years²³
18 Tensile Test – Elevated Temp.Tensile Every 2 Years² Every 2 Years²
10 Stress Rupture Every 2 Years¹ Every 2 Years¹
11 Fatigue Every 5 Years Not Required
13 Shear Strength – Double Shear Every 2 Years Every 2 Years
5 Stress Durability – External Threads Not Required Not Required
14 Stress Durability – Internal Threads Not Required Not Required
Q Corrosion – Salt Spray Not Required Not Required
QF Corrosion – Copper Sulfate Not Required Not Required

Notes for Fastener Testing IRR Requirements

General: See also AC7101/11 Table 1 regarding assignment of test codes


General: Any of the above IRR requirements, if not fastener specific, can be met through other accredited checklists (does
not apply to fatigue).

¹For labs performing IRR stress rupture tests on fasteners, time to fracture must be reported. A result of discontinued is
not a valid result to determine operator proficiency. If fastener specimens cannot be used for stress rupture IRR, then
machined specimens shall be utilized under the same guidelines as AC7101/3.
²If elevated temp tensile has been performed for IRR (and all operators are the same), equivalent room temperature
participation is not necessary.
³Yield, Reduction of Area, and percent Elongation not required if reporting results required by customer is limited to
ultimate tensile strength for fasteners.
⁴If case depth utilized Microindentation hardness, separate IRR for Microindentation hardness is not required.

AC7109/5 – Coating Evaluation Laboratory Practices: See AC7109/5 for PT/IRR requirements

AC7110/13 – Evaluation of Welds: No PT/IRR requirements

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 25 -

C. APPENDIX C – SELECTION OF A PROFICIENCY TEST (PT) PROVIDER

C.1. General Information:

Proficiency Testing is used to check the ability of a lab to perform a Test Method with a
defined protocol (common with other participating labs).

The statistical population shall contain a sufficient number of participants. Without this
requirement, there is an increased probability that the statistical methods used to compile
the report will be non-robust.

Nadcap specifies participation in PT for specific methods but not materials (with the
exception of chemistry where specific alloy analyses are required): whatever the material
chosen by the PT provider, if the capability of your equipment and/or specimen preparation
allows you to participate it shall be used, even if the specimen material or shape will not
exactly reflect your typical testing (mainly an issue for captive testing labs).

When not practical or feasible to use a provider from the PRI list of recognized providers
(found at www.eAuditNet.com, Resources → Documents → Public Documents → Task
Groups → Materials Testing Laboratories → Interlaboratory Proficiency Testing (IPT)
Information), three other options are available in this appendix.

Laboratories are responsible to ensure the provider they use conforms to the rules of this
appendix (listed below) at time of use.

Appendix E requirements for Proficiency Testing must always be met.


Note: If preparation of the sample provides difficulties for the lab, the lab is encouraged to
use a machining / preparation source identified by MTL (accredited to AC7101/7) and
located on eAuditNet at this address: (www.eauditnet.com).

C.2. Selection of PT provider/program:

Each Nadcap Subscriber specifies whether they require laboratories to go through Process
A or Process B when choosing PT providers. Which Subscribers require which Process is
given in the summary in Table C1. If the Subscriber is not listed, use Process A.

Process A (mandated by Airbus, MTU, Safran, Process B (Boeing, Eaton, Honeywell, Spirit,
Airbus Helicopter, Rolls Royce, Bombardier) Textron Aviation, Pratt and Whitney)
Carry out PTP using a recognized PTP provider as Any PTP program is OK, so long as rules laid down in
listed in Table C.2. or as updated on eAuditNet Appendix E are followed.
If this is not available, go to the following Options in
order of priority as detailed in Section C.2. above:
1. Option 1a: ISO 17043 (previously Guide 43)
accredited provider (e.g. delivered in audit
handbook or as updated on eAuditNet)
OR
Option 1b: ISO 17043 (previously Guide 43)
compliant (not accredited) provider following
8/10 of the “rules” listed in Appendix C Section
C.3.
2. Subscriber program
3. Supplier program with a plan to meet the
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 26 -

intent of PT in accordance with AC7101/1


Appendix C (absolute exception if no other
option is available)
Appendix E requirements must always be met. Note: Supplier-suggested program (AC7101/1
Appendix C Option 3) is an absolute last option.
Appendix E requirements must always be met.

C.2.1. Process A:

Default: Carry out PTP using a recognised PTP provider as listed on eAuditNet or in Table
C.2. (in the Audit Handbook/Supplemental Guidance).

If the method to be tested is not available from a recognised PTP provider, use one of the
following options. Note that these are listed in order of priority. Option 1 shall be used if
available. If not, use Option 2. If Option 2 is not available, use Option 3.

Option 1 Option 1a: ISO 17043 (previously Guide 43) accredited provider (see Table C3 in the Audit
Handbook/Supplemental Guidance ).

Option 1b: ISO 17043 (previously Guide 43) compliant (not accredited) and following 8/10 of
the “rules” listed in Appendix C Section C.3.

The laboratory can participate in PT by other commercial providers if at least 8 of the “Rules
for acceptance of commercial proficiency testing providers” (listed in section C.3.) are
validated by the provider and verified by the laboratory.

Option 2 Use a Subscriber Program as a Proficiency Testing Provider.

The laboratory can use a Subscriber specific program only after PRI Staff Engineer and
Subscriber concur regarding confidentiality and method validation.

Option 3 Submit a plan to meet the intent of proficiency testing for Task Group approval. Supplier
shall retain an approved plan to meet this requirement. This supplier plan shall fulfill the
“rules” listed in Appendix C Section C.3.

C.2.2. Process B:

Unless specific Subscribers require otherwise, the Subscribers hold no preference for PT
provider, and any MTL approved (see Table C.2. or ISO 17043 (previously Guide 43)
accredited provider (see Table C.3.) is considered acceptable. (Table C.2. and C.3. located
in the Audit Handbook/Supplemental Guidance).

The Subscribers hold no preference for PT provider, and any MTL approved (see Table C.2.
and link below) or ISO 17043 (previously Guide 43) accredited provider (see Table C.3. in
audit Handbook and link below) is considered acceptable.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 27 -

TABLE C.2.: RECOGNIZED PROVIDERS OF PROFICIENCY TESTING PROGRAM at time of checklist publication

Source Items (For reference only)

PTP Salt spray


Fatigue
Fracture toughness
Hardness
Impact
Tensile
Creep
Stress rupture
Crack growth
Embrittlement
R Curve
Stress corrosion
Rotative bending
Machining
Machining properties (measure of residual stress)
Metallurgical Testing
Grain size
Alpha case
Alloy depletion
Inclusion rate
Porosity
Welding
Chemical Analysis

Collaborative Testing Services, Inc. (CTS) Chemical Analysis – Metal Alloys


Mechanical Testing – Metals for:
Room Temperature Tensile
Rockwell Hardness
Brinell Hardness
Fastener Testing – for:
Wedge Tensile
Axial Tensile
Rockwell Hardness
Vickers Hardness
Double Shear
Metallography – for:
Alpha Case Depth
Alloy Depletion
Grain Size
Microhardness (Knoop & Vickers)
* Other material programs (plastic, rubber, etc. available)

Analytical Reference Materials International, Inc. (ARMI) (LGC Chemical Analysis – Metal Alloys
STANDARDS)
Rocky Mountain Reference Materials, LLC Chemical Analysis – Metal Alloys

Notes on Table C.2.:

General: Any changes to the list will be posted on www.eAuditNet.com, Resources →Documents →Public Documents →
Task Groups → Materials Testing Laboratories → Interlaboratory Proficiency Testing (IPT) Information. Refer to eAuditNet
for contact information.

¹The PTP 5-year program guide provides additional visibility to the program so that labs can schedule their participation.
Some Nadcap Subscribers work directly with the host of the PTP and have input on proposed programs. If a common
need arises, a program can be developed. Subscribers are encouraged to provide feedback to the MTL Task Group PT
TAG by contacting the staff engineer so that interest in a specific new test method can be effectively collected. On
occasion, PTP does retain remaining material from previous programs, and these can be requested and performance
compared to existing statistics. Please contact the PTP provider directly.
ist of ISO 17043 (previously GUIDE 43) accredited PT providers at time of checklist publication are in the Audit Handbook.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 28 -

C.3. Rules for acceptance of commercial proficiency testing providers.

The *Full Process Provider, to be recognized by the MTLTG, shall be compliant with
Criterion 1 or Criterion 2
*Full Process Provider - A provider that supplies the sample in a condition to require
participating testing laboratory to utilize their entire process (e.g. sample preparation and
testing). (Not one that submits photographic sample for review only.)

Criterion 1: ISO 17043 (previously Guide 43) or ILAC G-13 Compliance and 3rd party
accreditation (such as ISO 9001, ISO/IEC 17025, and the scope of the accreditation
corresponding) and the following rules. OR

Criterion 2: ISO 17043 (previoulsy Guide 43) or ILAC G-13 Accreditation and the following
rules.

Rule 1 Materials and tests scope offered by the provider comply with our aeronautic requirements
(Standard used are listed in our referenced documentation).

Rule 2 Homogeneity study of material shall be explained and compliant with Rules 3 and 4:

Rule 3 20 specimens per sheet, tubes or batch is recommended for the homogeneity analyses.
Less than 10 specimens per sheet, tubes or batch analyses will not be accepted.

Rule 4 Risk analyses to exclude a participant because of an inhomogeneous material shall be less
than 5%.

Rule 5 The number of participants per test program shall be more than 30 to have a robust
statistical analyse (less than 10 not accepted (per ASTME2489)).

Rule 6 Time process between the beginning and the end of the program shall be less than 6
Months (Root cause analyses concern).

Rule 7 Time process between the final reporting of results and the data analysis report shall be less
than 3 months (Root cause analyses concern).

Rule 8 Numbers of specimens per test (sufficient number of specimens to ensure repeatability).

Rule 9 Statistical analyses performed (repeatability, median & sigma or k studies).

Rule 10 Report shall clearly state class identification of results and a graphical depiction of
population fit.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 29 -

D. APPENDIX D – SPECIFIC TESTING PROTOCOL FOR INTERNAL ROUND ROBINS


Appendix E requirements must always be met for general protocol.

D.0.1. INTENT

The aim of conducting internal round robins is to check the potential impact in variability
between equipment and/or operators on measurements for the same test code.

Intent is not to check the influence of the material, one material shall be chosen and be
homogenous to limit the impact on the statistics.

D.0.2. MEMBERSHIP

A coordinator of the Internal Round Robin program shall be assigned. It is the coordinator’s
responsibility to design the test method protocol, distribute testing materials, guide the
testing phase and construct a final report based on the data obtained.

D.0.3. PARTICIPANTS

All qualified operators or candidates for qualification must participate unless excluded in
Appendix B.

All qualified equipment or equipment to be qualified must participate unless excluded in


Appendix B.

D.0.4. OPTIONS

Use one of the following options to fulfil the requirements for participation in an internal
round robin (IRR) program. There is no order of preference.

D.0.4.1. Statistical process control in lieu of IRR– see Appendix D.1.

D.0.4.2. Gage R&R in lieu of IRR– see Appendix D.2.

D.0.4.3. IRR – see Appendix D.3.

D.0.4.4. Auditee to propose an IRR Program plan.

D.0.5. FREQUENCY

See Appendix B for frequency requirements.

D.1. APPENDIX D.1. – STATISTICAL PROCESS CONTROL IN LIEU OF IRR

This option is best suited for captive labs with routine production testing. For independent
labs without routine measurements on consistent production material, it is recognized that
this option may be difficult to implement. One way to implement this for an independent lab
would be to obtain a sufficient number of samples from a homogenous material and
disperse these between regular lab jobs. This is particularly appropriate for testing which is
not destructive (hardness, some chemistry tests).

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 30 -

The SPC program shall be designed in such a way that operators are compared and
equipment is compared. Intervals at which data is to be analysed are to be defined by the
laboratory.

All equipment and operators shall be covered at least within the required time frame and for
chemistry, include all alloy families listed in appendix B.

The sampling frequency is determined by practical considerations, such as time and cost of
an observation, the process dynamics (how quickly the output responds to upsets), and
consequences of not reacting promptly to a process upset.

When using data from production material, compare operators or equipment using as similar
material as possible (e.g. same grade, same production route).The program shall be
designed using control charts and should be in accordance with one or more of the following
international standards:

Any of the ISO 7870 series of standards referenced in ISO 7870-1 Control charts: general
guidelines: It presents an overview of the basic principles and concepts and illustrates the
relationship among various control chart approaches to aid in the selection of the most
appropriate standard for given circumstances.

ISO 11462-1 Guidelines for implementation of statistical process control (SPC): it extends
the definition of process control to integrate the traditional definitions of statistical process
control, algorithmic process control, and model-based control methods. These are different
approaches with the same purpose of reducing variation in both products and processes.

ASTM E2587 Use of Control Charts in Statistical Process Control: it provides guidance for
the use of control charts in statistical process control programs, which improve process
quality through reducing variation and controlling the process to a target level or historical
average.
Note: The following standard may be used as guidance for statistical methods but is not
sufficient to design an SPC program on its own:
ISO 13528 Statistical methods for use in proficiency testing by interlaboratory
comparison: allowing guidance on statistical methods for analysing measurement.

D.2. APPENDIX D.2. – GAGE R&R IN LIEU OF IRR

Gage R&R is a robust statistical process used to establish repeatability and reproducibility
for operators and equipment, and is a good option for a large population.

A gage R&R study will tell operators if the measurement system is acceptable for its
intended use. The gage study also shows which part of the measurement system is
contributing the most to the variation of the measurements and helps operators/equipment
improvements to the system.

Measurement systems contain variation from three main sources: the products themselves
(taken into account by using homogeneous material), the operator taking the
measurements, and the equipment used to perform the measurement. The gage study
shows the contribution of each of these areas and checks whether the deviation generated
is acceptable.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 31 -

The Gage R&R Program should be designed in accordance with one or more of the
following international standards:

ISO TR 12888 Selected illustrations of gauge repeatability and reproducibility studies:


provides general guidelines on the design, conduct and analysis of GRR studies.

ISO 22514-7 Statistical methods in process management — Capability and performance


Part 7: Capability of measurement processes: defines a procedure to validate measuring
systems and a measurement process in order to state whether a given measurement
process can satisfy the requirements for a specific measurement task with a
recommendation of acceptance criteria. The acceptance criteria are defined as a capability
figure.
Note 1: The following standards may be used as guidance for statistical methods but are not
sufficient to design a Gage R&R program on their own:
ISO 13528 Statistical methods for use in proficiency testing by interlaboratory
comparison: allowing guidance on statistical methods for analysing measurement.

ASTM E 2782 Standard Guide for Measurement Systems Analysis (MSA): This guide
presents terminology, concepts, and selected methods and formulas useful for
measurement systems analysis.

D.3. APPENDIX D.3. – IRR

D.3.1. Comparison to Certified or Reference Values

D.3.1.1. Material Selection: Choose one of the following types of material

D.3.1.1.A. Verified Material - Use a material that has been statistically evaluated with a known mean
value and standard deviation (Type 1) or a material accompanied with set upper and lower
limit values (Type II e.g. PTP material or standard hardness test block). Chemical reference
material upper and lower limits are defined by the laboratory’s process.

D.3.1.1.B. Unverified Material - Use a material with an unknown mean and sample standard deviation.
In this case, testing needs to be conducted to determine a reference distribution for the test
of interest (Type III).

D.3.1.1.1. Determine the reference distribution

D.3.1.1.1.A. Number of Tests

D.3.1.1.1.A.a. The minimum number of tests required is twelve (12).

D.3.1.1.1.A.b. For large volumes of material more tests may be necessary to adequately characterize
material variations present in the candidate stock. It is the labs responsibility to determine
adequate number of tests.

D.3.1.1.1.B. Conduct Subject Tests

D.3.1.1.1.B.a. Conduct tests according to procedures that are used to fulfill the requirements set forth in
the test code of interest.

D.3.1.1.1.C. Perform Statistical Evaluation

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 32 -

D.3.1.1.1.C.a. Tabulate the test data.

D.3.1.1.1.C.b. To produce a robust data set, first perform an outlier test on test data. If an outlier is
identified, remove the test from the data set and run two (2) replacement tests. The
replacement test material should come from a location near the outlier sample’s original
location.

D.3.1.1.1.C.c. Calculate the mean (µ) and sample standard deviation (σ) on the robust test data set. So as
to define a reference distribution.

D.3.1.1.1.C.d. Establish the limits (fences) of the reference distribution by determining two (2) and three (3)
sample standard deviations values.

D.3.2. Equipment or Operator Qualification (Usual Method)

D.3.2.A. The allowed period for completion of the internal round robin will be two or five years
(defined by the calendar year) as listed under “frequency” in Appendix B. All Operators and
equipment must participate within the given timeframe.

The intention behind frequency of 2 or 5 years is to allow laboratories to share the cost and
equipment unavailability associated with round robin testing over multiple years, however if
the lab prefers to complete the round robin in less time than that available (e.g. all in year 1,
or spread over years 1, 3 and 5 for a five-year frequency), this is expressly permitted.

Examples of how to spread measurements over multiple years are given in the AC7101/1
Handbook Supplement.

D.3.2.B. Each subject piece of equipment or operator will perform a minimum of one (1) test.

D.3.2.C. Qualification will be determined as follows:

D.3.2.C.a. If using a verified material with set upper and lower limit values (Type II), all values must fall
within the materials stated limits.

D.3.2.C.b. If using verified material with a known mean and standard deviation (Type I), establish the
limits (fences) of the reference distribution by determining two (2) and three (3) sample
standard deviations values. In this case proceed with qualification process described for
unverified material.

D.3.2.C.c. If using an unverified material for which a reference distribution has been determined,
qualification is established by comparing the test value to the reference sample standard
deviation limits (fences) according to the following conditions.

D.3.2.C.c.i. If the subject value falls within ± one (1) sample standard deviation, then the equipment or
operator is considered qualified.

D.3.2.C.c.ii. If the subject value falls within ± two (2) sample standard deviations but above ± one (1)
sample standard deviation (2s ≥ Value ≥ 1s) then a minimum of two (2) additional tests must
be run. If all three (3) tests are within two (2) sample standard deviation and the mean
absolute value of the Z Score of the variance (equation C) is within (1.6) sample standard
deviation, then the equipment or operator is considered qualified. If these conditions are not
met then the equipment or operator are considered non-qualified, the lab shall evaluate for

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 33 -

possible causes of the error.

D.3.2.C.c.ii.1. To find mean absolute value of the Z Score of the variance, use the following equations:

D.3.2.C.c.ii.1.a. Absolute Varience (v) – |Measured Value (Mᵛ) – Mean (μ)|

D.3.2.C.c.ii.1.b. Z Score (Z) = Absolute Varience (v)


Sample Standard Deviation (σ)

D.3.2.C.c.ii.1.c. Mean Z Score (Z) = Σ(z₁)(z₂)(z₃)


3

D.3.2.C.c.iii. If the subject value falls outside of ± two (2) sample standard deviations then the equipment
or operator are considered non-qualified, the lab shall evaluate for possible causes of the
error.

D.3.2.C.c.iv. When equipment or operators are considered non-qualified, upon completion of the
laboratory evaluation the equipment or operators may be qualified by repeating the above
outlined procedure with satisfactory results.

D.3.3. Equipment Qualification (Calibration Method)

D.3.3.A. Determining subject equipment

D.3.3.A.a. This method is limited to equipment, (it would normally be applied to large numbers of
equipment).

D.3.3.A.a.i. Define a key characteristic or characteristics.

D.3.3.A.a.ii. Based upon the equipment’s calibration results for the key characteristic or characteristics,
numerically order the calibration values (rank). Using the value ranked #1 as the “0%” and
the largest ranked value as “100%”, choose equipment at the 0%, 25%, 50%, 75%, and
100% levels. It is recognized that exact pieces of equipment may not be available and
alternative equipment within ± 5% of the level is acceptable.

D.3.3.B. Each subject piece of equipment will perform a minimum of three (3) tests.

D.3.3.C. Qualification will be determined as follows:

D.3.3.C.a. If using a verified material with set upper and lower limit values, all values must fall within the
materials stated limits.

D.3.3.C.b. If using verified material with a known mean and standard deviation, establish the limits
(fences) of the reference distribution by determining two (2) and three (3) sample standard
deviations values. In this case proceed with qualification process described for unverified
material.

D.3.3.C.c. If using an unverified material for which a reference distribution has been determined,
qualification is established by comparing the test value to the reference sample standard
deviation limits (fences) according to the following conditions.

D.3.3.C.c.i. If all subject values fall within ± one (1) sample standard deviation, then the equipment is

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 34 -

considered qualified.

D.3.3.C.c.ii. If the subject value falls within ± two (2) sample standard deviations but above ± one (1)
sample standard deviation (2s ≥ Value ≥ 1s) then a minimum of two (2) additional tests must
be run. If all three (3) tests are within two (2) sample standard deviation and the mean
absolute value of the Z Score of the variance (equation C) is within (1.6) sample standard
deviation, then the equipment is considered qualified. If these conditions are not met then
the equipment is considered non-qualified, the lab shall evaluate for possible causes of the
error.

D.3.3.C.c.ii.1. To find mean absolute value of the Z Score of the variance use the following equations:

D.3.3.C.c.ii.1.a. Absolute Varience (v) – |Measured Value (Mᵛ) – Mean (μ)|

D.3.3.C.c.ii.1.b. Z Score (Z) = Absolute Varience (v) _


Sample Standard Deviation (σ)

D.3.3.C.c.ii.1.c. Mean Z Score (Z) = Σ(z₁)(z₂)(z₃)


3

D.3.3.C.c.iii. If a subject value falls outside of ± two (2) sample standard deviations then the equipment is
considered non-qualified, the lab shall evaluate for possible causes of the error.

D.3.3.C.c.iv. When equipment is considered non-qualified, upon completion of the laboratory’s evaluation
the equipment may be qualified by following the above outlined procedure.

D.3.4. Refinement of Reference Distribution

D.3.4.A. Data which has been generated during a qualification study that meets the above
qualification criteria may be combined with the original reference distribution population to
create a more robust reference distribution moving forward. (This may be done at the
discretion of the laboratory.)

D.3.5. Reporting

Results shall be documented in a report at the end of the IRR program.

For IRR programs which last longer than one year, it is highly recommended that the
laboratory document results to date in an interim report at the end of each year.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 35 -

E. APPENDIX E – GENERAL TESTING PROTOCOL FOR INTERNAL ROUND ROBINS (IRR)


AND PROFICIENCY TESTING (PT)

(A) Basic Design – The testing protocol should be designed such that the results obtained
from the chosen method can be classified easily to study the within – and between – facility
variability without the influence of secondary effects.

(B) Within facility variability, referred to as repeatability, concerns the variability between
independent testing results obtained within a single facility in the shortest practical period of
time by a single operator with a specific set of test apparatus using test specimens taken at
random from a single quantity of homogeneous material obtained or prepared for the study.
The single operator – single set of apparatus requirement means that given a particular step
in the measurement process, the same combination of operator and apparatus is used for
every test result (replicate) and on every material. Thus, one operator may prepare the test
specimens, a second operator measure the dimensions and a third operator may perform
the test.

(C) Timing Precision – “Shortest practical period of time” means that the test results, at least
for one material, are obtained in a time not less than in normal testing and not so long as to
permit significant changes in the test material, equipment or environment.

(D) Between facility variability, referred to as Reproducibility, deals with the variability
between single test results obtained in different facilities, each of which has applied the test
method to the test specimens taken at random from a single quantity of homogeneous
material obtained or prepared for the study.

(E) Data Classification – One form of classification suggested is a separate matrix table for
each property tested, in which the rows represent the facilities and the columns represent
the materials (or vice versa). Each cell, the intersection of a row with a column, contains the
test results made by a particular laboratory for a particular material. (For practicality reasons
regarding certain test methods, the terms material and property may be interchanged in this
paragraph).

(F) Test Method – The actual measurement process and the written description of the
process. A written draft of the test method shall be constructed that describes the test
procedure, identifies test conditions affecting the test results, and specifies the proper
degree of control of the test. The number of significant digits to be reported shall also be
designated and shall follow, as a minimum. The test method shall include any special
calibration procedure and the frequency of calibration required, if applicable.

(G) Global Instruction – The name, address, e-mail address, telephone and fax number of
the key person(s) coordinating and supervising the proficiency testing should be provided in
the protocol. The participating laboratories shall be instructed to contact the coordinator
when any questions arise as to the conduct of the proficiency testing.

(H) Test Identification – Clearly identify the test method, specifying any option(s) in
apparatus or procedure selected. Test units and test data sheets should be given for each
option.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 36 -

(I) Material Consistency – Each material selected shall be supplied by one source and made
to be as homogeneous as possible, prior to its subdivision into test specimens. The location
of every test specimen from the bulk material shall be traceable through a letter and/or
number designation indicated on each sample. In other words, a log or schematic of the
location referencing where each test specimen originated from the bulk material shall be
maintained. The samples shall be randomized before distribution and a record shall be
maintained of which facilities (EPT) or operators and equipment (IRR) are testing which
sample number(s).

(J) Calibration Procedures – Calibration procedures required before every test result should
be described in detail in the test method, if applicable.

(K) Specific Conditions Analyses – Characterize any special circumstances that must be
addressed in executing the repeatability conditions (e.g. the length of time between
obtaining the test results for the same material).

(L) Handling and Conditioning – Stipulate the required care, handling and conditioning of the
material(s) to be tested, if applicable. Describe the coding system used to identify the
material(s) to be tested.

(M) Host Facility Data Collection – The host laboratory or provider may provide data sheets
for recording the raw data as observed. Supply sheets on which test results can be
calculated or combined with the raw data sheet(s), if applicable. Request that all raw data be
sent as soon as the testing is completed, or at regular intervals for testing which extends
over several weeks.

(N) Data sheets should be provided so that each laboratory can record any special events
that arise during any phase of the testing. In addition to a ‘comments’ section, questions
pertinent to the test method may be asked to get a better idea of how the test was carried
out as long as the information is not proprietary. Any information that would ensure that the
laboratory complied with the requirements specified for the test method or that may be
needed to prepare for the final report should also be requested. The recorded comments will
serve as a valuable source of information both in handling outlying data and for improving
the test method for future proficiency testing. Obtain suggestions for future testing regarding
the test method and test materials.

(O) Replacement – The protocol must contain information about the availability of the
material(s) for replacement tests. It is recommended that the host laboratory prepare
enough of each material to supply 50% more than needed by the number of facilities
committed to the testing program. Instruct the facilities to notify the test coordinator
immediately whenever an error in test procedure occurs. It can then be determined whether
a new set of test specimens needs to be provided for a replacement test of the material(s).

(P) Final Report – A formal report shall be distributed by the host to all participants,
containing a description or summary of the test method, materials and the reported test
results from all participants, a summary of performance statistics and a description of the
statistical method used for the analysis of results. Testing sponsored by Nadcap-accredited
facilities should clearly state which Nadcap testing requirement(s) are met (e.g. This testing
fulfills Nadcap requirements for Stress Rupture in January of 2010). Participants shall be
identified by code to minimize the possibility of bias during data analysis. Each participant
shall be informed of its code assigned by the host to maintain confidentiality.

t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 37 -

F. APPENDIX F – CALIBRATION FREQUENCY (MAXIMUM)

GENERAL EQUIPMENT REQUIRED FREQUENCY

Temperature measurement Instruments and 3 Months


Recorders

Laboratory Facility Temperature/Humidity 1 Year


Measuring Instruments

Recording Systems: 6 Months


To + 1% of full scale range
(e.g., X-Y Strip Charts)

Precision Potentiometers 3 Months

Micrometers/Verniers 6 Months

Optical Comparator or video/camera systems used 1 Year


to verify dimensions of specimens

Oscilloscopes 1 Year

Note:Calibration cycles may be extended as defined by the NCSL (National Conference of Standards
Laboratories), Recommended Practice 1, or other recognized statistical review process to support the
extended time interval. Calibration frequencies defined by standard methods or supplier requirements
shall not be extended. Calibration extension shall be allowed only if documented historical data and
standard calibration practices substantiate the extension of calibration frequencies.

t-frm-15 04-Apr-2019

You might also like