Professional Documents
Culture Documents
PSF-R0a
092121
www.orielstat.com | 732.548.0600
About Oriel STAT A MATRIX
Whether you are planning to bring a new medical device to market, harmonize a quality system
across a global organization, or enhance your organization’s productivity, turn to Oriel STAT A
MATRIX to get the expert support you deserve.
Founded in 1968, Oriel STAT A MATRIX is the world’s leading consulting and training organization
dedicated to business process improvement, management systems, and quality and regulatory
compliance. We have consultants in 33 states and more than 20 countries, and our team has
assisted customers in more than 75 countries.
Quality Assurance
Our quality assurance services support quality system development, implementation, management,
and auditing to improve business results, address issues, and satisfy global medical device
requirements, including ISO 13485:2016, ISO 9001:2015, US FDA GMP Quality System Regulation
(QSR), the Medical Device Single Audit Program (MDSAP), and the EU MDR.
Performance Excellence
Our extensive experience with performance excellence methodologies like Process Management,
Lean and Six Sigma, teams, and Voice of the Customer enable our customers to identify and solve
tough business problems to improve performance and results – without compromising compliance.
Training
Thousands of companies have turned to us for their RA/QA training and we’ve trained over
130,000 quality system auditors. Our library includes courses on more than on 50 RA/QA-related
topics. Classes are offered in the US, Costa Rica, and the EU, or can be delivered on-site as is or
customized for your company.
Objectives
Timeline
1968 STAT A MATRIX is founded. Focus is on quality systems development, quality audits, and process quality control and reliability.
1977 Chosen by US FDA to train their investigators in the new medical device regulation.
Trained 1,500 FDA investigators over a 12-month period and worked with FDA to refine the regulation.
1980 Medical device practice expands to include consulting for all phases of a device’s life cycle, from premarket to postmarket requirements.
1988 Oriel, as Joiner Associates, publishes The Team Handbook™; more than 1.4 million copies have been sold to date.
1990 STAT A MATRIX becomes the first US-based company to offer IRCA-Registered Lead Auditor Training. We quickly become
the largest ISO 9000 (and later ISO 13485) training/consulting firm.
In the late 1990s, Oriel is instrumental in developing Lean Six Sigma training for GE, which goes on to become the gold
standard for Lean and Six Sigma training.
Introduction of sustainable performance management (SPM) – a methodology that integrates STAT A MATRIX’s
expertise in quality systems and regulatory conformance with Oriel’s performance excellence experience. Via SPM, our
customers achieve compliance with standards and regulations while making processes more effective and efficient, thus
improving business performance.
2014 Introduction of performance-based auditing methodology – an approach for auditing beyond compliance by analyzing process
performance.
Course Agenda
Course Objectives
Learning Objectives
Postmarket Surveillance
Postmarket Surveillance
(under EU Medical Device
(under 21 CFR 822)
Regulation 2017/745)
Initiated after an FDA Initiated by the manufacturer
request for post-design as a proactive process to
control data obtained identify any need to
during clinical examinations immediately apply any
FDA will tell the company necessary corrective or
which data to submit preventive actions
Where Do I Start?
5
Management
8.2.1
Responsibility Feedback
8.2.2
Regulatory
Complaint
Authorities
8.3, 8.4, 8.5 Handling
6 4 Control nonconforming
ISO 13485 Resource QMS product
Analysis of data
8.2.3
Management
Improvement Reporting to
Regulatory
Authorities
INPUTS
7 OUTPUTS Products and
User needs Prod. Realization
Services
ISO 13485:2016
8.5 Improvement
8.5.1 General
The organization shall identify and implement any changes necessary
to ensure and maintain the continued suitability, adequacy and
effectiveness of the quality management system as well as medical
device safety and performance through the use of the quality policy,
quality objectives, audit results, postmarket surveillance, analysis of
data, corrective actions, preventive actions and management review.
(Emphasis added)
Article 10 (8)(i), (9), and Article 78 Post-market surveillance system of the manufacturer (1)
ISO 13485:
Implement a PMS system capable of gathering information
related to meeting customer requirements
As part of the PMS system, ensure procedures are in
place for timely complaint handling and reporting to
Regulatory Authorities
Document procedures for providing notification to the
appropriate Regulatory Authorities
Use data, including postmarket surveillance data, to
identify and implement any changes needed to ensure that
the QMS is effective and the device is safe and effective
Key points or What are 3-4 key points from this section?
takeaways
for section
Next steps What does your team or organization need to do next to start
addressing this topic?
Learning Objectives
Event reporting
Report based
Yes on global
Determine
requirements;
if reporting is Reportable?
document
required
decision maker
and decision
No date
In the complaint file,
document the rationale,
decision maker, and
decision date
Australian Sponsors of Class AIMD, Class III, and Implantable Class IIb
devices must provide three consecutive annual reports to the TGA after
inclusion of the device in the ARTG
The reports should include:
– ARTG number | Product name
– Model number(s)
– Number supplied in Australia and number supplied worldwide
– Number of complaints in Australia and number of complaints worldwide
– Number of adverse events and incident rates in Australia (rate = number of
events / number supplied x 100 = rate%)
– Number of adverse events and incident rates worldwide
– A list of the more common complaints and all of the adverse events
– Device Incident Report (DIR) number of adverse events reported to TGA
– Regulatory / corrective action / notification by manufacturer
MDSAP Audit Approach
Summary
– Manufacturers are required to implement a postmarketing
system that includes provisions for the recovery of devices
– Proposed recalls must be reported by the manufacturer to the
TGA, or to the Sponsor in a timely manner to ensure that a
Sponsor can meet their reporting obligations
– Note: Australian Sponsors are required to provide
manufacturers with any information that will assist the
manufacturer in complying with the obligations of a conformity
assessment procedure (e.g., information in relation to the
recovery of devices)
The Therapeutic Goods Act of 1989 and Therapeutic Goods (Medical Devices) Regulations of 2002
Australia
The Therapeutic Goods Act of 1989 and Therapeutic Goods (Medical Devices) Regulations of 2002
Brazil Resolution RDC No. 67/2009 and Resolution RDC No. 23/2012
Brazil
Trigger Event Time Frame
Report death, serious threat to public health, or falsification occurring Within 72 hours
in Brazil
Report severe adverse event without associated death; report Within 10 days
nonserious adverse event if recurrence has potential to cause a
severe adverse event to a patient, user, or other person
Report events with potential for severe adverse events if the Within 30 days
occurrence is not remote or has already caused / contributed to death
or serious harm to health in the last two years; report if there is a need
for a health hazard evaluation or there is evidence of misuse due to
poor instructions
Report incidents (death, serious threat to public health, or falsification) Within 10 days
occurring in other jurisdictions if the device is approved for sale in
Brazil and affected serial numbers and lots were imported into Brazil
What Make a preliminary and a final report for any incident that comes to
their attention occurring in Canada that involves the device if:
The device is sold in Canada, and
The incident relates to a failure of the device or a deterioration in
its effectiveness or any inadequacy in its labelling or in its
directions for use, and
Has led to the death or a serious deterioration in the state of
health of a patient, user or other person, or could do so if it were
to recur
* Requirement to report incident outside Canada only applies to Class I devices and
does not apply unless the manufacturer has indicated to a regulatory agency of the
country where the incident occurred that the manufacturer will take corrective action, or
unless the regulatory agency has required the manufacturer to take corrective action
CMDR Incident Reporting 59 (1-2) Effective June 23, 2021; Incident reporting for medical devices: Guidance document, Effective June 23, 2021
Incident reporting for medical devices: Guidance document, Effective June 23, 2021
Foreign Risk Notification (FRN) FRN must be provided within 72 hours of when the
for Class II to IV devices manufacturer or importer receives or becomes aware
of a notifiable action
Incident reporting for medical devices: Guidance document, Effective June 2021; Foreign risk notification for medical devices guidance document, January 2021
The persons operating the registered manufacturing sites must report any
adverse event that meets specified criteria to the Marketing Authorization
Holder in a timely manner
The registered manufacturing sites are not required to report any adverse
event directly to a Regulatory Authority
Reportable events
– Malfunction events that may cause or may have caused
health damage:
Serious event (domestic and foreign)
Unlabeled non-serious event (domestic)
Japan
21 CFR 822
Applicable to Class II and Class III devices that meet any
of the following criteria:
– Failure of the device would be reasonably likely to have serious
adverse health consequences
– The device is intended to be implanted in the human body for
more than 1 year
– The device is intended to be used outside a user facility to support
or sustain life
If you fail to comply with requirements that ordered under section 522
of the act and this part, your device is considered misbranded under
section 502(t)(3) of the act and you are in violation of section
301(q)(1)(C) of the act
21 CFR 822
For the guidance document “Postmarketing Safety Reporting for Combination Products” see https://www.fda.gov/media/111788/download
MDSAP
Additional Regulatory Requirements: US
Summary:
The manufacturer develops a process for reporting to FDA incidents
involving device-related deaths, serious injuries, and reportable
malfunctions that occur within and outside the United States if the same or
similar device is marketed to the United States
US
Submit reports to the electronic system for vigilance and postmarket surveillance
EU MDR Article 87
In the event of a serious public Immediately, and not later than 2 days, after the
health threat manufacturer becomes aware of this threat
Vigilance reporting has specified format, content, and frequency of the periodic
summary reporting to the authorities
Section Summary
Key points or
takeaways
for section
Impact on your
organization
and / or your
job role
Next steps
Learning Objectives
Market surveillance “[M]eans the activities carried out and measures taken
EU MDR Article 2(61) by competent authorities to check and ensure that
devices comply with the requirements set out in the
relevant Union harmonisation legislation and do not
endanger health, safety or any other aspect of public
interest protection”
Postmarket Surveillance
Planning Define postmarket surveillance system
Postmarket Establish a postmarket surveillance system
Surveillance
Define, assign, and communicate responsibilities and authorities
Ensure the availability of resources with independence and
competence
Establish cross-functional PMS teams
Establish a procedure for how to make and maintain a PMS plan
Describe how and where the data are collected
Monitor postmarket data actively, proactively, and systematically
Use as a method to implement preventive or corrective action
Define how the postmarket process interacts with other QMS processes
Results are evaluated and reported to top management
Postmarket Surveillance
PMS Plan: Establish complaint reporting and vigilance reporting
Implementing Establish procedure for vigilance activities
and
Conducting Reference vigilance procedures as part of PMS plan
Define methods for communicating with:
• Regulatory Authorities
• Customers
• Other parties (Notified Body, Authorized Representative)
Ensure procedure for corrective action links to processes for:
• Customer complaint handling and trending
• Serious incidents and reporting
• Recalls and market corrections
Section Debrief
Key points or
takeaways
for section
Impact on your
organization
and / or your
job role
Next steps
Learning Objectives
EU
EU MDR PMS Plan Requirements MDR
ISO/TR
20416:2020
PMS Plan Outputs
5-10
© 2021 Oriel STAT A MATRIX. All rights reserved. | PSF-R0
SECTION 5: POSTMARKET SURVEILLANCE PLANNING, DATA COLLECTION, APPRAISAL, AND ANALYSIS
ISO/TR
20416:2020
PMS Plan: Defining the Scope
ISO/TR
20416:2020
PMS Plan: Defining the Scope
ISO/TR
20416:2020
PMS Plan: Establishing the Objectives
© 2020
2021 Oriel STAT A MATRIX. All rights reserved. | PSF-R0 5-18
SECTION 5: POSTMARKET SURVEILLANCE PLANNING, DATA COLLECTION, APPRAISAL, AND ANALYSIS
ISO/TR
20416:2020
PMS Plan: Establishing the Objectives, Cont.
DEFINE OBJECTIVES
©
© 2021
2020 Oriel
Oriel STAT
STAT A
A MATRIX.
MATRIX. All
All rights
rights reserved.
reserved || PSF-R0
PSF-R0 5-19
5-29
Best Practice
PMS Plan Content: Data Collection
Company-sponsored postmarket
☐ PMCF report
clinical follow up-studies
Systematic Reproducible
Options
Search Keywords: Examples include the device name and the
terms disease type
Subject headings: Refer to the database’s controlled
vocabulary to identify the needed search terms
Other access points (e.g., language, format, study type)
• Fields vary by database
Boolean and wildcard operators: Using combinations of
AND, OR, NOT, IS, “*” (wildcard) to refine or expand a search
• Options vary by database; refer to the database’s search
screen to find out how
Examples
Databases Free access: Examples include PubMed, Cochrane Library,
Google Scholar
Commercial publishers (paid access): May provide access to
resources not available in free databases, examples include:
• Embase (European biomedical database)
• Scopus (“[T]he largest abstract and citation database of
peer-reviewed literature: scientific journals, books and
conference proceedings”)
• Web of Science (20,000+ journals covered)
• Ovid databases
4. 34 1
2
5. Etc. …
– Review
Narrative description of what was found
Sample
table
format
FDA’s TPLC
PLC database
https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfTPLC/tplc.cfm
https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfRES/res.cfm
MAUDE Database
https://www.nih.gov/health-information/nih-clinical-research-trials-you/list-registries
Data Appraisal
MEDDEV
General Data Appraisal Process
Data appraisal
Data Data
Data appraisal
Go to analysis
and
Is it scientifically valid?
What weight does the data
(confirm safety and
performance) point have compared to
other data?
Is it relevant based on
criteria established
in planning?
Data Appraisal
1. Create a data appraisal plan
2. Document the plan and appraisal in the PMS plan, PMSR
report, and PSUR report
3. Evaluate quality of data in a defined method
4. Conduct the data appraisal on all data sets
5. Determine relevance to the clinical data
6. Systematically weight the contribution of the data set
7. Document appraisal of data sets in the PMSR / PSUR
Data Analysis
– Quantitative analysis
Descriptive
Inferential statistics
Semi-quantitative includes both qualitative and quantitative analysis
– An example is statistical process control
Trend analysis
– Identify patterns over a specified timeframe
– Historical data can serve as baselines
– As an alternative action, alert limits can be set by management
or quality
– Continually collected data for a specific attribute over time
– Types of changes that a trend analysis can detect:
Significant trend
Sudden spike or outlier
Whether data is subject to cyclic effects
– Trending period should be long enough to see trends or cycle
effects over time (e.g., rolling 12 months)
– SPC-6 in a row typically depicts a trend
Complaint rates
– Normalize the data
– Consider usage of device (single use or reusable)
– Examples: complaints per million; complaints per installed base
Bar charts
– Graphic presentation of frequency distribution
Pareto analysis
– Type of bar chart
– Ranks data by cause in order of decreasing occurrence
– 20% of causes generate 80% of problems
– Helps focus on issues to address
Graphic examples of some of these methods are
presented on the slides that follow
To © 2021 Oriel STAT A MATRIX. All rights reserved. | PSF-R0 5-109
60
50
40
30
20
10
0
January February March April May June July August September October November December
10.00%
8.00%
6.00%
4.00%
2.00%
0.00%
1Q2015 2Q2015 3Q2015 4Q2015 1Q2016 2Q2016 3Q2016 4Q2016 1Q2017 2Q2017
Section Debrief
Key points or
takeaways
for section
Impact on your
organization
and / or your
job role
Next steps
Learning Objectives
ISO/TR
20416:2020
PMS Report: ISO/TR 20416:2020, 5.7
Once the PMS plan has been executed, the PMS data
should be analyzed
Include in the PMSR / PSUR report:
– A “Brief Description of the Device” section – consider addressing:
Product, product family, accessories, connected devices
Models or versions of device
Intended use of the device
Patient population that uses the device
Life cycle of the device
PMSR
PMSR
Class I Devices
Class A, B IVDs Reporting
Reporting
Manufacturers must:
Prepare a postmarket surveillance report (PMSR)
– Summarize results and conclusions of analyses of PMS
– Include a rationale and description of any preventive and
corrective actions taken
Update the report when necessary
Internally, there should be a defined period for updating
Make the report available to the Competent Authority
upon request
EU MDR Article 85
Completes analysis and submits to Health Canada within requested time frame
Default time frame: 30 calendar days, but shorter time frame may be imposed
The analysis should contain the following sections:
Device complaints and incident reports Device malfunction trends, quality issues,
Clinical data and other evidence and results from other analyses
Exposure data or sales data Labeling
Conclusion
Health Canada, Guidance on summary reports and issue-related analyses for medical devices, Part B (January 2021); Amended regulation effective December
23, 2021 (CMDR 25.1 and 39)
EU MDR Article 86
PSUR Contents
EU MDR Article 86
EU MDR Article 86
EU MDR Article 86
Technical
Technical
Postmarket Postmarket Postmarket Documentati
surveillance Documentati
surveillance surveillance onCER
activities on
plan report
Risks
Benefits
Serious incidents Except for expected side effects that are documented in
involving devices made product information, quantified in technical documentation,
available in the and subject to trend reporting
EU market If the incident occurs outside the EU, there is no
requirement to report it in the EU – even if the device is
marketed in the EU
Field safety corrective Includes any field safety corrective action undertaken in
actions for devices made countries outside Europe for devices legally made available
available in the EU market in the EU market
for which actions have Only if the reason for the field safety corrective action is
been taken not limited to the device made available in countries outside
the EU
Submit reports to the electronic system for vigilance and postmarket surveillance
When to report:
Any serious incident Immediately after the manufacturer has established
the causal relationship* with its device or that such
causal relationship is reasonably possible, and
not later than 15 days after the manufacturer has
become aware of the serious incident
In the event of a serious public Immediately, and not later than 2 days, after the
health threat manufacturer becomes aware of this threat
EU MDR Article 87
The manufacturer may provide periodic summary reports instead of individual serious
incident reports
There can be similar For which the root cause has been identified
serious incidents that OR
occur with the same For which a field safety corrective action has
device / device type been taken
and: OR
Where the incidents are common and well documented
Vigilance reporting has specified format, content, and frequency of the periodic
summary reporting to the authorities
EU
EU MDR PMCF Overview MDR
Patient
registries
PMS
Vigilance
Complaints
reporting
PMCF
Patient
Feedback
monitoring
Customer
Usability
surveys
EU MDR Annex XIV
EU
EU MDR Overview of PMCF Activities MDR
Postmarket
surveillance plan: Perform Analyze Document results in
• PMCF required? PMCF PMCF results a PMCF evaluation
• Document PMCF and data report
method
EU
EU MDR PMCF Evaluation Report MDR
EU
EU MDR PMCF Evaluation Report, Cont. MDR
PMCF Impacts
Update the CER using the same risk-dependent cycle, which may
or may not sync with PMS; may include current PMCF status in the
CER updates:
̶ Current status of the PMCF, adverse events, etc.
Also update the CER whenever product has significant changes in
risk, design, or registration (e.g., MDD Î MDR)
Important Tip
Section Debrief
Impact on your
organization
and / or your
job role
Next steps
Learning Objectives
Technical Documentation
Design
History File
Device Medical
Master Device
Record File
510(k) Indications GSPR Clinical Declaration
Summary for Use Evaluation of Conformity
ISO
13485:2016
Postmarket Surveillance in ISO 13485:2016
ISO
13485:2016
Postmarket Surveillance in ISO 13485:2016, Cont.
ISO
13485:2016
Feedback and PMS in Management Review
Process
Complaints and
Feedback Performance
Reports
Measures
PMS
Proactive Reactive
Process
PMS PMS
Effectiveness
Device Marketing
Management 1 Authorization and Facility 2
Registration
Risk Management
7. Purchasing
Measurement,
ure Medical Device Adverse
Analysis and 3 Events and Advisory 4
Improvement Notice Reporting
Design
gn and Device Marketing
5
p
Development Authorization and Facility
7
Registration
Production
duc
and Service 6
Controls
For example:
– A procedure for reviewing the currency of relevant standards and
conducting gap analyses as required
– A requirement to assess design changes and the need for further
technical testing
– A plan for postmarket clinical trials, where necessary, or periodic
literature reviews
Annex III
Annex II
Verification
and
validation
Design and Postmarket
manufacture planning
Labeling Postmarket
information surveillance
Risk PMS
management activities
Information gained
Is the benefit-risk from customer use
analysis still valid? Clinical benefits Changes from
and new indications increasing hazards
or new hazards
Changes in the Clinical
clinical evidence evaluation or
Design Improvement in the
performance
changes design or function
evaluation
(IVD)
Each stage of life-cycle management can be followed through
other processes that are integrated and managed by the QMS
© 2021 Oriel STAT A MATRIX. All rights reserved. | PSF-R0 7-24
SECTION 7: TECHNICAL DOCUMENTATION AND PMS LINKAGES TO QMS PROCESSES
Postmarket Activities
Registration
CE Marking Postmarket
Eudamed
Economic Declaration of Vigilance
operators Conformity
PMS plan
UDI EC Certificate of
Conformity PMCF
Certificates and
reports Labeling Corrective actions
Ongoing processes
What will they ask to see? Where would they start the
PMS technical documentation review?
Postmarket surveillance
What Is Eudamed?
Unique Device
Identification
Eudamed
Clinical Corrective
Investigations Actions What will be public
Market information and
Postmarket Surveillance what will not?
Surveillance
PSURs
EU MDR Article 33
Section Debrief
Key points or
takeaways
for section
Impact on your
organization
and / or your
job role
Next steps
Learning Objectives
Auditor must:
Create an audit program that demonstrates complete coverage of
the manufacturer’s PMS and to determine whether it meets
criteria in EU MDR, IVDR, and ISO/TR 20416, if applicable
Audit the PMS process to ensure it is controlled, has the
appropriate outputs (such as PSUR), and contains both proactive
and reactive inputs
Audit the processes that intersect with the PMS, including risk
management and QMS processes
Evaluate PMS evidence according to Annex II requirements and a
sampling plan
Ensure that audit findings are appropriately and consistently
classified
EU MDR Annex VII 4.5.2
8-8
Thank You and Next Steps
Next Steps
Topic Course
Risk management ISO 14971 Medical Device Risk Management
Training
Complaint handling Medical Device Complaint Handling, Event
Reporting, and Recall Management Training
Visit https://www.orielstat.com/courses/medical-device-RA-QA
Questions?