Professional Documents
Culture Documents
HTM CFPP 01 01a Final
HTM CFPP 01 01a Final
x x
x x
Rescaled Score
min
max min
63
3.7 Scoring the binary questions
Binary questions scored as a positive (yes is the correct/desired answer):
Survey
answer
Initial
score
Min
score
Max
score
Rescaled
score
Yes 1.00 0.00 1.00 1.00
No 0.00 0.00 1.00 0.00
Unknown 0.00 0.00 1.00 0.00
N/A 0.00 0.00 1.00 0.00
<blank> 0.00 0.00 1.00 0.00
Binary questions scored as negative (no is the correct/desired answer):
Survey
answer
Initial
score
Min
score
Max
score
Rescaled
score
Yes 0.00 0.00 1.00 0.00
No 1.00 0.00 1.00 1.00
Unknown 0.00 0.00 1.00 0.00
N/A 0.00 0.00 1.00 0.00
<blank> 0.00 0.00 1.00 0.00
3.8 Scoring numerical questions
Numerical questions with 1 to 5 scale scored as a positive (higher is better):
Survey
answer
Initial
score
Min
score
Max
score
Rescaled
score
1 1.00 1.00 5.00 0.00
2 2.00 1.00 5.00 0.25
3 3.00 1.00 5.00 0.50
4 4.00 1.00 5.00 0.75
5 5.00 1.00 5.00 1.00
<blank> 0.00 1.00 5.00 0.00
64
Numerical questions with a 1 to 5 scale scored as negative (lower is better):
Survey
answer
Initial
score
Min
score
Max
score
Rescaled
score
1 5.00 1.00 5.00 1.00
2 0.00 1.00 5.00 0.00
3 0.00 1.00 5.00 0.00
4 0.00 1.00 5.00 0.00
5 0.00 1.00 5.00 0.00
<blank> 0.00 1.00 5.00 0.00
Note
Where a question uses a 1 to 5 scale, 5 scores as high/always and 1 scores as
low/not at all.
Numerical questions with a 1 to 10 scale scored as positive:
Survey
answer
Initial
score
Min
score
Max
score
Rescaled
score
1 2.00 1.00 11.00 0.10
2 3.00 1.00 11.00 0.20
3 4.00 1.00 11.00 0.30
4 5.00 1.00 11.00 0.40
5 6.00 1.00 11.00 0.50
6 7.00 1.00 11.00 0.60
7 8.00 1.00 11.00 0.70
8 9.00 1.00 11.00 0.80
9 10.00 1.00 11.00 0.90
10 11.00 1.00 11.00 1.00
<blank> 0.00 1.00 11.00 0.00
65
Numerical questions 1 to 10 scale scored as negative:
Survey
answer
Initial
score
Min
score
Max
score
Rescaled
score
1 6.00 1.00 11.00 0.50
2 0.00 1.00 11.00 0.00
3 0.00 1.00 11.00 0.00
4 0.00 1.00 11.00 0.00
5 0.00 1.00 11.00 0.00
6 0.00 1.00 11.00 0.00
7 0.00 1.00 11.00 0.00
8 0.00 1.00 11.00 0.00
9 0.00 1.00 11.00 0.00
10 0.00 1.00 11.00 0.00
<blank> 0.00 1.00 11.00 0.00
Note
The current survey questionnaire contains only four numerical questions where a
scale of 1 to 10 is used. Of these, two score as positive and two as negative.
The wording of the questions using the 1 to 10 scale refers to 10 being 100%
but does not indicate whether a 1 is to be interpreted as zero/not at all, as
would be the case had the 1 to 5 scale been used.
In the table for questions scored as positive, the Initial Score and Max Score have
been incremented by 1 to produce a Rescaled Score which more closely reects
the percentage scale implied by the wording of these questions.
Caveat: Where a researcher recorded a binary Yes answer to this type of numeri-
cal question, the system will amend the answer to a numerical value of 6 (refer to
section 6 of this annex for information on data conversion issues) and calculate the
Rescaled Score as follows:
Original
answer
Amended
answer
Initial
score
Min
score
Max
score
Rescaled
score
Yes 6 6.00 1.00 11.00 0.50
For the questions scored as negative, only the minimum answer value (1) is allo-
cated a non-zero score. However, given the ambiguity in the scale being used for
66
these questions, DH has decided to allocate a Rescaled Score of 0.5 rather than 1.0
where the Initial Score is 1.
A value of 0.5 is consistent with the score that would be achieved had a binary
answer been converted to a numerical.
The relevant survey questions are both in the Vigilance survey category:
439(a)
How frequently, as a % of sets processed, are sets returned for reprocessing found
to have instruments missing? Please indicate the percentage by selecting the appro-
priate number from the drop-down box (10 being 100%)
439(b)
How frequently, as a % of sets processed, are sets returned for reprocessing found
to have instruments which are defective and must be replaced? Please indicate the
percentage by selecting the appropriate number from the drop-down box (10 be-
ing 100%)
4. Quality System Categories
DH has agreed a set of Quality System Categories to facilitate the analysis of the
survey results and has assigned each survey question to an appropriate category.
Weighting factors are scaled from 1 to 5. A weighting of 1 indicates that a survey
question is of minimal relevance in terms of prion removal and deactivation. A
weighting of 5 indicates that a survey question is of the highest relevance in these
terms.
67
4.1 Quality System Categories relevant to prion removal and deactivation
QS_ID
Quality System
Category
Relevant guid-
ance
Relevant EN/
ISO standards
Weighting
factor
No. of
ques-
tions
5
Washing /
disinfection
HTM 2030
HTM 01-01 A
Washer-disin-
fectors
BS EN ISO
15883 1/2/3,
(2006)
5 106
6 Water quality HTM 04-01
Water Supply
BS 6700
(2006)
3 31
7 Inspection
HTM 01-01
Part A
5 68
9
Sterilization /
Steam
HTM 2010
HTM 2031
Steam Steriliz-
ers
BS EN 285
(2006) (Large)
BS 13060
(2004) (Small)
BS EN 556
1 (2001) 2
(2003)
5 144
10 Record keeping
HTM 01-01
Part A
Record Man-
agement Code
of Practice
(2006)
Medical De-
vices, Quality
Management
Systems: BS
EN ISO 13485
(2003)
5 80
11
Instrument
tracking
HTM 01-01
Part A
Coding For
Success (GS1)
5 20
12
Instrument
quality control
ESAC-Pr 2006
MDD Essential
Requirements
Medical De-
vices, Quality
Management
Systems: BS
EN ISO 13485
(2003)
2 22
68
QS_ID
Quality System
Category
Relevant guid-
ance
Relevant EN/
ISO standards
Weighting
factor
No. of
ques-
tions
14
Staffng / train-
ing
IDSc initiative
IHEEM AE(D)
5 32
16
Management
controls
HTM 01-01
Part A,
CQC
MHRA notifed
body.
Medical De-
vices, Quality
Management
Systems: BS
EN ISO 13485
(2003)
5 176
17
Dispatch and
transport
Clean Waste
UN 3291
Trade Bar-
rier Regulations
(2007)
2 44
Number of relevant survey questions 723
Notes
No. of questions refers to the number of questions assigned to each Quality Sys-
tem Category in the NDS 2008/10.
69
4.2 Quality System Categories related to quality of decontamination for general
patient and staff safety purposes
QS_ID Quality System
Category
Relevant guid-
ance
Relevant
EN/ISO
standards
Weighting
factor
No. of
ques-
tions
1
Environmental
control
HBN 13
CFPP 01-01 B
BS EN
ISO
14644
BS 5925
(1991)
1 188
2
Stafng control
HTM 01-01 Part
A
1 11
3
Personal hygiene
HCAI 08 Code
of Practice
1 15
4
Personnel / staff
safety
Health & Safety
at Work Act
1974
1 30
8
Packaging
HTM 01-01
Parts A and B.
BS EN
ISO
11607
(2006)
1 22
13
Microbiological
supervision
HTM 01-01 Part
A,
HCAI 08 Code
of Practice
1 10
15
Disposal
HTM 01-01 Part
A
1 1
- Unmapped ques-
tions
- 10
Number of non-relevant survey questions 287
70
5. Type of question positive, negative and neutral
The Question type determines the scoring method applied to each survey answer.
Question
type
Scoring method No. of
questions
Positive
A yes answer is scored as a positive response and a no
answer is scored as a negative response
896
Negative
A no answer is scored as a positive response and a yes
answer is scored as a negative response
100
Neutral
Answers are indeterminate in terms of their perceived merit
and therefore are not scored
14
Number of survey questions: 1010
6. Data conversion issues
Due to weak data type enforcement in the data capture application, it was possible
for a researcher to record a binary answer against a numerical question and a nu-
merical answer against a binary question. In total, 1,506 answers required conver-
sion (see table in section 6.6, audit keys 6 to 15) out of a total of 50,496.
DH devised the following decision tables to determine the appropriate method of
conversion for each possible case.
6.1 Conversion of binary answers to numerical answers
Where a researcher recorded a binary answer to a non object-related numerical
question, the system amends the answer in accordance with the following decision
table:
Survey
answer
Answer is amended to:
where scale =
1 to 5
where scale =
1 to 10
Yes 3 6
No 1 1
Not applicable 0 0
Unknown 1 1
Not available 1 1
See comment 1 1
71
6.2 Conversion of numerical answers to binary answers
Where a researcher recorded a numerical answer to a binary question, the system
amends the answer in accordance with the following decision table:
Survey
answer
converted to:
1 No
> 1 Yes
6.3 Normalisation of not applicable answers
Where a researcher answered no more than one question in a particular survey cat-
egory the system enters not applicable against all of the unanswered questions in
that survey category. This is done so that non-relevant categories are removed from
the scoring process for each site.
The following table contains a record for the NDS 20082010 of all not applicable
records entered by the system:
Survey category
Category
type
No. of
sites
Total N/A
records
Transport system SSD 1 43
Other sterilizer ENG 19 796
Vacuum bench ENG 25 1,573
Local clinical reprocess-
ing
ENG 20 538
Bench top ENG 23 1,171
Number of normalised records: 28 4,121
72
6.4 Audit table for system-generated answers
Audit
key
Audit subject / answers entered by system
No. of
answers
02
Normalisation of scoring by entering not applicable
against all unanswered questions in blank survey
categories (i.e. those where no more than one an-
swer is recorded)
4,121
03
Normalisation of scoring for additional items of
equipment by entering unknown against unan-
swered questions where the Item no. is greater
than 1
174
04
Normalisation of scoring for additional items of
equipment by entering unknown against unan-
swered questions where the Item no. is 1
7
Number of answers entered by system 4,302
Note
The total number of answers recorded during the current survey was 50,496 (in-
cluding the above total).
73
6.5 Audit table for system-generated amendments to answers
Audit
key
Audit subject / answers amended by system
Refer to
table
No. of
answers
01
Re-mapping of Equipment item no. from 11 to 10 in
Porous Load section to correct error in previous data
capture application
- 322
05
Removal of amended answers where amendment and
original answer are identical
- 8
06
Binary questions numerical answer 1 converted to
binary No
6.2 6
07
Binary Questions numerical answer >1 converted to
binary Yes
6.2 79
08
Numerical questions (1 to 10):
binary answer Not applicable converted to numerical
0
6.1 20
09
Numerical questions (1 to 10):
Binary answers No, Unknown, Not available or
See comment converted to numerical 1
6.1 5
10
Numerical questions (1 to 10):
binary answer Yes converted to numerical 6
6.1 1
11
Numerical questions (1 to 5):
Binary answer Not applicable converted to numerical
0
6.1 743
12
Numerical questions (1 to 5):
Binary answers No, Unknown, Not available or
See Comment converted to numerical 1
6.1 143
13
Numerical questions (1 to 5):
binary answer Yes converted to numerical 3
6.1 423
14
Object numerical questions:
Binary answer {not Yes} converted to numerical 0
- 82
15
Object numerical questions:
binary answer Yes converted to numerical 1
- 4
Number of answers amended by system 1836
74
6.6 Audit table for all recorded survey answers
Audit subject survey answers No. of answers
No. of recorded survey answers 50,496
less irrelevant answers (9,814)
No. of relevant answers 40,682
Relevant answers not scored:
text / date answers (265)
object numerical answers (150)
neutral answers (1,093)
not applicable answers (14,203)
less relevant answers not scored (15,711)
Number of answers scored 24,971
Number of trusts surveyed 26
Number of sites surveyed 30
Note
The above gures include 83 blank answers of which 13 (8 weighted as 1 and
5 that were text answers) were not scored.