M
Question 1
emorandum for Assignment 02
Option 4 is the key
Lesiba, Joly, Paul
Question 2
Option 5 is the key
Paul, Lesiba, Joly
Question 3
Option 1 is the key
Paul, Joly, Lesiba
Open Rubric
Sanna: I think there is a printing error in the manual. Figure 1 is
incomplete with no proper explanation provided. Do you know
what this figure is about?
Joly: Looking at the numbers I think the figure is a graphical
representation of the information provided for Item 2.1 in Table 3
Lesiba: If your assumption is correct, Joly, the figure expresses the item-
total correlation for Item 2.1
Paul: No, I think the figure expresses the fact that five people
completed each item in the questionnaire
You agree most with, second most with and least with:
1. Paul, Joly, Lesiba
2. Joly, Lesiba, Paul
3. Lesiba, Paul, Joly
4. Lesiba, Joly, Paul
5. Joly, Paul, Lesiba
Sanna: So, what do the numbers on the X-axis mean?
Lesiba: I think the numbers on the X-axis represent the possible
responses to Item 2.1
Joly: If the numbers on the X-axis represent the possible responses to
Item 2.1 it means five people completed the item
Paul: If the X-axis represents Item 2.1 I would say it means the numbers
1 to 5 are associated with the scale categories that range from
disagree strongly to agree strongly
You agree most with, second most with and least with:
1. Lesiba, Joly, Paul
2. Lesiba, Paul, Joly
3. Paul, Joly, Lesiba
4. Joly, Lesiba, Paul
5. Paul, Lesiba, Joly
Sanna: And those numbers in the square brackets, [1], [2], etc. What do
they stand for?
Lesiba: The numbers in the square brackets are discrimination values.
They reflect the proportion of individuals who completed the item
correctly
Joly: No, each point indicates the item score and the total score of a
particular individual
 Paul: For example, [1] means that participant 1 obtained a total score of
44 and also disagreed strongly with the statement that drinking is
relaxing

You agree most with, second most with and least with:

1. Paul, Joly, Lesiba

2. Joly, Paul, Lesiba
3. Paul, Lesiba, Joly
4. Lesiba, Joly, Paul
5. Joly, Lesiba, Paul

Question 4 You: Compare Item 2.10 as it is formulated in the questionnaire with

the item’s item-total correlation shown in Figure 2. Do you find
Option 3 is the key this result surprising?

Sanna, Lesiba, Paul Sanna: The item-total correlation is weak, which is not surprising because
it is not clear whether the item reflects inspirational or non-
inspirational behaviour
Paul: The item-total correlation is positive and negative, which is not
surprising because the item reflects inspirational and non-
inspirational
Lesiba: The item-total correlation is negative, which is not surprising
because it is not clear how the item relates to inspirational
behaviour

You agree most with, second most with and least with:

1. Sanna, Paul, Lesiba

2. Lesiba, Sanna, Paul
3. Sanna, Lesiba, Paul
4. Paul, Lesiba, Sanna
5.Lesiba, Paul, Sanna
Question 5 You: Compare Item 2.6 as it is formulated in the questionnaire with the
item’s item-total correlation shown in Figure 3. Do you find this
Option 5 is the key result surprising?

Paul, Lesiba, Sanna. Sanna: The item-total correlation is positive, which is not surprising
because the item reflects a clear stance to inspirational behaviour
Paul: The item-total correlation is negative, which is not
surprising because the item requires reversed scoring
Lesiba: The item-total correlation is negative, which is not surprising
because the item reflects non-inspirational behaviour

You agree most with, second most with and least with:

1. Paul, Sanna, Lesiba

2. Lesiba, Paul, Sanna
3. Lesiba, Sanna, Paul
4. Sanna, Lesiba, Paul
5. Paul, Lesiba, Sanna

Question 6 You: Compare Item 2.9 as it is formulated in the questionnaire with the
item’s item-total correlation shown in Figure 4. Do you find this
Option 2 is the key result surprising?

Lesiba, Joly, Sanna Lesiba: The item-total correlation is positive which is not surprising
because individuals who measure high on inspirational behaviour
should get a high score on this item

2
 Joly: The item-total correlation is negative which is surprising because
the item expresses influential behaviour
Sanna: The item-total correlation is weak which is not surprising because
the item requires reversed scoring

You agree most with, second most with and least with:

1. Joly, Lesiba, Sanna

2. Lesiba, Joly, Sanna
3. Sana, Joly, Lesiba
4. Lesiba, Sanna, Joly
5. Joly, Sanna, Lesiba

Question 7 You: Compare Item 2.13 as it is formulated in the questionnaire with

the item’s item-total correlation shown in Figure 5. Do you find
Option 2 is the key this result surprising?

Paul, Joly, Sanna Joly: The correlation is negative, which is not surprising because the
item required reversed scoring
Paul: The correlation is weak, which is not surprising because the item
has a very strong social response bias with low discrimination
between individuals
Sanna: The correlation is positive, which is surprising because the item
portrays influencing behaviour in a negative light

You agree most with, second most with and least with:

1. Joly, Paul, Sanna

2. Paul, Joly, Sanna
3. Joly, Sanna, Paul
4. Sanna, Joly, Paul
5. Paul, Sanna, Joly

Question 8 You: Given your previous considerations, which of the four items would
you discard and why?
Option 1 is the key
Lesiba: Item 2.10 because of low item discrimination and Item 2.6 due to
Paul, Lesiba, Sanna negative item discrimination
Sanna: Item 2.6 because of its negative item discrimination and 2.9
because it has low item variance
Paul: Item 2.10 because of low item discrimination and Item 2.13 due to
low item variance

You agree most with, second most with and least with:

1. Paul, Lesiba, Sanna

2. Sanna, Lesiba, Paul
3. Paul, Sanna, Lesiba
4. Lesiba, Paul, Sanna
5. Lesiba, Sanna, Paul

Question 9 You: Given the way in which we want to use the LQ, how would you
approach the reliability of the questionnaire?
Option 1 is the key
Paul: It is important to make sure that the LQ has high internal
Paul, Joly, Sanna consistency because we need a reliable measure of the ‘preferred

3
 behaviour style’ construct
Joly: I think test-retest reliability is more important than internal
consistency, given the way in which we want to use the LQ
Sanna: Because we want to identify learners at risk of emotional burnout
and underperformance it is important to consider criterion-
related reliability as the most important component of the LQ’s
reliability

You agree most with, second most with and least with:

1. Paul, Joly, Sanna

2. Joly, Sanna, Paul
3. Paul, Sanna, Joly
4. Sanna, Joly, Paul
5.Joly, Paul, Sanna
Question 10 Joly: I presume the same goes for validity. We have to consider our
approach concerning the validity of the LQ
Option 5 is the key
Sanna: Because our goal is to identify learners who could benefit from
Paul, Sanna, Lesiba motivational and support programmes I think it is important to
consider the concurrent validity of the LQ
Paul: I agree, Lesiba, but we have to make sure the LQ has construct
validity otherwise the LQ’s concurrent validity may be suspect
Lesiba: Face validity is the most important aspect of validity to consider. If
the learners cannot see that the LQ is about preferred behaviour
style they may think the questionnaire has no value

You agree most with, second most with and least with:

1. Sanna, Paul, Lesiba

2. Paul, Sanna, Lesiba
3. Lesiba, Sanna, Paul
4. Paul, Lesiba, Sanna
5. Sanna, Lesiba, Paul

Question 11 You: Considering the information provided in Table 4, what do you

think of the construct validity of the LQ?
Option 5 is the key
Joly: The high correlations between the Influence, Inspiration and
Lesiba, Joly, Paul Intellectual stimulation factors support the construct validity of
the LQ
Paul: The low correlation between the Recreation factor and the
Influence, Inspiration and Intellectual stimulation factors show
low construct validity of the LQ
Lesiba: The information in Table 4 supports the construct validity of the
LQ, but the LQ does not fully represent the content domain of the
construct it purports to assess

You agree most with, second most with and least with:

1. Lesiba, Paul, Joly

2. Joly, Lesiba, Paul
3. Joly, Paul, Lesiba
4. Paul, Joly, Lesiba
5. Lesiba, Joly, Paul

Question 12 Sanna: I think Table 5 provides further information about the construct

4
 validity of the LQ?
Option 3 is the key
Paul: Yes, the correlations among the questionnaires show convergent
Lesiba, Paul, Joly and discriminent validities that support construct validity for the
LQ
Lesiba: In addition to supporting construct validity for the LQ the
correlation between the LQ and the presenter-manager ratings
also indicates support for concurrent validity for the LQ
Joly: The table shows convergent validity but it does not support
discriminant validity for the LQ

You agree most with, second most with and least with:

1. Lesiba, Joly, Paul

2. Paul, Lesiba, Joly
3. Lesiba, Paul, Joly
4. Joly, Paul, Lesiba
5. Paul, Joly, Lesiba

Criteria applied for the rating questions (13-25) are listed below:

Q Rating Comment Criteria Scale

13 1 AIQ instructions refer to c only The instructions of the LQ are correct Rate 1 if: none of a, b, c
NB: The scale needs to be if: Rate 2 if: a
changed to: a the intention of the LQ is Rate 3 if: a+b
“None of the following” indicated correctly Rate 4 if: a+b+c
As is the scale cannot be b the matter of confidentiality is
applied (the rating one addressed correctly
indicates that c is not, which is c general instructions for
incorrect) completing the AIQ are indicated
correctly
14 2 Not b Item 2.12 is formulated correctly if: Rate 1 if: none of a, b, c, d, e
a Item 2.12 has content and
construct relevance Rate 2 if: a
b Item 2.12 is clear and Rate 3 if: a + b + c
unambiguous Rate 4 if: a + b + c + d + e
c Item 2.12 is configured correctly
d Item 2.12 is not leading
e Item 2.12 is not likely to elicit a
socially desirable response
15 4 All Item 2.12 is suitable if: Rate 1 if: none of a, b, c
a the respondents are likely to find Rate 2 if: a
the language level appropriate Rate 3 if: a + b
b the respondents are likely to find Rate 4 if: a + b + c
the item relevant in their context
c the respondents are likely to
possess the knowledge required
to respond correctly

5
 16 2 Incorrect configuration Item 3.4 is formulated correctly if: Rate 1 if: none of a, b, c, d, e
a Item 3.4 has content and
construct relevance Rate 2 if: a
b Item 3.4 is clear and Rate 3 if: a + b + c
unambiguous Rate 4 if: a + b + c + d + e
c Item 3.4 is configured correctly
d Item 3.4 is not leading
e Item 3.4 is not likely to elicit a
socially desirable response
17 3 Not required knowledge Item 3.4 is suitable if: Rate 1 if: none of a, b, c
a the respondents are likely to find Rate 2 if: a
the language level appropriate Rate 3 if: a + b
b the respondents are likely to find Rate 4 if: a + b + c
the item relevant in their context
c the respondents are likely to
possess the knowledge required
to respond correctly
18 4 All Item 5.6 is formulated correctly if: Rate 1 if: none of a, b, c, d, e
a Item 5.6 has content and
construct relevance Rate 2 if: a
b Item 5.6 is clear and Rate 3 if: a + b + c
unambiguous Rate 4 if: a + b + c + d + e
c Item 5.6 is configured correctly
d Item 5.6 is not leading
e Item 5.6 is not likely to elicit a
socially desirable response
19 3 Not required knowledge Item 5.6 is suitable if: Rate 1 if: none of a, b, c
a the respondents are likely to find Rate 2 if: a
the language level appropriate Rate 3 if: a + b
b the respondents are likely to find Rate 4 if: a + b + c
the item relevant in their context
c the respondents are likely to
possess the knowledge required
to respond correctly
20 1 Consideration factor not The LQ is functional if: Rate 1 if: none of a, b, c
present in LQ a the information gathered by the Rate 2 if: a
LQ contains a section on LQ concerns the intended Rate 3 if: a + b
physical activity not part of LQ content domain Rate 4 if: a + b + c
construct b the LQ is suitable for the
intended target population
c the LQ produces information in a
format that facilitates data
processing
21 2 Aim is stated The purpose of the LQ is described if: Rate 1 if: none of a, b, c
Target population not indicated a the aim of the LQ is stated Rate 2 if: a
Design described b the target population is Rate 3 if: a + b
defined Rate 4 if: a + b + c
c the design of the LQ is
described
22 2 Sample described The properties of the LQ are Rate 1 if: none of a, b, c, d
Data provided, but no discussed if: Rate 2 if: a
information about item analysis a the sample used to test the LQ is Rate 3 if: a + b
and selection described correctly Rate 4 if: a + b + c or a + b + d
Reliability and validity not b the item analysis and selection Rate 5 if: a + b + c + d
discussed procedures are described
correctly

6
 c the reliability of the LQ is
discussed correctly
d the validity of the LQ is discussed
correctly
23 2 Administration instructions The procedures for utilising the LQ
provided are described if:
Scoring instructions is a instructions are provided
insufficient for administering the LQ
Interpretation instruction b instruction are provided for
sprovided scoring the LQ
c instructions are provided
for interpreting results
Rate 1 if: none of a, b, c
Rate 2 if: a
Rate 3 if: a + b
Rate 4 if: a + b + c
24 4 All The manual is structured properly if: Rate 1 if: none of a, b, c
a the text is clustered into topical Rate 2 if: a
sections Rate 3 if: a + b
b topics are presented in logical Rate
order 4 if:
c the information about each topic
is relevant and presented a +b
coherently +c
25 3 Text contains conflicting The manual is written properly if: Rate 1 if: none of a, b, c
information Items not a the text is factual and objective Rate 2 if: one of a, b, c
numbered correctly; Two tables b the text is clear and to the point, Rate 3 if: two of a, b, c
indicated as Table 3 etc. with no ambiguous and/or Rate 4 if: a + b + c
C is fine conflicting statements
c the text is not inundated with
numerous spelling, grammar and
punctuation errors

Wishing you success in your studies!