University of The Philippines Diliman Extension Program in Pampanga

Clark Special Economic Zone, Pampanga

‘A Quiz of Ice and Fire”: A Cognitive Test on Game of Thrones

In partial fulfillment of the requirements for the course Psychology 162: Psychological
Measurement

Louise Macapagal Osayan

 A Quiz of Ice and Fire

AQOIAF, or A Quiz of Ice and Fire, was constructed to be able to test the breadth of

knowledge of both fans and non-fans of HBO’s hit television series: “Game of Thrones”. Game

of Thrones is an adaptation of George R.R. Martin’s fantasy series “A Song of Ice and Fire”. The

television series was created by David Benioff and D.B. Weiss. (“Game of Thrones,” n.d., para.

1) AQOIAF was made to find out what fans and non-fans know about the television series only,

and not the entire A Song of Ice and Fire universe.

The test consists of 50 items which have been categorized into varying difficulties. It

contained 20 difficult items, 15 moderate difficulty items, and 15 easy items. The difficult items

were comprised of questions that were specifically about the production of the TV series itself,

and a few questions about episode names. The moderate difficulty items contained questions

entirely about lines said by the characters, and the easy questions were about various

terminologies, character names, and information about the characters.

Description of Sample

The test was made to measure the knowledge of college students about Game of Thrones,

whether they were fans of the show or not. No other parameters were set by the test developer in

the gathering of test takers. A total of thirty-three college students were able to take the test.

(N=33)

Table 1 shows the percentage of male vs. female test takers. Fifteen (15) of the test takers

were male, while eighteen (18) were female.

Table 1
Gender of Test Takers
 Cumulative
Frequency Percent Valid Percent Percent

Valid Male 15 45.5 45.5 45.5

Female 18 54.5 54.5 100.0

Total 33 100.0 100.0

Table 2 shows the age of the test takers. Majority of the test takers were between eighteen

to nineteen (18-19) years of age, making up at least 75% of the total number of test takers.

Table 2
Age of Test Takers
Cumulative
Frequency Percent Valid Percent Percent

Valid 18 12 36.4 36.4 36.4

19 13 39.4 39.4 75.8

20 5 15.2 15.2 90.9

21 1 3.0 3.0 93.9

22 1 3.0 3.0 97.0

23 1 3.0 3.0 100.0

Total 33 100.0 100.0

Table 3 shows the various degree programs of the test takers. At least 27% of the test

takers were from the BA Applied Psychology program of the University of the Philippines –

Diliman Extension Program in Pampanga (UPDEPP), while at least 15% of them were from the

BS Business Management Program in UPDEPP as well. All the other test takers were spread out

across different degree programs.

Table 3
Degree Program of the Test Takers
 Table 4 shows the different universities that the test takers came from. At least 50% of

the test takers were from the University of the Philippines – Diliman Extension Program in

Pampanga (UPDEPP), while the other half is comprised of different universities from both

Region III and the NCR.

Table 4

Universities of the Test Takers

 Table 5 shows the number of test takers who have watched the show. At least 88% of the

test takers, or 29 of them, have watched the show, while only 4, or 12% of them have not

watched the show.

Table 5
No. of Test Takers Who Have Watched the Show
Cumulative
Frequency Percent Valid Percent Percent

Valid No 4 12.1 12.1 12.1

Yes 29 87.9 87.9 100.0

Total 33 100.0 100.0

Table 6 shows the number of seasons of the show that have been watched by the test

takers. 75% of the test takers or 25 out of 33 of them, have watched all the seasons of the show.

Table 6

Cumulative
Frequency Percent Valid Percent Percent
 Valid 0 4 12.1 12.1 12.1
No. of Seasons Watched
1 1 3.0 3.0 15.2

6 2 6.1 6.1 21.2

7 1 3.0 3.0 24.2

8 25 75.8 75.8 100.0

Total 33 100.0 100.0

Table 7 shows the number of the people who are fans and not fans of the show. The test

takers were asked how much of a fan they think they are on a scale of 1 to 5; 5 being the highest

and 1 being the lowest. 23 out of 33 test takers answered 4 to 5, meaning they considered

themselves as fans of the show, while only 5 out of 33 test takers did not see themselves as fans

of the show.

Table 7
No. of Fans & Non-Fans
Cumulative
Frequency Percent Valid Percent Percent

Valid 1 4 12.1 12.1 12.1

2 1 3.0 3.0 15.2

3 5 15.2 15.2 30.3

4 15 45.5 45.5 75.8

5 8 24.2 24.2 100.0

Total 33 100.0 100.0

Description of Test Scores (frequency table, frequency polygon, descriptive stat. table of
standard scores)
Table 8 shows the number of test takers who got a certain score. The lowest score, as

shown in the table is 10, while the highest score is 44. Only one test taker got the lowest score,

while two people got the highest score. The score with the highest frequency is 32, and five test

takers got this score, which is equivalent to at least 15% of the total number of test takers.

Table 8
Frequency Table
Cumulative
Score Frequency Percent Valid Percent Percent

Valid 10 1 3.0 3.0 3.0

12 1 3.0 3.0 6.1

14 2 6.1 6.1 12.1

15 2 6.1 6.1 18.2

17 1 3.0 3.0 21.2

18 3 9.1 9.1 30.3

22 2 6.1 6.1 36.4

25 1 3.0 3.0 39.4

27 2 6.1 6.1 45.5

29 1 3.0 3.0 48.5

31 3 9.1 9.1 57.6

32 5 15.2 15.2 72.7

33 1 3.0 3.0 75.8

34 1 3.0 3.0 78.8

35 1 3.0 3.0 81.8

39 2 6.1 6.1 87.9

41 1 3.0 3.0 90.9

43 1 3.0 3.0 93.9

44 2 6.1 6.1 100.0

Total 33 100.0 100.0

Table 9
Frequency Polygon

Table 10 shows the descriptive statistics obtained using the test scores. Using the data

gathered via test administration, the results that were ran through SPSS shows an obtained mean

of 27.52, a median of 31, and a mode of 32. The standard deviation is equal to 9.95

Table 10
Descriptive Statistics

N Valid 33

Missing 0
Mean 27.52
Std. Error of Mean 1.733
Median 31.00
Mode 32
Std. Deviation 9.957
Variance 99.133
Skewness -.083
 Std. Error of Skewness .409
Kurtosis -1.048
Std. Error of Kurtosis .798
Range 34
Minimum 10
Maximum 44
Sum 908
Percentiles 25 18.00

50 31.00

75 33.50

Reliability Analysis

Table 12 and 13 show the Split-Half Reliability of the test items. Since the variance of

the two halves are not equal, Cronbach’s Alpha Coefficient should be used instead.

Table 12
Split-Half Reliability Statistics
Cronbach's Alpha Part 1 Value .822

N of Items 25a

Part 2 Value .872

N of Items 25b

Total N of Items 50
Correlation Between Forms .795
Spearman-Brown Coefficient Equal Length .886
Unequal Length .886
Guttman Split-Half Coefficient .883

Table 13
Split-Half Scale Statistics

Mean Variance Std. Deviation N of Items

Part 1 13.82 24.716 4.972 25a

Part 2 13.70 30.655 5.537 25b
Both Parts 27.52 99.133 9.957 50
 Table 14 shows the Cronbach’s Alpha Coefficient of the test. The Cronbach Alpha
Coefficient is 0.916, and 0.915 if Item Number 43 is deleted. A higher Cronbach Alpha value
indicates greater internal consistency and reliability, and since the values can only range from 0
to 1, it can be inferred from the reliability coefficient obtained via SPSS that the test reliability is
actually good or strong.
Table 14
Cronbach’s Alpha Coefficient
Reliability Statistics

Cronbach's
Alpha Based on
Cronbach's Standardized
Alpha Items N of Items

.916 .915 49

Table 15
Cronbach’s Alpha if Item is Deleted

Corrected Item- Squared Cronbach's

Scale Mean if Scale Variance Total Multiple Alpha if Item
Item Deleted if Item Deleted Correlation Correlation Deleted

VAR00001 25.70 95.405 .467 . .914

VAR00002 26.03 94.905 .401 . .914
VAR00003 25.64 96.301 .418 . .914
VAR00004 26.33 99.292 -.040 . .918
VAR00005 25.70 95.718 .426 . .914
VAR00006 26.30 97.030 .236 . .916
VAR00007 25.79 93.422 .630 . .912
VAR00008 26.06 99.121 -.024 . .919
VAR00009 26.18 99.278 -.039 . .919
VAR00010 25.70 95.968 .392 . .914
VAR00011 25.82 94.778 .455 . .914
VAR00012 25.88 92.047 .730 . .911
VAR00013 25.88 93.172 .607 . .912
VAR00014 26.06 95.059 .387 . .914
VAR00015 26.33 98.292 .089 . .917
VAR00016 26.06 95.434 .349 . .915
VAR00017 26.27 95.142 .448 . .914
VAR00018 25.70 95.405 .467 . .914
VAR00019 25.94 94.871 .410 . .914
VAR00020 25.94 93.496 .555 . .913
VAR00021 26.15 97.320 .163 . .917
VAR00022 26.09 94.898 .407 . .914
VAR00023 25.91 95.648 .334 . .915
VAR00024 25.76 94.189 .563 . .913
VAR00025 25.85 94.133 .514 . .913
VAR00026 25.88 95.797 .324 . .915
VAR00027 26.21 93.860 .559 . .913
VAR00028 26.09 94.648 .433 . .914
VAR00029 26.30 99.218 -.031 . .918
VAR00030 25.64 95.989 .467 . .914
VAR00031 25.88 94.110 .505 . .913
VAR00032 25.64 96.864 .331 . .915
VAR00033 25.97 92.968 .606 . .912
VAR00034 26.15 96.258 .275 . .916
VAR00035 25.73 95.517 .424 . .914
VAR00036 25.70 94.843 .542 . .913
VAR00037 26.21 95.047 .425 . .914
VAR00038 26.30 98.155 .098 . .917
VAR00039 25.85 94.570 .465 . .914
VAR00040 26.03 92.468 .656 . .911
VAR00041 26.06 92.059 .703 . .911
VAR00042 25.64 95.739 .506 . .914
VAR00046 26.18 96.028 .306 . .915
VAR00044 25.97 91.780 .732 . .911
VAR00045 26.18 94.028 .525 . .913
VAR00047 25.82 96.841 .226 . .916
VAR00048 25.85 92.508 .695 . .911
VAR00049 26.27 96.267 .313 . .915
VAR00050 26.12 93.547 .556 . .913

Item Analysis

Table 16

Difficulty Index for the entire test

 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34

8 27 19 19 12 14 20 25 22 21 10 14 7 29 21 29 18 12

0.242 0.818 0.576 0.576 0.364 0.424 0.606 0.758 0.667 0.636 0.303 0.424 0.212 0.879 0.636 0.879 0.545 0.364

35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50

26 27 10 7 22 16 15 29 33 18 11 11 23 22 8 13

0.788 0.818 0.303 0.212 0.667 0.485 0.455 0.879 1 0.545 0.333 0.333 0.697 0.667 0.242 0.394

Question # 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
No. of Correct
Answers per
Item 27 16 29 6 27 7 24 15 11 27 23 21 21 15 6 15
Item Difficulty
Index (p) 0.818 0.485 0.879 0.182 0.818 0.212 0.727 0.455 0.333 0.818 0.697 0.636 0.636 0.455 0.182 0.455
Distractor Analysis
Item 1 A B* C D
U 1 9 0 0
L 4 5 1 0

Item 2 A B* C D
U 0 6 3 1
L 2 2 2 4

Item 3 A* B C D
U 10 0 0 0
L 6 3 1 0

Item 4 A B C* D
U 5 3 2 0
L 4 2 2 2

Item 5 A B C* D
U 0 0 10 0
L 1 2 7 0

Item 6 A B C D*
U 1 2 4 3
L 4 3 2 1

Item 7 A B C* D
U 0 0 10 0
L 2 3 2 3

Item 8 A B C* D
U 3 1 5 1
L 2 3 5 0

Item 9 A B* C D
U 4 4 1 1
L 0 3 3 4

Item 10 A B* C D
U 0 10 0 0
 L 3 7 0 0

Item 11 A B C* D
U 1 0 8 1
L 4 2 4 0

Item 12 A B* C D
U 0 10 0 0
L 2 1 2 5

Item 13 A B C D*
U 0 0 0 10
L 1 5 2 2

Item 14 A B C D*
U 0 3 0 7
L 1 4 2 3

Item 15 A* B C D
U 3 4 0 3
L 2 5 2 1

Item 16 A B C* D
U 3 0 7 0
L 0 4 3 3

Item 17 A B* C D
U 2 6 0 2
L 6 1 1 2

Item 18 A B C* D
U 0 1 9 0
L 2 2 6 0

Item 19 A B C* D
U 2 0 8 0
L 4 2 3 1
Item 20 A B C D*
U 1 0 0 9
L 3 4 1 2

Item 21 A B* C D
U 2 5 2 1
L 1 3 2 4

Item 22 A B C* D
U 0 1 8 1
L 1 5 2 2

Item 23 A B* C D
U 2 0 0 8
L 3 2 2 3

Item 24 A B C D*
U 0 10 0 0
L 2 4 0 4

Item 25 A B C* D
U 0 0 10 0
L 3 2 3 2

Item 26 A B* C D
U 0 8 0 2
L 2 5 0 3
Item 27 A B C D*
U 2 0 2 6
L 1 4 5 0

Item 28 A B* C D
U 0 7 2 1
L 4 2 3 1

Item 29 A B* C D
U 3 2 3 2
L 6 1 3 0

Item 30 A B* C D
U 0 10 0 0
L 3 6 1 0

Item 31 A B C* D
U 0 1 9 0
L 2 2 3 3

Item 32 A B C D*
U 0 1 0 9
L 0 2 2 6

Item 33 A* B C D
U 9 1 0 0
L 0 5 0 5

Item 34 A B C* D
U 0 1 6 3
L 0 2 3 5

Item 35 A B C* D
U 0 0 10 0
L 3 1 5 1

Item 36 A B C* D
U 0 0 9 1
L 0 3 5 2
Item 37 A* B C D
U 6 2 1 1
L 1 2 5 2

Item 38 A* B C D
U 4 1 2 3
L 3 0 3 4

Item 39 A* B C D
U 9 0 1 0
L 4 2 3 1

Item 40 A B C D*
U 0 1 2 7
L 4 2 3 1

Item 41 A B C D*
U 1 0 0 9
L 5 5 0 0

Item 42 A B C D*
U 0 0 0 10
L 0 1 3 6

Item 43 A B C D*
U 0 0 0 10
L 0 0 0 10

Item 44 A B* C D
U 0 10 0 0
L 2 1 3 4

Item 45 A B* C D
U 0 7 3 0
L 1 1 3 5

Item 46 A* B C D
U 5 1 1 3
L 2 1 4 3
 Item 47 A* B C D
U 9 0 1 0
L 6 2 0 2

Item 48 A* B C D
U 10 0 0 0
L 1 4 2 3

Item 49 A B C* D
U 5 0 5 0
L 1 5 1 3

Item 50 A B C* D
U 0 2 8 0
L 1 4 2 3

Recommendations (include items to be deleted, distractors to be modified/changed,

rephrasing of stems, sampling procedure, etc.)
First and foremost, the test developer recommends gathering a larger sample size, and a
more diversified one. It would be best if the test is to be taken by people, especially fans, of all
ages, and from various locations in the country, not just the NCR and Region III. Item No. 43 is
definitely the biggest factor in the lowering of the test reliability, so it must be entirely omitted,
References:

(n.d.). Game of Thrones. Retrieved from https://en.wikipedia.org/wiki/Game_of_Thrones

Haysom, S. (2017, July 8). 41 of the most memorable 'Game of Thrones' one-liners so far.

Retrieved from https://mashable.com/article/best-game-of-thrones-one-liners/

(n.d.). War of the words: All the best quotes from 'Game of Thrones'. Retrieved from

https://ew.com/tv/2019/03/27/game-of-thrones-best-quotes/