Professional Documents
Culture Documents
ENGLISH LANGUAGE
PREPARATORY PROGRAM
CRITERIA BOOKLET
Page 1 of 14
The following outlines the criteria used in the Preparatory Programme.
APPENDIX 2 4
ELEMENTARY CAT&ECA ANALYTIC WRITING
CRITERIA
APPENDIX 3 5
PRE-INTERMEDIATE CAT&ECA ANALYTIC
WRITING CRITERIA
APPENDIX 4 6
PRE-INTERMEDIATE LP SPEAKING CRITERIA
APPENDIX 10 13
PAE WRITING TASK 2 CRITERIA
APPENDIX 11 14
PAE SPEAKING CRITERIA
The Bilkent University English Language Preparatory Program reserves the right to make changes to the exam and the criteria.
Elementary: An analytic Writing Criteria is used for ELM CATs, ECA and LP Writing Tasks. A holistic Speaking Criteria is
used for Oral Tasks.
Pre- Intermediate: An analytic Writing Criteria is used for PIN CATs, ECA and LP Writing Tasks. A holistic Speaking Criteria
is used for Oral Tasks.
INT/UPP/PFC: An Analytic Criteria is used for INT/UPP/PFC LP Writing Tasks and CATs. As for LP Speaking Tasks a holistic
criteria is used but depending on the task type, instructors need to choose either Oral Interaction or Oral Production.
PAE: An analytic criteria is used for PAE Writing Part 1. A holistic Criteria is used for PAE Writing Part 2 and Speaking Exams.
Page 2 of 14
APPENDIX 1: ELEMENTARY LP SPEAKING CRITERIA
0 1 2 3
Use of target Almost no control of Limited control of Adequate control of Good control of
grammar grammar grammar, frequent grammar; few errors grammar; very few
errors related to level related to level errors related to level
objectives objectives objectives
Use of target Almost no control of Limited control of Adequate control of Good control of
vocabulary vocabulary vocabulary; frequent vocabulary; few errors vocabulary; very few
errors related to level related to level errors related to level
objectives objectives objectives
Page 3 of 14
APPENDIX 2: ELEMENTARY CAT & ECA ANALYTIC WRITING CRITERIA (Total: 15 points)
GRAMMAR
Student’s written work shows
4 good control of grammar and a good range of structures; very few errors related to level objectives
3 adequate control of grammar and an adequate range of structures; few errors related to level objectives
2 limited control of grammar and limited range of structures evident; frequent errors related to level objectives
1 very limited control of grammar and very limited range of structures; errors related to level objectives throughout
VOCABULARY
Student’s written work shows
4 good control of vocabulary and a good range of lexical items; very few errors related to level objectives
3 adequate control of vocabulary and an adequate range of lexical items; few errors related to level objectives
2 limited control of vocabulary and limited range of lexical items evident; frequent errors related to level objectives
1 very limited control of vocabulary and very limited range of lexical items; errors related to level objectives throughout
CONTENT
Student’s written work shows
3 good response to the task; information relevant to the topic and completely related to the task
2 adequate response to the task; information mostly relevant to the topic and mostly related to the task
1 very limited response to the task; information mostly irrelevant to the topic and mostly unrelated to the task
0 an almost irrelevant response to the task; almost no attempt at answering the question
ORGANIZATION
Student’s written work shows
2 good organization; good use of linkers and referencing related to level objectives
1 adequate organization; adequate use of linkers and referencing related to level objectives
0 almost no organization; almost no use of linkers and referencing; inadequate sample for scoring
MECHANICS
Student’s written work shows
2 good use of spelling and punctuation; few errors related to level objectives
1 adequate use of spelling and punctuation; some errors related to level objectives
Students are assessed according to their own level objectives; do not penalize for language errors that are beyond level objectives.
If the task is not attempted, the student will receive a total grade of ‘0’.
If the student writes a response to the task which is totally (100%) irrelevant, the student will receive a total grade of ‘1’.
If the student writes what appears to be a memorized response, please consult the standardization leader. In such a case, the student
will receive a total grade of ‘4’ (Grammar:1 / Vocabulary: 1 / Content: 0 / Organization: 1 / Mechanics: 1).
Students are assessed according to the PIN level objectives; do not penalize for language errors that are beyond level objectives.
If the task is not attempted, the student will receive a total grade of ‘0’.
If the student writes a response to the task which is totally (100%) irrelevant, the student will receive a total grade of ‘1’.
If the student writes what appears to be a memorised response, consult the standardisation leader. The student will receive a total
grade of ‘5’ (Content: 0 / Organisation: 1 / AG: 1 / RG: 1 / AV: 1 / RV: 1).
SEPTEMBER 2022
Page 5 of 14
APPENDIX 4: PRE-INTERMEDIATE LP SPEAKING CRITERIA
Ground Rules:
All qualifiers in the criteria are subject to task and level expectations (i.e. “wide range of structural accuracy” refers to a wide range
of structural accuracy for the PIN level and not beyond it).
In case a student’s performance falls far short of one or more indicators for a band, the grade goes one band down.
Task completion:Handles the task mostly effectively; maintains flow of language with appropriate hesitations
Grammar: Speaks with a good range of structural accuracy to participate in the task; errors quite rare
Vocabulary:Speaks with a good range of level vocabulary to participate in the task; errors quite rare
Pronunciation: Appropriate pronunciation with minimal strain on listener
Discourse:Almost always extended, relevant and coherent utterances
Task completion:Not able to handle the task without repetition by the interlocutor
Grammar:Grammar is mostly inaccurate and inadequate to participate in the task
Vocabulary:Limited range of level vocabulary, mostly inadequate to participate in the task
Pronunciation: Pronunciation is unintelligible at times; errors interfere with understanding
Discourse:Utterances lack adequate length, relevance and coherence
Page 6 of 14
APPENDIX 5: INTERMEDIATE, UPPER-INTERMEDIATE & PRE-FACULTY CAT ANALYTIC WRITING
CRITERIA
(Total: 20 points)
All qualifiers in the criteria below should be considered with respect to the relevant level and the writing task given.
GRAMMAR
5 high degree of grammatical control shown over a wide range of appropriate structures; some complex
structures are evident although there may be errors in their use that do not hinder understanding
4 mostly accurate use of a good range of appropriate structures with some minor errors
3 sufficiently accurate use of an adequate range of structures with some language errors but meaning is not
obscured
2 inadequate range of structures with some basic language errors which at times may obscure meaning and/or use
of language below level expectations
1 poor range of structures with basic and frequent language errors which often obscure meaning
NB There are two dimensions in this category - grammatical accuracy (or control) and range - a paper should
be given the grade which fits both dimensions. If one of the dimensions is lacking compared to the other, the
paper should be given the grade that fits the lower of the two (i.e. a paper with sufficient accuracy but
inadequate range would get a 2 for grammar).
VOCABULARY
5 wide range of vocabulary used appropriately with almost no instances of misuse (i.e. word choice / word
formation) and very few spelling mistakes
4 good range of vocabulary used mostly appropriately with occasional instances of misuse and few spelling
mistakes
3 sufficient range of vocabulary used fairly appropriately although some errors are apparent and some problems
in spelling
2 inadequate range of vocabulary and/or frequent inappropriate use which at times may obscure meaning,
frequent problems in spelling
1 poor range of vocabulary with serious problems in accuracy and/or usage, major problems with spelling
NB There are two dimensions in this category - lexical range and appropriateness (or usage) - a paper should
be given the grade which fits both dimensions. If one of the dimensions is lacking compared to the other, the
paper should be given the grade that fits the lower of the two (i.e. a paper with sufficient lexical range but used
mostly inappropriately would get a 2 for vocabulary).
Page 7 of 14
APPENDIX 5: INTERMEDIATE, UPPER-INTERMEDIATE & PRE-FACULTY CAT ANALYTIC WRITING
CRITERIA
(Total: 20 points)
CONTENT
5 very good response to the prompt; a fully developed passage (with respect to exemplification and details) with very
good justification (with respect to the quality of ideas)
3 adequate response to the prompt; an adequately developed passage with satisfactory justification
2 attempts to respond to the prompt but inadequately; some development of ideas but with inadequate justification and/or
frequent repetition- content is not always clear and/or partly irrelevant
1 response is considerably irrelevant; poor development of ideas with little attempt at justification and/or almost
completely repetitious and/or incomplete
0 response is completely irrelevant to the task; almost no attempt at answering the prompt
NB There are two dimensions in this category - relevance of the ideas and development / justification(s) of the ideas.
A paper should be given the grade which fits both dimensions. If one of the dimensions is lacking compared to the
other, the paper should be given the grade that fits the lower of the two (i.e. a paper that presents adequate ideas but
justifies them inadequately would get a 2 for content).
ORGANIZATION
5 very fluent passage; the text flows in a meaningful and a logical way, all aspects of cohesion managed well (i.e. linkers,
referencing, punctuation)
4 mostly fluent passage; information provided mostly flows in a meaningful and logical way, a range of cohesive devices
used appropriately, although there may be some under/over-use
3 adequately fluent passage; information is ordered meaningfully and logically, cohesive devices used although cohesion
within and/or between parts of the text/sentences may be faulty at times
2 lacks fluency despite some evidence of organization; “jumpiness” in places; inappropriate, inadequate or overuse of
cohesive devices leads to problems with transitions between ideas
1 almost complete lack of fluency; a limited range of cohesive devices and/or cohesive devices may be inaccurate,
repetitive, or may not provide a logical relationship or show a clear transition between ideas
NB There are two dimensions in this category - the flow (fluency) and cohesion of the information presented.
A paper should be given the grade which fits both dimensions. If one of the dimensions is lacking compared to the
other, the paper should be given the grade that fits the lower of the two (i.e. a paper that gives information in a
meaningful and logical order but makes inadequate use of cohesive devices would get a 2 for organization).
If the task is not attempted, the student will receive a total grade of ‘0’.
If the student writes a response to the task which is totally (100%) irrelevant, the student will receive a
total grade of ‘1’.
If the student writes what appears to be a memorized response, please consult the standardization leader.
In such a case, the student will receive a maximum grade of ‘3’ (Grammar: 1 / Vocabulary: 1 / Content: 0 / Organization: 1).
Inadequate - communicates in a limited way and has difficulty initiating and responding adequately throughout most of
the task
4 - makes contributions which are sometimes incoherent and generally unextended and/or irrelevant
- uses a limited range of vocabulary, phrases and structures, and errors sometimes interfere with
understanding
- speaks with some sense of fluency but with long hesitations; pronunciation, rhythm and intonation may
sometimes interfere with understanding
3 Features of 4 and 2 in equal measure
Interaction breaks down because the student…
Poor
- communicates with considerable difficulty and cannot initiate or respond adequately throughout most of the
task
2
- makes frequently incoherent, very short, and irrelevant contributions
- uses a very limited range of vocabulary, phrases and structures and errors frequently interfere with
understanding
- speaks with low fluency; pronunciation, rhythm and intonation frequently interfere with understanding
1 Task incomplete; very little communication
Very Poor - No communication; task incomplete
Very Good - delivers information very effectively in a organized way; all ideas are relevant and well-expanded
- uses a wide range of appropriate vocabulary, phrases and structures with few errors
10 - speaks very fluently; uses pronunciation, rhythm and intonation effectively to enhance communication and
help the audience distinguish important points
- makes effective use of body language, eye contact, visual aids and notes
No strain on the listener
9 Features of 10 and 8 in equal measure
To communicate the message, the student…
Good
- delivers information effectively in an organized way; most ideas are relevant and well-expanded
8 - uses a range of appropriate vocabulary, phrases and structures with few errors
- speaks fluently; uses pronunciation, rhythm and intonation to convey the message clearly
- makes mostly effective use of body language, eye contact, visual aids and notes
Almost no strain on the listener
7 Features of 8 and 6 in equal measure
To communicate the message, the student…
Adequate - delivers information with adequate organization; most ideas are relevant and sufficiently expanded
- uses some range of vocabulary, phrases and structures appropriately with some noticeable but unimportant
6 errors
- speaks fluently with minor hesitations; pronunciation, rhythm and intonation do not interfere with
understanding
- makes adequate use of body language, eye contact, visual aids and notes
Little strain on the listener
5 BORDERLINE FAIL: Some features of 6 but closer to 4
Communication breaks down because the student…
Inadequate - gives limited information; ideas are noticeably disorganized, irrelevant or unexpanded
- uses a limited range of vocabulary, phrases and structures, and errors sometimes interfere with
4 understanding
- speaks with some sense of fluency but with long hesitations; pronunciation, rhythm and intonation may
sometimes interfere with understanding
- makes inadequate use of body language, eye contact and visual aids, and often reads from notes
Some strain on the listener
3 Features of 4 and 2 in equal measure
Communication breaks down because the student…
Poor
- gives very limited information; ideas are frequently disorganized, irrelevant and unexpanded
- uses a very limited range of vocabulary, phrases and structures and errors frequently interfere with
2
understanding
- speaks with low fluency; pronunciation, rhythm and intonation frequently interfere with understanding
- makes no use of body language, eye contact or visual aids, and reads from notes
- considerable effort required by the listener
1 Produces few sentences but task incomplete
Very Poor - No communication; task incomplete
0
Page 10 of 14
APPENDIX 8: INTERMEDIATE AND UPPER-INTERMEDIATE ECA HOLISTIC WRITING CRITERIA (TOTAL:10
POINTS)
The qualifiers in the criteria below should be considered with respect to the relevant level and the writing task.
10 • very good response to the prompt; a fully developed passage (with respect to the quality of ideas and details)
with very good justification (with respect to exemplification)
• ideas are well organized; effective use of a wide range of cohesive devices
• uses a wide range of grammar structures and vocabulary accurately and appropriately throughout
• language errors are rare
9 Elements of both 8 and 10 OR slightly better than ‘8’
6 • adequate response to the prompt with very little irrelevance or repetition; an adequately developed passage
with satisfactory justification
• almost always organizes ideas logically with mostly appropriate use of cohesive devices
• an adequate range of grammar structures and vocabulary
• some basic language errors which do not obscure meaning
5 • responds to the prompt, but inadequately; some development of ideas, but with limited justification and/or
some repetition; content is not always clear, some irrelevance
• ideas are generally organized with some jumpiness or inappropriate use of cohesive devices
• limited range of grammar structures and vocabulary / a range but overuse of memorized chunks
• some basic language errors which may hinder meaning at times
4 • attempts to respond to the prompt, but prompt may have been misunderstood; little development of ideas
with
inadequate justification and/or frequent repetition; content is frequently unclear, partly irrelevant; below 50%
of
minimum word limit
• noticeable problems in the organization of ideas; uses some basic cohesive devices with some inaccuracy,
repetition or overuse
• very limited range of grammar structures and vocabulary used repetitively
• errors and inappropriacy with grammar structures and vocabulary throughout, which may cause strain for
the reader
3 Elements of both 2 and 4 OR slightly better than ‘2’
2 • response is considerably irrelevant; poor development of ideas with little attempt at justification and/or
almost
completely repetitious; almost totally irrelevant and/or incomplete
• has very little control of organizational features
• uses a very limited range of vocabulary and cannot use grammar structures except for memorized chunks
• language errors may severely obscure meaning
1 • very little assessable text; below 25% of minimum word limit
• has almost no control of organizational features
• almost no range of language
• language errors obscure meaning at all times
• the response is totally (100%) irrelevant
0 • the task is not attempted
For papers that are partially irrelevant please follow the criteria or consult the standardization leader
for a decision.
The Preparatory Program reserves the right to make changes to the exam and the criteria.
LAST UPDATED SEPTEMBER 2019
APPENDIX 9: PAE WRITING TASK 1 CRITERIA
Page 11 of 14
Identifies the specific focus of the input text and states stance clearly 2
The test taker produces language with few grammatical errors and a range of grammatical
2
structures
Grammar Comprehensible despite grammatical The reader may have to infer meaning at times
errors BUT limited grammatical due to grammatical errors BUT a range of 1
structures grammatical structures
Limited range of grammatical structures AND the reader may have to infer meaning at
0
times due to grammatical errors
The test taker produces language with accurate and appropriate use of a range of
2
vocabulary
Limited range of vocabulary AND the reader may have to infer intended meaning at times
0
due to vocabulary errors
* If the outcome is completely irrelevant, the paper receives the score of “1”.
* If there is insufficient text to make an assessment, the paper receives the score of “1”.
JUNE 2021
Page 12 of 14
10 An excellent response to the prompt = evidence of ALL elements of band 9
Very good coverage of topic: well-developed, coherent, clear passage with good
justifications
Very good use of organizational devices
9
Accurate use of a wide range of appropriate structures
Occasional unimportant language errors
A wide range of appropriate vocabulary
Good coverage of topic: fairly well-developed, coherent, clear passage with good
justifications
Good use of organizational devices
8
Fairly accurate use of a good range of appropriate structures with some minor language
errors
Good range of vocabulary used mostly appropriately
Attempts to answer the prompt but the text poses serious problems for the reader due to
3 frequent language errors
Very limited vocabulary
2 Falls far short of the word limit but has some relevance to the topic
Too little text to grade. Produces 2 or 3 sentences
1
The response is totally (100%) irrelevant
0 The task is not attempted
For papers that are partially irrelevant please follow the criteria or consult the standardization leader for a
decision.
The Preparatory Program reserves the right to make changes to the exam and the criteria.
Page 13 of 14
Speaks very fluently and coherently with no hesitation, restriction or pronunciation issues
20 A strong sense of spontaneity
Communication is maintained Contributions are developed extensively through relevant examples and details
without any problems Consistently uses a very wide range of grammar and vocabulary naturally, accurately and appropriately
2
No evidence of ability to Almost no assessable language
perform task
1 No assessable language
0 Does not attend
Page 14 of 14