-Roots can be found in early twentieth ASSESSMENT – follows a model (a) century in France 1905 evaluation (b) intervention (a) evaluation. - -Alfred Binet published a test designed to Provide a means for help place Paris school evaluating how the assesse processes or children benefits from some type of - WW1, military used the test to screen large intervention during the course of evaluation. numbers of recruits Tools of Psychological Assessment quickly for intellectual and emotional problems A. The Test (a measuring device or procedure) -WW2, military depend more on tests to 1. psychological test: a device or procedure screen recruits for service designed to measure *PSYCHOLOGICAL variables related to psychology (intelligence, ASSESSMENT personality, PSYCHOLOGICAL TESTING aptitude, interests, attitudes, or values) DEFINITION 2. format: refers to the form, plan, structure, -Gathering & integration of psychology-related arrangement, and data for the purpose of making a psychological layout of test items as well as to related evaluation with accompany of tools. considerations such as -Process of measuring psychology-related time limits. variables by means of devices/procedures a) also referred to as the form in which a test is designed to obtain a sample of behavior administered (pen and paper, computer, etc) *OBJECTIVE Computers can generate scenerios. -To answer a referral question,solve problem or b) term is also used to denote the form or arrive at a decision thru the use of tools of structure of evaluation other evaluative tools, and processes, such as -To obtain some gauge, usually numerical in the nature guidelines for creating a portfolio work sample *PROCESS 3. Ways That tests differ from one another: -Typically individualizedTesting may be a) administrative procedures individualized or group (1) some test administers have an active *ROLE OF knowledge EVALUATOR (a) some test administration -Key in the process of selecting tests as well as involves demonstration of in drawing conclusions tasks -Tester is not key into the process; may be (b) usually one-on-one substituted (c) trained observation of *SKILL OF assessee’s performance EVALUATIOR 2) some test administers don’t even have to Typically requires an educated selection, skill be present in evaluation (a) usually administered to larger -Requires technician-like skills groups *OUTCOME (b) test takers complete tasks -Entail logical problem-solvingapproach to independently answer the referral ques. b) Scoring and interpretation procedures -Typically yields a test score (1) score: a code or summary statement, *3 FORMS OF ASSESSMENT: usually (but not necessarily) numerical in 1. COLLABORATIVE PSYCHOLOGICAL nature, that reflects an evaluation of ASSESSMENT – assessor and performance on a test, task, interview, or assesse work as partners from initial contact some other sample of behavior through final feedback (2) scoring: process of assigning such 2. THERAPEUTIC PSYCHOLOGICAL evaluative codes/ statements to ASSESSMENT – self-discovery and performance on tests, tasks, interviews, new understandings are encouraged throughout or other behavior samples. the assessment (3) different types of score: (a) cut score: reference point, usually numerical, 1. sheds light on an individual's past and current derived by judgement and used to divide a set of adjustment as well as on events and circumstances data into two or more classifications. that may have contributed to any changes in (i) sometimes reached without any formal adjustment method: in order to “eyeball”, teachers 2. provides information about neuropsychological who decide what is passing and what is functioning prior to the occurrence of a trauma or failing. other event that results (4) who scores it in a deficit. (a) self-scored by testtaker 3. insight into current academic and behavioral (b) computer standing (c) trained examiner 4. useful in making judgments for future class c) psychometric soundness/ technical quality placements (1) psychometrics:the science of 5. Case history Study: a report or illustrative psychological measurement.(a) referring to to how account concerning consistently and how accurately a psychological person or an event that was compiled on the basis test measures what it purports to of case history data measure. a) might shed light on how one individual’s (2) utility: refers to the usefulness or personality practical value that a test or other tool of and particular set of environmental conditions assessment has for a particular purpose. combined to produce a successful world leader. B. The Interview: method of gathering b) groupthink: work on a social psychological information through direct phenomenon: contains rich case history material on communication involving reciprocal exchange collective decision making that did not always 1. interviewer in face-to-face is taking note of result a) verbal language in the best decisions. b) nonverbal language E. Behavioral Observation: monitoring the (1) body language movements actions of others or oneself by (2) facial expressions in response to interviewer visual or electronic means while recording (3) the extent of eye contact quantitative and/or qualitative (4) apparent willingness to cooperate information regarding those actions. c) how they are dressed 1. often used as a diagnostic aid in various settings: (1) neat vs sloppy vs inappropriate inpatient 2. interviewer over the phone taking note of facilities, behavioral research laboratories, a) changes in the interviewee’s voice pitch classrooms. b) long pauses 2. naturalistic observation: behavioral observation c) signs of emotion in response that takes 3. ways that interviews differ: place in a naturally occurring setting (as opposed to a) length, purpose, and nature. a research b) in order to help make diagnostic, treatment, laboratory) for the purpose of evaluation and selection, etc information- 4. panel interview gathering. a) an interview conducted with one interviewee 3. in practice tends to be used most frequently by with researchers in more than one interviewer settings such as classrooms, clinics, prisons, etc. C. The Portfolio F. Role- Play Tests 1. files of work products: paper, canvas, film, video, 1. role play: acting an improvised or partially audio, etc improvised part in a 2. samples of ones abilities and accomplishments simulated situation. D. Case History Data: records, transcripts, and 2. role-play test: tool of assessment wherein other accounts in written, assessees are pictorial or other form that preserve archival directed to act as if they were in a particular information, official and situation. Assessees informal accounts, and other data and items are then evaluated with regard to their expressed relevant to assessee thoughts, behaviors, abilities, etc G. Computers as tools pencil tests 1. local processing: on site computerized scoring, (3) costs associated with internet testing tend to be interpretation, or other conversion of raw test data; lower than costs associated with contrast w/ CP and teleprocessing paper-and-pencil tests 2. central processing: computerized scoring, (4) the internet facilitates the testing of otherwise interpretation, or other conversion of raw data that isolated populations, as well as people with is physically transported from the same or other test disabilities for whom getting to a test center might sites; contrast w/ LP and teleprocessing. prove as a hardship. 3. teleprocessing: computerized scoring, (5) greener: conserves paper, shipping materials etc. interpretation, or other conversion of raw test data d) Cons: sent over telephone lines by modem from a test site (1) test client integrity to a central location for computer processing. (a) refers to the verification of the identity of the contrast with CP and LP test taker when a test is administered online 4. simple score report: a type of scoring report that (b) also refers to the sometimes varying interests of provides only a listing of scores the test taker vs that of the test administrator. The 5. extended scoring report: a type of scoring report test taker might have access to notes, aids, internet that provides a listing of scores AND statistical resources etc. data. (c) internet testing is only testing, not assessment ff. interpretive report: a formal or official 8. CAT: computerized adaptive testing: an computer-generated interactive, computer- administered test taking account of test performance presented in both process wherein items presented to the test taker are numeric and based in part on the test taker's performance on narrative form and including an explanation of the previous items findings; a) EX: on a computerized test of academic abilities, a) the three varieties of interpretive report are the computer might be programmed to switch from (1) descriptive testing math skills to English skills after three (2) screening consecutive failures on math items. (3) consultative H. Other tools b) some contain relatively little interpretation and 1. DVD- how would you respond to the events that simply call attention to certain high, low, or unusual take place in the video scores that needed to be focused on. a) sexual harassment in the workplace c) consultative report: A type of interpretive report b) respond to various types of emergencies designed to provide expert and detailed analysis of c) diagnosis/treatment plan for clients on videotape test data that mimics the work of an expert 2. thermometers, biofeedback, etc consultant. TEST DEVELOPER d) integrative report: a form of interpretive report of They are the one who create tests. psychological assessment, usually computer- They conceive, prepare, and develop tests. They generated, in which data from behavioral, medical, also find a way to administrative, and/or other sources are integrated disseminate their tests, by publishing them either 7. CAPA: computer assisted psychological commercially or assessment. (assistance to the test user not the test through professional publications such as books or taker) periodicals. a) enables test developers to create TEST USER psychometrically They select or decide to take a specific test off sound tests using complex mathematical procedures the shelf and use it for and calculations. some purpose. They may also participate in other b) enables test users the construction of tailor-made roles, e.g., as test with built-in scoring and interpretive examiners or scorers. capabilities. TEST TAKER c) Pros: Anyone who is the subject of an assessment (1) test administrators have greater access to Test taker may vary on a continuum with respect potential test users because of the global to numerous reach of the internet. variables including: (2) scoring and interpretation of test data o The amount of anxiety they experience & the tend to be quicker than for paper-and- degree to which the test anxiety might affect the results COUNSELING SETTING o The extent to which they understand & agree with o schools,prisons, and governmental or privately the owned institutions rationale of the assessment o ultimate objective: the improvement of the o Their capacity & willingness to cooperate assessee in terms of adjustment, productivity, or o Amount of physical pain/emotional distress they some related variable. are GERIATRIC SETTING experiencing o quality of life: in psychological assesment, an o Amount of physical discomfort evaluation of variables such as perceived o Extent to which they are alert & wide awake stress,lonliness, sources of satisfaction, personal o Extent to which they are predisposed to agreeing values, quality of living conditions, and quality of or friendships and other social support. disagreeing when presented with stimulus BUSINESS AND MILITARY SETTINGS o The extent to which they have received prior GOVERNMENTAL AND coaching ORGANIZATIONAL CREDENTIALING o May attribute to portraying themselves in a good How are Assessments Conducted? light protocol: the form or sheet or booklet on which a Psychological autopsy – reconstruction of a tes ttaker’s responses are entered. deceased individual’s o term might also be used to refer to a description psychological profile on the basis of archival of a set of test- or assessment- related procedures, records, artifacts, & as in the sentence, “the examiner dutifully followed interviews previously conducted with the deceased the complete protocol for the stress interview” assesee rapport: working relationship between the TYPES OF SETTINGS examiner and the examinee EDUCATIONAL SETTING ASSESSEMENT OF PEOPLE WITH o achievement test: evaluation of accomplishments DISABILITITES or the Define who requires alternate assessement, how degree of learning that has taken place, usually with such assessment are to be conducted and how regard to an academic area. meaningful inferences are to be drawn from the o diagnosis: a description or conclusion reached on data derived from such assessment the basis Accommodation – adaptation of a test, procedure of evidence and opinion though a process of or situation or the distinguishing substitution of one test for another to make the the nature of something and ruling out alternative assessment more suitable for an assesee with conclusions. exceptional needs. o diagnostic test: a tool used to make a diagnosis, Translate it into Braillee and administere in that usually to form. identify areas of deficit to be targeted for Alternate assessment – evaluative or diagnostic intervention procedure or process o informal evaluation: A typically non systematic, that varies from the usual, customary, or relatively standardized way a brief, and “off the record” assessment leading to the measurement is derived either by virtue of some formation of an opinion or attitude, conducted by special accommodation made to the assesee by any person in any way for any reason, in an means of alternative methods unofficial context and not subject to the same ethics Consider these four variables on which of many or standards as evaluation by a professiomal different types of CLINICAL SETTING accommodation should be employed: o these tools are used to help screen for or diagnose o The capabilities of the assesse behavior problems o The purpose of the assessment o group testing is used primarily for screening: o The meaning attached to test scores identifying o The capabilities of the assessor those individuals who require further diagnostic REFERENCE SOURCES evaluation. TEST CATALOUGES – contains brief description of the test TEST MANUALS – detailed information REFERENCE VOLUMES – one stop CHARLES DARWIN AND INDIVIDUAL shopping, provides detailed information for each DIFFERENCES test listed, including test publisher, author, purpose, Tests designed to measure these individual intended test population and test administration differences in ability and personality among people time “Origin of Species” chance variation in species JOURNAL ARTICLES – contain reviews of would be selected or rejected by nature according to the test adaptivity and survival value.“survival of the ONLINE DATABASES – most widely used fittest” bibliographic databases FRANCIS GALTON TYPES OF TESTS Explore and quantify individual differences INDIVIDUAL TEST – those given to only one between people. person at a time Classify people “according to their natural gifts” GROUP TEST – administered to more than one Displayed the first anthropometric laboratory person at a time by single examiner KARL PEARSON ABILITY TESTS: Developed the product moment correlation o ACHIEVEMENT TESTS – refers to previous technique. learning (ex. Spelling) His work can be traced directly from Galton o APTITUDE/PROGNOSTIC – refers to the WILHEM MAX WUNDT potential for learning or acquiring a specific skill First experimental psychology laboratory in o INTELLIGENCE TESTS – refers to a person’s University of Leipzig general potential to solve problems Focuses more on relating to how people were PERSONALITY TESTS: refers to overt and similar, not different covert dispositions from each other. o OBJECTIVE/STRUCTURED TESTS – JAMES MCKEEN CATELL usually self-report, require the subject to choose Individual differences in reaction time between two or more alternative responses Coined the term mental test o PROJECTIVE/UNSTRUCTURED TESTS – CHARLES SPEARMAN refers to all possible uses, applications and Originating the concept of test reliability as well underlying concepts of psychological and as building the mathematical framework for the educational test statistical technique of factor analysis CHAPTER 2: HISTORICAL, CULTURAL VICTOR HENRI AND LEGAL/ETHICAL CONSIDERATIONS Frenchman who collaborated with Binet on A HISTORICAL PERSPECTIVE19TH papers suggesting how mental tests could be used to CENTURY measure higher mental processes Tests and testing programs first came into being EMIL KRAEPELIN in China Early experimenter of word association Testing was instituted as a means of selecting technique as a formal test who, of many applicants would obtain government LIGHTNER WITMER jobs (Civil service) “Little known founder of clinical psychology” The job applicants are tested on proficiency in Founded the first psychological clinic in the U.S. endeavors such as PSYCHE CATELL music, archery, knowledge and skill etc. Daughter of James Cattell GRECO-ROMAN WRITINGS (Middle Ages) Cattel Infant Intelligence Scale (CIIS) & World of evilness Measurement of Intelligence in Deficiency in some bodily fluid as a factor Infants and Young Children believed to influence personality RAYMOND CATTELL Hippocrates and Galen Believed in lexical approach to defining RENAISSANCE personality which examines Christian von Wolff – anticipated psychology human languages for descriptors of personality as a science and dimensions psychological measurement as a specialty within 20thCENTURY that science - Birth of the first formal tests of intelligence - Testing shifted to be of more understandable relevance/meaning A. THE MEASUREMENT OF Goddard tested immigrants and found most to INTELLIGENCE be feebleminded o Binet created first intelligence to test to identify -invalid; overestimated mental deficiency, even in mentally retarded school children in Paris native English-speakers (individual) Lead to nature-nurture debate about what o Binet-Simon Test has been revised over again intelligence tests actually measure o Group intelligence tests emerged with need to Needed to “isolate” the cultural variable screen intellect of WWI recruits Culture-specific tests: tests designed for use with o David Wechsler – designed a test to measure ppl from one culture, but not from another- adult intelligence test for him Intelligence is a minorities still scored abnormally low global capacity of the individual to act ex.) loaf of bread vs. tortillas purposefully, to think rationally and to deal today tests undergo many steps to ensure its effectively with his environment. suitable for said nation Wechsler-Bellevue Intelligence Scale -take testtakers reactions into account Wechsler Adult Intelligence Test – was revised Some Issues Regarding Culture and Assessment several times and extended the age range of Verbal Communication testakers from young children through senior o Examiner and examinee must speak the same adulthood. language B. THE MEASUREMENT OF PERSONALITY o Especially tricky with infrequently used o Field of psychology was being too test oriented vocabulary or o Clinical psychology was synonymous to mental unusual idioms employed testing o Translator may lose nuances of translation or give o ROBERT WOODWORTH – develop a measure unintentional hints toward more desirable answer of adjustment and emotional stability that could be o Also requires understanding of culture administered quickly and efficiently to groups of Nonverbal Communication and Behavior recruits o Different between cultures To disguise the true purpose of the test, o Ex.) meaning of not making eye contact questionnaire was labeled as Personal Data o Body movement could even have physical cause Sheet o Psychoanalysis: Freud’s theory of personality and He called it Woodworth Psychoneurotic psychological treatment which stated that symbolic Inventory – first widely used self-report test of significance is assigned to many nonverbal acts. personality o Timing tests in cultures not obsessed with speed o Self-report test: o Lack of speaking could be reverence for elders Advantages: Standards of Evaluation Respondents best qualified o Acceptable roles for women differ throughout Disadvantages: culture Poor insight into self o “judgments as to who might be the best One might honestly believe something about self employee, that isn’t true manager, or leader may differ as a function of Unwillingness to report seemingly negative culture, as qualities might judgments regarding intelligence, wisdom, o Projective test: individual is assumed to project courage, onto some and other psychological variables” ambiguous stimulus (inkblot, photo, etc.) his or her o must ask ‘how appropriate are the norms or other own standards that will be used to make this evaluation’ unique needs, fears, hopes, and motivations Tests and Group Membership Ex.) Rorschack inkblot ex.) must be 5’4” to be police officer- excludes o C. THE ACADEMIC AND APPLIED cultures with short TRADITIONS stature Culture and Assessment ex.) Jewish lifestyle not well suited for corporate Culture: ‘the socially transmitted behavior patterns, America beliefs, and products of work f a particular affirmative action: voluntary and mandatory population, community, or group of people’ efforts to combat Evolving Interest in Culture-Related Issues discrimination and promote equal opportunity in o right to know why they are being evaluated, how education and employment for all Psychology, test datam will be used and what information will tests, and public policy be released to whom Legal and Ethical Condiseration o may be obtained by parent or legal representative Code of professional ethics: defines the standard o must be in written form: of care expected of members of a given profession. general purpose of the testing The Concerns of the Public the specific reason it is being undertaken Beginning in world war I, fear that tests were general type of instruments to be administered only testing the ability to take tests o revealing this information before the test can Legislation contaminate the results o Minimum competency testing programs: formal o deception only used if absolutely necessary testing programs designed to be used in decisions o don’t use deception if it will cause emotional regarding various aspects of students’ educations distress/ o Truth-in-testing legislation: state laws to provide o fully debrief participants testtakers with a means of learning the criteria by The right to be informed of test findings which they are being judged o Formerly test administrators told to give Litigation participants only positive information o Daubert ruling made federal judges the o No realistic information is required gatekeepers to determining what expert testimony is o Tell test takers as little as possible about the admitted nature of their performance on a particular test. So o This overrode the Frye policy which only that the examinee would leave the test session admitted scientific testimony that had won general feeling pleased and statisfied. acceptance in the scientific community. o Test takers have the right also to know what The Concerns of the Profession recommendations are being made as a consequence Test-user qualifications of the test data o Who should be allowed to use psych tests The right to privacy and confidentiality o Level A: tests or aids that can adequately be o Private right: “recognizes the freedom of the administered, individual to pick and choose for himself the time, scored, and interpreted with the aid of the manual circumstances, and particularly the extent to which and a general orientation to the kind of institution or he wishes to share or withhold from others his organization in which one is working attitudes, beliefs, behaviors, and opinions” o Level B: tests or aids that require some technical o Privileged information: information protected knowledge of test construction and use and of by law from being disclosed in legal proceeding. supporting Protects clients psychological and educational fields from disclosure in judicial proceedings. Privilege o Level C: tests and aids requiring substantial belongs to understanding of testing and supporting psych the client not the psychologist. fields with experience o Confidentiality: concerns matters of Testing people with disabilities communication outside the courtroom o Difficulty in transforming the test into a form that Safekeeping of test data: It is not a good policy can be taken by testtaker to maintain all records in perpetuity o Transferring responses to be scorable The right to the least stigmatizing label o Meaningfully interpreting the test data o The standards advise that the least stigmatizing Computerized test administration, scoring, and labels should always be assigned when reporting interpretation test results. o simple, convenient o easily copied, duplicated o insufficient research to compare it to pencil-and- paper versions o value of computer interpretation is questionable o unprofessional, unregulated “psychological testing” online The Rights of Testtakers the right of informed consent