Carlo

 Magno,  PhD.  
De  La  Salle  University,  Manila  
 Development  of  Psychometrics  
  What  is  psychometrics?  
  Field  of  study  concerned  with  the  theory  and  
technique  of  educational  and  psychological  
measurement,  which  includes  the  measurement  
of  knowledge,  abilities,  attitudes,  and  personality  
traits.    
  Two  major  research  tasks:  
  (i)  the  construction  of  instruments  and  procedures  
for  measurement;  and    
  (ii)  the  development  and  refinement  of  theoretical  
approaches  to  measurement.  
Michell,  J.  (1997).  Quantitative  science  and  the  definition  of  measurement  in  
psychology.  British  Journal  of  Psychology,  88,  355-­‐383.    
Thurstone,  L.L.  (1929).  The  measurement  of  psychological  value.  In  T.V.  Smith  &  
W.K.  Wright  (Eds.),  Essays  in  Philosophy  by  Seventeen  Doctors  of  Philosophy  of  the  
University  of  Chicago.  Chicago:  Open  Court.    
 Development  of  Psychometrics  

  Quality  of  our  work  adheres  to  the  standards  

set  by  the  Joint  Committee  on  Standards  for  
Education  Evaluation:  
  Propriety  
  Utility  
  Feasibility  
  Accuracy  

Joint  Committee  on  Standards  for  Educational  Evaluation.  (2003;  1998;  1994).  
 Topical  Areas  in  Psychometrics  

  CTT:  Estimation  of  errors  and  true  score    

  Establishing    validity  and  reliability  
  Item  Response  Theory  (IRT)  
  One,  two,  three  parameter  models  
  Cognitive  diagnosis  (DINA  Model)  
  Polychotomous    Response  theory  
  Testlet  Response  theory  
  Multidimensional  IRT  
  Differential  Item  Functioning  (DIF)  
  Equating  Tests  
Regulated  “Psychometrics”  
  “Philippine  Psychology  Act  of  2009”  
  Functions  of  a  “psychometrician”:  
  (1)  administering  and  scoring  of  objective  
personality  test,  structured  personality  test,  
pen  and  paper  intelligence,  achievement  and  
interest  tests  (excluding  projectives)  
  (2)  Interpret  results    
  (3)  Conducting  preparatory  intake  interview  
Regulated  “Psychometrics”  

Who  is  qualified  to  be  a  psychometrician?  

  Bachelors  degree  in  psychology  
  Good  moral  character  
  Passed  a  test  on  the  following  areas:  
  Theories  of  personality  
  Abnormal  psychology  
  Industrial  psychology  
  Psychological  assessment  
Regulated  “Psychometrics”  

  Given  the  functions  of  a  psychometrician  

according  to  the  “Philippine  Psychology  Act”:  
  Forfeits  the  need  for  advance  training  because  the  
job  function  is  primarily  administering  and  scoring  
tests!  
  Construction  of  tests  and  refinement  of  
methodologies  are  neglected!  
  The  “functions  regulated”  do  not  capture  the  “real  
“functions  of  a  psychometrician.”  
  “Low  status”  given  to  psychometricians  because  
they  are  not  as  qualified  as  the  psychologists.  
 Development  of  Psychometrics  
in  Publications  
Our  work  is  evaluated   Our  work  is  
whether  we  are  
contributing  to  theory   Publication reviewed  by  a  
panel  of  experts  

Public
Presentation

Write reports
Levels  of  Publication  
ISI abstracted Journals

Abstracted journal

International Journal

Local journal

Conference proceeding

In house publication
Publications  that  accommodate  studies  n  
psychometrics  (in  the  Philippines)  

  Educational Measurement and Evaluation Review

(International)
  The Assessment Handbook (International)
  APSA Journal of SBA Research (local)
  Philippine Journal of Educational Measurement
(local)
  Learning Edge (local)
  Philippine Journal of Psychology (local)
  Philippine Journal of Counseling Psychology
(local)
  Guidance Journal (local)
  Asia-Pacific Education Researcher (International,
ISI)
Publication  Counts  of  Studies  on  
Psychometrics  
  Survey  on  Philippine  Publication  in  
Psychology  from  1986-­‐1996  (Bernardo,  2002)    
Area   N  
Social  psychology   63  (41.7%)  
Child  Psychology   19  (12.6%)  
Family  psychology   15  (9.9%)  
Health  psychology   13  (8.6%)  
Clinical  psychology   11  (7.3%)  
Counseling  psychology   8  (5.3%)  
Industrial  and  Organizational  psychology   8  (5.3%)  
General  psychology  (history  of  psychology)   5  (3.3%)  
Methodology   5  (3.3%)  
Educational  psychology   4  (2.6%)  
Cognitive  psychology   4  (2.6%)  
Psychological  Measurement   3  (2.0%)  
Cross-­‐cultural  psychology   1  (0.7%)  
Publication  Counts  of  
Studies  on  Psychometrics  
  Type  of  Research  
Type  of  Research   N  
Descriptive   78  (51.7%)  
Theoretical  analysis   19  (12.6%)  
Review  of  literature   18  (11.9%)  
experiment   16  (10.6%)  
Theory  development/model   12  (7.9%)  
building  
Program    development   10  (6.6%)  
Statistical  analysis   4  (2.6%)  
Test  development   3  (2.0%)  
Historical  analysis   2  (1.3%)  
2010  Study  of  Bernardo  
Studies  published  in  the  Philippine  Journal  of  Psychology  

Area of study 1994-19 1999-20 2004-20 Total

98 03 08

Social psychology and personality 3 13 22 38

Clinical and counseling psychology 6 16 13 35
Developmental psychology 4 6 7 17
Industrial and organizational psychology 1 1 13 15
Educational psychology 2 3 5 10
Psychometrics or psychological measurement 1 3 3 7
General (history, trends, current issues) 2 3 2 7
Cognitive psychology 1 1 0 2
Biological psychology 0 0 1 1
Sport psychology 0 0 1 1
Total 20 46 67 133
 2010  study  of  Bernardo  
Studies  published  in  the  Philippine  Journal  of  Psychology  

Research approach 1994-199 1999-200 2004-200 Total

8 3 8

Non-experimental quantitative (descriptive) 4 16 31 51

Qualitative 4 12 15 31

Literature review (historical analysis, trends) 8 9 4 21

Non-experimental quantitative (predictive) 0 2 8 10

Program development and evaluation 3 3 3 8

Psychometric analysis 1 3 3 7

Experiment 0 1 4 5

Total 20 46 67 133
Filipino  authors  in  International  refereed  
journals  

Area of study 1994-1 1999-2 2004-2 Total

998 003 008
Social psychology and personality 2 12 17 31
Industrial and organizational psychology 0 7 7 14
Cognitive psychology 3 4 3 10
Educational psychology 3 5 2 10
Clinical and counseling psychology 1 5 2 8
Developmental psychology 0 0 2 2
General (history) 0 1 1 2
Psychometrics or psychological 0 1 0 1
measurement
Sport psychology 0 0 1 1
Total 9 35 35 79
Filipino  authors  in  International  refereed  
journals  
Research  approaches  of  international  refereed  publications  

Institution 1994-19 1999-20 2004-20 Total

98 03 08

Experiment 5 13 7 25
Non-experimental quantitative 1 7 13 21
(predictive)
Non-experimental quantitative 0 4 6 10
(descriptive)
Qualitative 0 5 4 9
Program development and evaluation 1 2 4 7
Psychometric analysis 2 2 1 5
Literature review (historical analysis, 0 2 0 2
trends)
Total 9 35 35 79
Implications  

According  to  Bernardo  (2002)  

  Lack  of  research  resources  
  Research  as  a  marginal  activity  
  Random  and  isolated  efforts  at  research  
  Lack  of  critical  mass  and  peer  review  
Moves  of  IRT  in  the  Philippines  
  Introduction  of  the  IRT  approach  in  psychometrics    
courses  in  the  graduate  programs.  
  Dr.  Letty  Azusano  includes  a  topic  on  Rasch  model  in  
advance  psychometric  theory  course  
  Dr.  Davies  introducing  IRT  analysis  in  personality  testing  
  Dr.  Pedrajita  and  his  team  developed  papers  detecting  item  
Bias  
  Tests  developed  by  the  Asian  Psychological  Services  
Assessment  (APSA)  uses  the  Rasch  model  in  the  
selection  of  good  items.  
  Assessment  of  College  Potential  
  Assessment  of  Nursing  Potential  
  Assessment  of  Engineering  Potential  
  Assessment  of  Accounting  Potential  
Moves  of  IRT  in  the  Philippines  

  De  La  Salle-­‐Santiago  Zobel  (DLSZ)  as  

initiated  by  Ms.  Ma  Socorro  Diesta  
constructed  a  curriculum-­‐based  exam  (items  
were  calibrated  as  persona  and  ability  free).  
  DLSZ  pioneered  on  training  the  basic  
education  teachers  in  analyzing  their  
quarterly  test  using  the  Rasch  model  
Moves  of  IRT  in  the  Philippines  
  Publication  
  Special  issue  on  studies  comparing  CTT  and  IRT  by  4  
Filipino  authors  in  The  International  Journal  of  
Educational  and  Psychological  Assessment  (ISI,  2009):  
  Magno  
  Hernandez  
  Morales  
  Tiratira  
  Pedrajta  published  a  study  on  detecting  item  bias  
using  logistic  regression  in  a  2009  issue.  
  The  Asia-­‐Pacific  Education  Researcher  (ISI)  published  
one  article  where  Polychotomous  IRT  was  used  for  the  
Asian  Values  Scale    
Moves  of  IRT  in  the  Philippines  

  Schools  that  offer  graduate  training  on  

Measurement  and  Evaluation:  
  University  of  the  Philippines  
  De  La  Salle  University  
  Philippine  Normal  University  
  Mirriam  College  
Recommendations  

  Funding  and  scholarship  should  be  given  to  

graduate  students  who  intend  to  pursue  a  
graduate  training  on  Measurement,  
assessment,  and  evaluation.  
  Training  should  be  provided  specifically  in  the  
conduct  of  IRT  
  Encourage  graduate  students  and  scholars  to  
conduct  and  publish  studies  using  IRT.