(2) 6 sy 0) wo United States Patent Dewar ELECTRONIC PRE ATION SYSTEM FOR ASSESSING A SUITABILITY OF JOB. APPLICANTS FOR AN EMPLOYER, Inventor: Katrina L Dewar, Plymouth, MN (US) Assignee: Previsor, Inc, Roswell, GA (US) Notice: Subject to any disclaimer, the term ofthis, pateat is extended or adjusted under 38 USC. 154(b) by 1065 days Appl, No. 09/878.245 Filed: Jum. 12, 2001 Prior Publication Data US 20020055866.A1 May 9, 2002 Related U.S. Application Data Provisional application No. 60/211,044, filed on Jun 12, 2000, Int Cl. G66 700 2006.01) Us.cI 106721; 706/48; 70646; ‘siti icld of Clasitication Search 706014, “06/21, 45, 46; 707/102; 705/11 ‘See application file for complete search history References Cited USS, PATENT DOCUMENTS 51099127 A 101991. Lowiestal SHI73S3 A $1902 Seipanvich etal Shoesor A 11/1902 Claket a $7036 A 12/1902 Groene et Su9TOO A 31993 Sobotka ea 5325802 A 71994 Lewis, 'US007606778B2 (10) Patent No. 4s) Date of Patent: US 7,606,778 B2 Oct. 20, 2009 5326270 A * 71994 Ostby tal an4302 Suossse A 41905 Ulug Sa1664 A $1905 Puishetal 561.699 101995 Arb S4o7-08 A 1/1995 Ulug $490,097 A 21906 Swenson SSSL8S) A 911906 Bonnteter et al SS65315 A 101996 Kershaw 5592378 A U1997 Salmon Coninved) FOREIGN PATENT DOCUMENTS Wo WosmITEI2 a2 4199 OTHER PUBLICATIONS (Changs, ~“The Development of « Computer-Based Desision Sup por Stem for Use in Evaluating Candidates for the Posi of Propamar-Analyst™, ACM SIGCRR, Ap. 1991" (Continved) Primary Examiner David R Vinwent Assistant Examiner—Lat Wong, (4) Attorney Agent, or Firm Christensen, BA, Patterson, Theate, Skaar & on ABSTRACT A system and method fr testing andorevaluating employees ‘or potential employees is disclosed, A computer arranges 9 plurality of applicants in stack ranked table. The table may Fank or reank applicants against each othe, from best 0 worst.afler successive screening, selecting, and/rinterview- ing stages for @ particular job, Performance evaluations of | hired workers may be fed back tothe computer for adjusting the system and method. Competencies shown to be predictive ofsuecesstul performance ofa given type of job are tested for at various stages in an online testing system. 3 Claims, 11 Drawing Sheets Giese) co _US 7,606,778 B2 Page 2 S618.182 S.71.400 soais sans 5778883 S504 swam Ss27070 sss2a7 885.087 Sp74on Sp7sT67 Syms 66 Ss.096 5099:900 6038295 5.089.776 6.086.556 6070.43 6.086.382 SIs 26.448 crn 6.192.029 213.780 6.280800 6266659 272467 e278812 6.280.140 atte 633453 6318628 6.341.267 370310 6388620 6408159 USS. PATENT DOCUMENTS 6.463.430 466914 6asto10 eaon73 ssiou os14o79 esiaoes 6.524108 6.567.784 501246 aut 1874 6,640.216 6.681.098 601,122 6728695 6735570 672.002 6.760.068 695.799 6853966 6851877 oss 581 {65.608 oe) 44 396 Toei ‘roso.0s? T9138 Ta9t39 7a00803 7310 826 78084 BL BI 8 BI BI BI 22 BI Bo 8? BI BL BI BI BL 2 BI BI B B i997 S997 109% Sips e098 1998 1098 1o.is9s Li i99s 1999 1o.1999 i399 11999 LL t999 11999 "2000 ‘42000 52000 2000 000 9 2000 102000 112000 22001 ‘42001 7001 oot ‘82001 2001 92001 o2001 1o200 1002 ‘2002 43002 2002 2002 82002 102002 to2002 12002 22002 1003 22003 2003 22003 72003 82003 9003 102003 1/2008 ood 42004 52004 52004 ‘roo 9008 22008 22005 Yann 200 ‘2005 9005 S006 ‘rons 32007 32007 ‘4007 12007 +4208 “Thomas Fatene Bao onisas Morrsca Ameren al ssn TOS Rivet al akshie Kershaw etal Taylor Thomas Endo Chest McGovern a Thalhammer-Reyeo Rakshie Klein Donel Brain tl Basmey etal. ‘Thomas Fiscman Hoctal Shechan Faent Ho Driscoll Naar Durand Haq Param Ogden 087 Thompson Smith Tb McGovern Kurs tal Bushey Driscoll et a Brady Mitsioka Sheehan Busche ‘lero ea MeMenimen ‘Thome Ley Bakow Tule Beans Willis t offs etal. TS Plenninger, Wie Pati ney AAmosood Boros Deb Bushey Watanabe Cloninger Hunter Williams Gay Frerone Seurborough Roy Roy Hartt Sexrboroegh Benjamin 7505919 B2 32009 Richardson 20010011280 AL 82001. Gilbert 20010031457 AL 102001. Pfenninger 200110082000 AL 11/2001. Defoon tn 30020019940 AL 22002 Matteson d0020082786 AL 42002. Surborough tl. dov20046199 AL 42002. Scarboroush et a. 20020128802 AL 972002 Farenden 20020128803 AL 972002 Farenden 20020128804 AL 972002 Farenden 20020198766 AL 122002 Marino eal. ao0200x7082 AL 22002 Newceet al donnO104091 AL 2003 Levin ta. 2003019168 AL 102003 Dewar 20030195786 AL 102003 Dewar 20090200136 AL 102003 Dewar 20050114279 AL $2005. Scarborough 20090246299 Ai 11/2008. Searboroush OTHER PUBLICATIONS Lim al, "A Method for (Recruiting) Methods: Faiiating Hunan autor input o System Design™, AC M1902 * Dianna Franklin, “An Esfetive Way to Hire Techaical tall ACM SIGUCCS, 186" erision Poiat Dat ne (+1999 StoveWorks Conference and Ei bation” 13 pages, May 1998)" Paul W. Brooks Clatemet Assessment: Opportunity an Chal lenges" IPMAAC fun, 4, 2000) Aprons A. pp. 1 tp webarchive ong web 1998206082136 svar nfo eves.” Ed Rubinstein ("Operators embrace aomated systems 10 hie the best, rede tro” 1997" ‘Schmit, Exploring the bouniary conitions fr interview vali: retaanalyi vali findings for anew interview type, Sumner 1909, Pasonael Psyeholog). 52, n2. pp. 448164 20 pages) ‘Kank. The weighed application blank, Ap 1998, Comell Hotel and ‘RestaantAdinstetion Quarterly, v3, a2 ‘Stokes (editor Biota Handbook: theory, research, and se of bio rapicl information in slection and perfomance peition,Con- fulling Psyehologiss Press, Ine. 1904, p. vl, 626-650 (22 pases. The Candidate Profile Record, brochure, Richardson, Bellows, Henry & Co Ine, Copyright 1082, 1983, 1989 (questionmie). A Technology Case Stay for Huan Resource Exectne”, Getting the High-Tech Mining alge, sow workindes com editorial a ‘HA0301 OL asp, “Sperion, ExtonMobil expand employeesreening agreement’, Industry News, ptoreti st npn 2001 1201020 rin sep ‘Robert F Enuich, “The Maay Advantages of Using IPS Diagnostic Software” Science Caco ine Critenden Mile Schoo, Armonk, New York sew ss-ps.comipdingnontic advantages. al, G. David Garson, Neural Networks An Introductory Gude for Social Sciatts, New Technologies for Socal Research, SAGE Publis tions, 1998, pp. 1-194, ReralWorks Professional 1/Plax” hips www nel vare som! prdcs_pro? jsp Jal 28,2001, 9p. 13. “Statistica ‘Neural Networks,” p/ww sas. comtat_an ml Jal 28,2001, pp. 1-1 David Scarborough and Bats Hollweg, “Tutorial on the Use of ‘Neural Network Models fr Personnel Selection: Detson Sciences Instiwe Southwest Relon Theor and Applications Procedings 27th Annet Confrence, Mat 6, 1996, 99. 181-153. David. Marshall and Dian J. English "Neural Network Modeling of Risk Avseuument in Child Protective Services” Payholegial Methods, vl No.1, 2000, pp 102-124 Ajay K. Aggaral tal, “Sslevtion of Surgical Residents: A Nawal ‘Network Approach” Chternetic and Stems: dn ternational Touma, vol 8, 2000, pp 417-490.US 7,606,778 B2 Page 3 Jodth M. Collins and Munay R. Clark, “An Application ofthe Theory of Neural Computation to the Prodition of Workplace Behavior An Ilustation and Assessment of Network Atay” Personnel Prychology, ol 46, 1993, pp 503824 Mitchell, “How fo Reduce the High Cost of Tarver” Lawson Software. Jul 12.2001, pp. I-11. of before Page ol, "Pacl Stiteaic Dietins in Simulation Research” Procoedinss ofthe 1999 Winter Simulation Confermce, 19. pp 1509-1520, Sosan Mengel and William Lively, Using a Network to Post Student Respoases” ACM, 1992. pp. 669.676 ‘Alex Peatland and Andrew Li “Modlin and rection of Human Behavior” MIT Media Lab Perceptual Conpuing Technical Report No. 433, 1999, pp 1-7. Pat Langley and Hebei A. Simon, “Applications of Machine Lear ing and Rule Indetion” Communications of the ACM, v0.38, No Nov 1985, pp. 868 “Xpenule Miner, The Complete Data Mining Solution” hp -worwatarcom/agesiafo amin Mar 23,2001, pp. LS “The Wie Seale Deployment of Active Daa Mining Solutions” Ip: wttacomtutor deploy tm Mat. 23, 200, pp 17. Abel AlAllay, “A Hyd GA-Hleufstie Search Suatgy, "tp ‘owas. com pages ev gp him Mar 23,2001, pp 1-8. Jon Doyleand Thomas Dean "Statepe Directions in Ata Intel ligence" ACM Computing Survey, sol. 28, No, De. 1995, Mar 24, 2001p 653070. Dennis Callaghin"Personalization on the ly—Sallon(ne, Front Mind Tap Advanced Technologis to Predict User Behavior “Make Recommendations.” eWook, Oct. 23, 2000, . $2 David A. Hensher, Ta T. Ton, "A Comparison of the Pretive Potential Artifical Newral Networks and Nested Logit Models or ‘Commute Mode Choice” Dumspuraton esearch Pat F Logit ‘and Transportation Revie, Sep. 200, vo. 36, NO. 3 pp 188-172 (absac only). Leander Kahney*KnowledgeMiner 2. Digs Out More Info" MaclWesk, Ost 20, 197, vol, No. 40, pp 23-24 (Cal Rosen, “Mining Datahase Treasures” Comping Conade, Sep. 26,1096, Vo. 22, No.2, pp 42-0. Robert W MeL eodeta.“Preicting Credit Risk: A Neural Network Approach Journal of Retail Banting, Fall 1993, ol. 13.0.3. Pp. yea fonOne’s Unique Product Feature” hp/wisffiontsch ‘om pies pdt Tenures ml Mar. 22,2001, py. 1-2 RichirdT Herel an Hamid R. Nematl*CKOS and Kaowalge Management Exploring. Opportunities for Using, Information Exchange Protocols” 4CM, 1999, pp 42-50 Fred Hapgood,"Embesed Logi” hp rw? clo comlarchive ‘050100 reist_contenthiml, Mar 23,2001 pp -3 Brachman et al. “Mining Business Databases" Communications of the ACM Nov. 1996, val. 39. No.l pp. 42-48. Scarborough “An Evaluation of Backpropgation Newal Network “Modeling as an lteative Methodology for Citation Validation of Employee Selection Tesi,” Doctoral Dissertation (MI Diseria- tion Services), University of Teas, 1995. “Michal Jordan and ChristoperM Bishop, "Neural Networks" The Computer Science and Engineering Hondbook, Tacks) 1996, pp 335-556 Robert M. Guion, ‘Persoanel Assessment, Selection, and Plce- mea" Handbook dustrial and Organizational Psychology, Cone fling Psychologists Press. Ine. 1991, pp. 327-397. ‘Personnel Sfetion Using Fussy MCDM Algorithm. G. Ling. MA ‘Wang, Eusopean Jounal of Operational Resclch, bvie Science By pp. 225%; Copyright 1998 An Expert Sistem fr Selecting Manufacturing Workers or Taining GA, Neuen, J.A, Chest, Expen System wth applications v9.9. No.3. pp 309-332; Copyriat 1995, The NASA Personnel Security Processing Expert Sysem, D. Silberberg, R. Thomas, National Conference on Artificial Ill ence Procesngs (AAD, pp. 1527-1532, Aug. 4-8. 1996, On the Architecture and Implementation of Parallel Ordinal ‘Machines, Ben-David G. Ben-David, IEEE Transactions on Sy tem, Manan Cybermtics, vo 25, No, pp 159-168, an 1995. ‘The Candidate Profile Record, brochure, Richardson, Bellows Henry Co. Ine, Copyright 1982, 1983, 1989 ‘The Supervisor Profe Record, ecuical sept, Richardson, Bel ows Henry & Co Ine not date The Manager Profle Record, Richantson, Helos, Henry & Coy Inc, act date, ‘The Candidate Profle Recon, Rihasdson, Bellows, Henry & Co Ine not date Management Information Packet for Customer Service and Sales Selection Criterion International, Ine» May 12, 2000 pp. 33 Cattomer Service and Clerical Pent Index tehaneal mas, ‘bre Ine Copyright 200 Customer Service ad Clerical PotealIndee™, candidate te. Pred, nc. Copyright 2001 “123 Assess Demonstration," ww thins comwcbsit archived an 28.1999, 2 pages ar, "Prditing the tenor outcome of teachers sed on variables nova atte time of application” North Caroling Slate University 1997, ProQuest 94 pags. “ApView Main Menu Demo, Aspen Tree Software, Ine, Jun. 13, 1997, 30 pages “Aspen Te Software Te Toa Soltion o Employse Resriting © Selection” Aspen Tre Softwar, Inc, Ost 27, 197.29 pages. SASSESS Exper System/Bighy, Havis & Associates, ne page archive rom www bghy com, 2 pages, May 7,199 “asessprevicw Welcome tothe ASSESS Ineret Onlin Preview.” ge ative fom war bihy com website, 1 pugs, May 8, 1999, SCAPS-A Teal Solstion for OfSte Screening and Scheduling” Demo, Aspen Tee Sofware, In. Apr 24, 1997.20 pages “Catalog” ‘webarhive org web! 1998206203353 ww. tehetiescomcatlog ml archived Dee. 6 1998, 3 pages. Indust of Chae” Food Service Reseach Fon, 46 pages Ja, 97, “aterview Gude or Tom Hom” Aspen Tee Software Inn. 1997.1 pags Now 18,197. More Firms Recruit Via the Internet," The Boston Globe, 2 pages. Now 14,1997 PR Newstie:TekMetics Help EDS Select Top Sales Tle Online 3 pages pw google.com searehhi-entgecachet Aww, findariclescom42Fet AsV mAPRNY2EIII Apis 2548025 -P<2FpM2Farile jul PR Newswise, 4p 29,1999 “Profil is Bill Upon Teamwork” Desision Point Data (pede sor company of Unies Ine.) mala to peospetive customer, 6 pages 1997 Saville Holdwoth, Human Resource Consting: ApView™ Net, prgesrchived fom new shlsa com website, pages, Ap 29,199. SHL Aspen Tee Software Solutions for Employee Selection, page chive rom www aspire om website, | page, Dex. 1, 1998 SHIL-IR Suppo Tools, Aalytial Process, Decision Suppo Tech, page archivel fom shina com west? pages Feb 18,199) ‘Solutions for Managers, Pofesonals and Supervisors” page achive from wat com websites page, Feb 9, 1999, “TekMtics skills ansesments & skills fest & resume tacking Frequently Asked” Questions” wwwtekmeticscom website auehived Ape 24,1990, 3 pages “Tuk Metries o Test Skis of Computer Sciences Corp, Sob Can dats Over the Latrnt, "EDP Woks IT Monitor vol 40 sue 16, PG Ape 19. 199, Top 10 Test Scores List wttekmtricscom website archived Det 5, 1998 page ‘Stone "Principal Selection: An application of mura network fare camting” Nowh Carlin Sine University 1993, ProQuest, 127 pases Byline, "Computers That Leary Doing. Issue 5p, Sp He? pages. Sep 6, 193, “Foderal Equal Employment Opportunity Laws” warweeve go. I pases G- David Garson, “Newal Networks An Inoductory Guide for Social Seen.” New Technologies for Social Research, Sage Pub onan vl. 128 lieatons, 1998, pp. 1-194 Glazer, “Neural Neovorks Take on Real-Would Problems" (btn) Compter Wor, 26,12, p21 (11 page, ug 10, 1992.US 7,606,778 B2 Page 4 Goodin, “As Jb Seekers Tum 19 Net” (Bie Article) Computer Weekly. ps (1), Feb. 4 1990, Lawton, "Genetic Algvithms for Shodule Optinizaion” (Cover Story) AI Expt v7, 15, p22 (6,7 pages, May 192. Kulonda, Dennis J, "ResngineringTrining for Performance Improvement.” Poland Intastional Confrence on Tachaslogy sd lnnovallon Masageaneal PICMET 99, vo. 1, Jul. 25-29, 1999 pp 333334 Scarborough, “DPDNewotech™" Power Point Presentation given to prospective employer Deision Pint Data (predecessor company ‘fUnieny le )32 pages, eleceonie copy pevieto Decision Poi Data, Des. 1998, Schaar "Where Neural Networks are Already at Work Puting AL to Workin the Maske" (Abstract) Business Week 8291p. 1362), page Now 2,192, Shannon, "A Mathematical Theory of Communication” Rerinted withcomection fom The Bell Syste Techical Journal, vol.27 9 379-423, 628 656,55 pages, Bal Oct. 148 US. Dept of Labor, Code of Feral Regulations Penning o US. Deparment of labo-Unifonm Guidelines on Employee Selection Procees, (CFR, Title 41, Chapter 60, Put 60-3) 52 pags, ew ol gow dol lletr Tile 41 Pan 60-3 him, 1978 “Legal Considerations When Using Testing” White Pape” wow tekantescom Website ascived Ap. 17, 1999, 3 page. “123 Asses!™-Qualiy Applicants in 10 Minutes” TekMetics, 008, pase “An Applied Look at Reducing Adverse Impact by Dileenialy Weighting Selection Measures” SIOP 2008, 18° Anaual Confer ence Hat Regency, New Orleans, USA. 3 pages Apr I, 2000 "Ae you end to Are you Ready?" ww brunbench com website auchived Mar 22000, 1 page “Applying Neural Networking Tecaigues to Prediction Problems i [LO Piyehologs:” SIOP 2000, 15" Annual Conference, Hat Regency, New Orlens, USA, 2 pages, pe 1, 2000. spe Tree Sofware helps lesen resume overload” PC Weck, vo 14.No.36.p. 84 2DNaL Aug. 28, 197 "Assess v2: Techaical Manual Bigby Havis & Ascites, Ine, 106, piaes Dec 2003, deseribing products from 1970-2008 "Assess V2-fr Selection and Development.” Bigy Havis & Associ- ates, Ine. 5 pages, hp wo bigby com systems assess: System ‘main.asp plied Aug 5.2008, showing applicants fom 1998 “Aserqrevicw ASSESS User Site Instctions.” page archived from sara bighycom website, | page, Ost 2, 2000. “Asverqueviow Higory of ASSESS” page archived ffom ww bighy com website page, Ot 11 199. “Ascsopreview: What is ASSESS?” page archived from wa bityrcom website, page. Oct. 1, 1999. Automated Technologies for Biodsta Preiton Systems, SIOP 2000.15" Angual Coaleence, Hyatt Regency, New Olean USA,2 piges Ape 15, 2000, "Batre You Bain: Welcome to SSA Online Help.” bp! eb archive o web 1998011 8183645 up hwo coopetsel com Inethip2 Hum. 6 pages 1998. “Brainbench-The Measure of Achievement: Sil- Based Employ ment Market," srwibinbench com webte white paper dled ln 24, 2000.9 pages “Biniabench- The Measue of Achievement: Completed Assess: sen” binbonch ony website archived May 12003, 1 page “Bminbench-The Measure of Achievement: Invascript Ceriict- tion” war ranbench som wchsitemehived Apr 4 2001, 3 pages “BsinbunlhThe Measure of Achieveinnt Mike Rasill” ww beaibeach conn website archived May 1, 2003, 2 pages, “PainbenchThe Measure of Achietement: The Rise of Online Cet ttetions," wa rsinbench com website whitepaper dated In. 26, 2000, 8 popes BrsibenchThe Skills Authority: About Our Assesses" ww Irainbeach conn website archived May 10,2000, 2 pages. “Brainbench-The Skills Authority Account Repsation” wo. ‘branch com weit archived May 11,2000, 2 pages. “Brainbench-The Skills Autboniy: ASsesmnont etter Demonsia- tion" ww brainbench om website archived May 12,2000, 2 pags. “BrainbeneheThe Skills Auhorty: Braibench Cesifcations™ swonwbminbench om website achive May 24,2000, 2 pgs. “Braibench-The Skills Authority: Brinbench to Develop Measure ‘ule! for BIG To Stall Major Depstmnat of Education Project. wlbaiabench com website jess tlease dated Fb. 11, 2000, 2 pages “Beainench-The Skills Aubority: Braibench VPto Discuss Rap Growth of Online Certiiation Indy” sw bminbensh om srotit press release dated May’ 2, 2000 2 pages, “Baainbench-The kills Authority: Cerifcations Add Efcincy to the Employment Market” waervbrainbench com website while paper dated Jun, 7,200, 4 pages “Brainbench-The Sills hott: Dat Warehousing pvt Cr ‘tations wore briabench com websie achive May 10,2000, 2 Skills Aubority: Der Afiate* wutsinbench «com website archived May 11,2000, 3 pags. “Brainbench-The. Skis Authority” EDS. Targets Training with Bainbench Test” www bnbench com website presteense dated ‘Mar 11,1999, pages “Brainbeach-The Skills Authority: FedSoures ne. Teams Lip with Bninbench for Online Sklle Centication “Service” wor. Tyainbeach com website pes eeas dated Oct 22,1099, 2 pages. “Braiabeach-The Skills Autor: Froquemly Asked Questions but Bratbeach Cettcaion!™ wo bsigbench com Website tehived May 10, 2000, § pages “Brainbeach-The Skills Authorin® Global E-Market Company’ for Silla Sersices Team with Worl’s Largest Online Certain ‘Athos wtninench com website press lease daa 2000.2 pages. “Basinbench-The Skills Authority: Hear What Our Customers Ase Saying. wonwrainbeach com website archived May 10, 2000, Sooges. “BeaiabeachcThe Skills Authority: Looking for Qualitied candi Ante” sare trninench.com website archived May 10,2000, pase "“Brainbench-The Skills Authority: Microsoft Chooses Brain Teatsto Prep the Markt fr Windows 200," ww binbench com svt prs flese dal Feb 17 2000, 2 pags “Biaiabeach-The Skis Authority: Oaline Cem Prop™" wat trainbeach com website achive un 22,2000, 2 pages, “Braiabeach-The Skills Authority: Oise Public Tanscxigt for Chastity Selig” ww trainbeach com website achive May 1 2000.3 pages. “Braibench-The Skills Authority: Online hil sessment Leader Brainbench Forms Partnership With Leading Qualiy-Rating Ser vies Provider” war brainbench.com site archived Jn. 6,200, 2 pages “Brainbench-The Skills Audory: Pricing” wwvvbiabench com website archived May 10, 200, 2 pages “Brainbeach-The Skis Authority: Privney Policy” wwe traineach com website achive! May 10,2000, 2 pages “Brainbench-The. Skills Author Sample Cental brainheach com webste archived May 1.2000, 2 pages “BeaiabeachcThe Skills Auhonty: See Where You Stan” www: trainbench om website archived Ap. 19, 2000, 1 page “Brainbeach-The Skills Authority: Take the Miroso Challeng” swwbabench om website archival Maz. 3, 2000, 2 pages. “Brainbench-The Skills Authority: Test Alen.” wow ranbeach, som webate archived am 21,2000, 2 pages, “Brainbench-The Skills Authority: ‘Test Developer” www. brinhench ont website achive! May 10,2000, 2 pages “Braiabeach-The Skills Audoriy: The Company.” www. byainbuach com website archived May 11,2000, page “Brainbeach-The Skills Authority: Top Ten Seores List” www, braineach cont website achive May 1, 2000, page, “Brainbench-The Skills Authosty: Welcome o Bainbench” www: brainheach om website archivo’ May 11.2000, 2 pages “Companies Registration” ww pevscreom, 8 pags, archived Sun 2000. “Configuring Your Hardware and Brows" Visual Learning Teck solos, htpvbarehie omg wes 109808241 11629 hp ww, provi com browser tml, pages, 198.US 7,606,778 B2 Page 5 “Custom Job Center” DecisonPoint Systems Hireink Network advertisement, 2 pages, provide o potential customers by Decision Point Systems (precesor company of Unica, In), below Jn. 2000. “DDI Launches Tech Spin- OIF Targeting Smal to MieSize Busi= nesses” Avantagelliingcom, hip wowadvantageiring com’ aboutpe_DDIspinoffasp, 2 pages, Sep 17,199. “DeesionPoint Systems-Alsng Technology That GivesYou A Com- petitive Advantage” DecisionPoint Systems HlrcPro™ adveise- teal 2 pages, providod to potential customers by Decision Pont Systems (predecessor company of Unie Ine) ele an. 2000. “DesisionPoint Systems-agine Beiag Able to Tacosprate Your ‘Company’ Jo Application, Skills Test, Background Checked Ta ‘Cra Paper ino One Simple Process” Dison Poi Systems dvertsoment 4 pape, provide to potential customers by Deesion Point Systems (preecesor company of Unica, In), below Jn. 2000. “Example Campus Manager roses” Bighy Havis & Associates, Ine. 3 pages. Mar 18, 189. “Facts Abou DDI: Who We Are, What We Do.” Development Dimensions International, Ine, ipod em abo (fcls.asp. pages, website vised on Nv. 2 2004 "et ert asa Java Programmes” hp we tekmetries com, 1 page Nov 16,2000, “Geling Started: 1-23 Assess" TekMetics ne, wor teleties com, 3 pages, 1998 “Gide to Using Assess Internet" Bighy Havis & Associates, Ine 13 ges, Mat 1999, “Highlights, The Bigh: Havis Newsletters: How Our Clients Use ASSISS” page archiva fom bigbysom chs, Lage, Ost 1900, ~iiePro.com-The Technology o Soest The Mal Fiploye fs Nowe Online” DevisioaPoint Systems HieProcom advatsement, 2 ges provided Io polenta esfomers by Decision Poit Systems {predecessor company of Unie, Ine) bore Jn. 2000 HirePro™-Autorated Hiring ‘System, DecisionPoint Systems FirePro™ advertisement 2 pages, provide fo potent customers bby Deision Pont Systems (peecessr company of Une, In) eflre Ja, 2000, iePro!™ Assessments Applicant Assesment Tests for “HluePs0™” DecsionPoint Systems Assessment Series averse ‘meal, pages, providod to potential customers by Decision Point Systems (predecessor compaay of Ucn, ne) before Jn. 2000, “HsePr0" DesisonPoint Systems HirePro™ advertisement, MB, provid fo potential customers by Dison Point Systems {predevesor company of Unien, Ine) bore fan. 2000 “HinePro™” Retail Diet Mail Piece 6 pages, provide open customers by Devsion Poin Systoms (prodacessor company of Uaiens, In before Jan 2000 “Interactive Interview Category Analysis Report” DPD Applicant, Report Decision Point Daa ne. (predecessor company of Uc Ine) I page, Ape 1998 “inerct chats om ine to replace pansr CVS." UK: Laamch of an ert CV Package Rta! Wook, 2 (1 page) Mar 13,1998 Invoice, Asses fo Internet Units” Bighy Havin & Associates In, 1 page Feb. 16, 1999 “Know It AllSiaffing Professionals” Know I Al, Ie, pe archiveong eb 9991009154938 www nsilline com sain, Bm page, 1999, “Kw I Allechoical Reenter” Know It ALL, Ine p/h archive.org web 1998120610646'www Knowing come ‘rater nk, {pag 1998 “Know It All-Trainiag Diectors” Know It Al, Inc pe, uchive np wel 19901000192333/ won knowitalinc ountraiing. Bn 1 page, 199, “Know I All, Ine: About Us" Know It All, Is tp webarchive ‘org wet 1999110016172 knowing con abu ML ise 1999, "Kao I¢ All, lc: Features and Benois Know It ll Ine, tp webarchiveonrweb'19901 110092810 wwwhnowialine com software im, 2 pages 1999 Sahami etal, "SONIA: A sevice fr ongnizng networked infonms- tion autonomous” Prooodiags ofthe third ACM conference ob Digi Iibaties 1998, New Approaches to Combining Mltiple Assessments fr Preict Jing riteron Ocomes”SIOP 2000, 1" Anmal Conference ya ‘Reponcy. New Orleans, USA, 2 pages, ap. 2000 Onliae Recuting Sales” Huat Scanlon com, tp hus- scalon som newsarcivesorsachives 200 jan hm 8 pes, lan 2000 “Predicting Sales Success: An Examination of Aleratve Prali- tora” SIOP 2000, 15° Annual Conference, Hyat Regency, New Orleans, USA, 2 pages, Ape 14, 2000. “Process Complete: Assessment Ress TekMeties ne. tp: swine prvone =Keatdaev filer ProgammerApeiudeTes hun, 3 pages 1999. Proposal to: (Cuomer Name Redate:: for Selection System Derelopment-Prodoction and Operations 4b Familie" Proposal £031 TRCO, Development Dimension national, ne .77 pages, Submited Sep. 30,1998 “Proponal to: Client Name: Web-Sereen Proposal" Development Dimensions Intrational, ne, 19 pages, 1999 “Prove! Demonrtation Test Welenme to Prove I Vial crn ing Technologies, hp webarchive one web 199080818227 ‘war proveit.con demo shun 6 pages, 199. “Prove It! Fentres and Benefits” Know It All Inc, p/w archive org web 19991000032645 wor nowitline som fats. Im 2 pags 199, “Prove leh Festzes and enefits: Internet and Intranet Solutions” Know It All Inc. hp: webarchive.rg Wwe 199911 10011034 sr knontaline com newark tm 2 pages, 199, “Prove I Ress Page” Know Ill Ihe htpwebarchive ony wal 19901009121500' ww kaowialline comes Hy 2 pages 1999. prove I Viuat Learning Technologie, hip webarchive an! wey 1998052411 1918p srwwpovedcomiindes him, 2 ages. 1998 “Prove com Features and Advantages” Vial Leming Techolo- ies, hip ebarchive ore wes 1D090S0SI8A2 14 sxe prove omentum, pag, 1998 “Psychology Technology Design: Solutions for Selection and Deve opment" SHRM Conference Bie, Buby Havis Associates, Ine? Pages Jun 1998 “QWIZ-Skils Testing and Training Sotvare” QWIZ, Ine. tp: ‘webatchive on web 9900218064159 www qwiz.cont mia page, 199, “OWIztek Remote Demo" piweharchive ong web! 1998120510815 208.147.160.198 welome aap, 2 pages, 1998 "QWIZteK™ Techical Skills Testing Software"hi: webarchive compel 1098 205272749 ge com giz tek elm, 2 pages, os. “RepotView"™.Closed Loop Repoting for HirePr0™" DestsioPoint Systems Repontview"™ advertisement 4 pags, po- ‘Vided to potential customers by Devsion Poin Systams(palocessor company of Unie ine), before Jan. 200. “ScttOneanicing Mapa and Comvntment Profiles” SIOP 200, 15! Annual Conference, Hyat Regency. New Orleans. USA, 2 pages, Apr 18.2000 Reka Product Line Vital Leung Technologies tp svcharchive ong veb! 1998052411739 hp ww prove com Prec 3 pages 998 ToekChelc IT Stil Tesing- Logistics and Seoting” Bookman Tes ing Services, Inc, tp weharchive orp wets 2000083316658) swwockcheck com/servies logic hm 1 page, 2000 “TeskChck Ape, 1999 Newslettg” Bookman Testing Services In. np: web archive orp web 19991022004537 ww teckchek com ome'newsleterD499 han, 3 pages pr. 199. “TekMaies E-Cetiieation (TM) Oflered On w:CarcerBuilde som: PR Nessvire, 9882 (2 pages), Mar 22, 1999. “The ASSESS System: An Assesment Tool for Consitng to Busi sos” Profesional Users Training Conference brochure, 2 pages 4h. 2.24, 1999 and Oct 7.9, 199 “The ad iday Report {to # Carer Opportunies” Peppers and Rogers Group, we lo serch con, Fe 11, 2000, pagesUS 7,606,778 B2 Page 6 “The Science Behind Our Produts-Proles ternational, ne." Pro- Sls Intoratonl. Inc, website archived May 26, 2000, ? pass. “UnicHistry, "hip wwwunicncomabout histor aspx. 3 ges, weit visited on Sep. 25, 2005, pages, recounting events from 1987-2005, “Welcome fo C&L Springboard: Welcome to SSA Online” tp: elbarchiveong web 1098011813630 ww-coopersel.com Serecal him, 2 pages, 1998 “What's Nev al TeckChok in TT Adapive Test Assessment." Book- rman Testing Services, Inc, Mips/weh achive ong we 0900422228828 wunndeckehek conhome whatsnew hn, se, 199, Cains, “Tools & Technology" Intemational Mass Retail Associa. tin, 1999 Store Operations & Human Resources Conference, Det ion Point Data, In. (prodscersr company of Unn, Ine.), 28 ges, Feb. 2, 1099 Duong et a, "A System of IAC Neural Networks asthe Basis for SelOnpanization ina Sociological Dynamical Stem Simulation” Bohavloral Sconce. vl 40, pp. 275-308, 1095 ‘Gormley, “Personality Texing:” Google Groups: alt psychology: hip: soups google.com group si peychology personality Troe thea thread acd 24 O86 321496703260648574- personality esting Simun=18 ‘Shi-eaf3279D7082606185, 5 pages, Jul 21, 1998, Jacobs, “Minimizing Risk: Hiring nthe 21° Century” wow sls ‘com, Presentation othe Intmational Persoanel Management Asso ‘ation Counsch, SH North America 4 pages, un, 7 2000, abate etal, "Employee Skills Analyaie Using Hybrid Neural Network and Expert Syste” IEEE Intemational Conference on Developing and Managing Inlligent System Projects pp. 208-21 Mar 1993 ake, “Webtased Sil Testing for Compute Professionals” Com. puting ol 8.N0. pp 30-32, 198. Mec, "A Few Good Employees (Sreening and Pralating Soft “warefor Employee Recruitment” Management Review: vl. §7,No 4.38, page. Ap, 199% ‘Mondragon st al, Implementing Web-Based HR Systems: From Recruitment Surveys an Besen SIOP 2000 Workshop 5, tp “sar stop ong Conferences 00Con Workshops workshops im, 2 ages, 2000. Diver, *Slouchos Make Ber Opestos (Aspen Tice Sofhane Designs Personnel Questionaire and Productivity Measurement Sotteare)." Forbes, ol 182. No.4. p 104, (4 pges), Aug. 6. 1993. “Tokunaga etal, "Carer Progussion ina Fortine 500 Company: Examination ofthe Glass cing” IEEE Tzanstios on Egince ing Management, v.43, No. 1996, pp. 2662-2672 Resi. “Online Cerieatons (Fres” CTS News Archives: vw jobs #202, 2 pages, an. 13, 1999 Scarborough, “Decision Point Systems” Presentation to potential ‘eustomer, Sages, temo fewer opis el with potential tomer, Wilsonville, Oregon, before Jun. 2000 Scarborough, "Welcome, Portland Sate University Presentation 0 about 15 people, Portland, Oregon 20 pages, before May 200. Walesa, “Cateporiing University Salen Applicants with Neural Networks” IEEE International Conference om Neural Network, IEEE World Congress on Computational Ineigence, vol. 6, 9 36h0-3685, 1994 Kaa Janes Bryan, City manager Tenure Stability: A Peitive Mode Based on Perceived Counel Comic, Leadership, Efective= ness and Conflict Reslution AP.” Nore linois University. 196, Abstract oly, 2 pages "Al About ApView" video (Length 17:13), Aspen Thee Softwa, In, Mar 7, 1997, video fe Training. a ‘ovendu, Michiel Okey Eghostba,“ENects of Stsition with Perfomance Evaluation Stems on Employee Tuoves” Nova Southeastern University 1998, Absit only. 2 pages. ‘Aspen Tree Sofware ideo (Length I44) Aspen Tice Software, Ine, Mar 10, 197, vdeo fle “AISa Springboard vido (Length 44), Aspen Tee Software Ine APE 30, 1908, dco le "Coopers Net av ‘Kemp, "Kaowledge-nsed Simul or Teaching” Proceedings of the I” New Zealand International Stream Conference n Ariel ‘Neuml Networks al Expert Systems; pp. 192+195, Nov. 1993, ‘itby tal, "An Analysis Applying Ariel Newal Neorks for Employee Selection Americas Confrence on Information Sys tems, 3 pages. 1998 Somers, MJ. "Applicaton of two neural nck perazms othe ‘ny of voluntary employee mover” Suma of Apis! Payee a3, 84, 177-188 (1099) ‘ale, “Neural Network Model for a Resoure locaton rob: Jem" IEEE Transactions on Systems, Man, and Cyberetics-Part Giteretes, vol. 28, No.2, pp. 276284. Ap. 1998 Tintotomen, DJ, "Note on the Meaturement and Prediction of ‘abour Turner” Jounal ofthe Royal Saisie Soca Series 8 (General) wo 122, No 2, 1959 pp 252-29, § pages ‘Morow ct al, “Using Absentstsm and Performance fo Pret “Employee Turnover: Eavly Detection though Company Racor” Journal of icaioal Behavior, vl $8, pp 388374199) 17 pes: Adapive Ousouring in Cross-onganzational Workflows” by lingemnn eta, CiS1°99, 1999 Alin etal. "hudgments off inthe seleetion process: the sole of ‘vod vale cangzuene.” Personnel Psychology, 10 Caldwell eal, “Personality Characterisis of lb Applicants and ‘Success in Srcening Interviews," 10 pope, Personnel Psychology. 198 CChambless etal, Iafosmaton-Theovtc Feature Selection for a neural behavioral Model,” Pecoodings ofthe Intemational Teint Conference on New Networks, vol 2, Fu, 15-9, 2001, pp. 1443 1488, 6 pues. Coben et. "Organizational Hsing Standard” Administeatve Sei fence Quatry, Mar. 1985. ‘Rees, “Infomation networks in labor markets" The American Feo omic Review, Mar 1966, ‘thant al. “Toward Optimal Feature Selection” In L. Suita, ‘itor, Machine Learning: Procedings of the Thirteenth Intern: tional Conference pp 2-289. Morgan Kava, 1996. ‘lvl, "Resmi seoen an ire St section an he dision ‘making proces,” Adnministation in Mental health, Fall Winter ior, Marin cl. “Using » Conceptully-based Predictor of Tena 19 Sclet Employees” Journal of Busines and Psychology vo, No 2, Winter 1998. Porsoaael Decisions, Inc, “Pi Man" ed Copyright 1994 Personnel Decisions, Iterations, Copyright 1996, 2000, Pessoal Decisions, Intratonal, “Employment lnventor)-Sles ‘Manual Copyright 1598. Development Dimensions International, In, “How Do You Stack Up Neat to Training's New Guard?” hp heb archive orgweb! 091012021541 daiwordcom nowiaedindexhim, 4 pages, weit archived Oct 12,1998 Dimpey, st a," Measurement-iased Modelo Prodi he Perfor ‘mance Impt of System Modifiations: A Case Sudy” IEEE Tran ‘tions a Parallel and Disiibuted Systems val. 6, No.1 1995, pp. 28-40, 13 pages. “Geral Gabis ta, “Stationl Interviews and Jo Perfomance” Public Personnel Managemen, sol 20, No 4p. 469, Winter 091 “Testing at Ssestion Took Another Old ant Sticky Manageri ‘Hunan Rights Iss" by George Munchus oural of Business E- ses 980. ‘rwwbriabench som website archive on May 24, 2000, US. Appl. No. 12338.703 (not published; Examiner has acess ‘trough PAIR) od Dee. 18, 2008 Incetor Deva Customer Service laventary How to Use PDI DiskScore” * cited by examinerU.S, Patent Oct. 20, 2009 102 ‘APPLICANT. TERMINAL 116 ‘APPLICANT. ‘TERMINAL, APPLICANT | TERMINAL, 120 124 ‘zt PARTNER ‘SERVER EMPLOYER ‘SERVER EMPLOYER ‘TERMINAL Nie Sheet 1 of 11 US 7,606,778 B2 06 108 SYSTEM ‘SERVER TESTING ‘COMPUTER PROGRAM, Test METADATA 110 ‘SCORING DATABASE, 116 FIG. 1U.S, Patent Oct. 20, 2009 Sheet 2 of 11 US 7,606,778 B2 201 APPLICANT TESTING 202 PREDICTIVE STACKRANKING | 7 FIG. 2 302 ANNOUNCEMENT f-7 306 304, my a SCREENING TEST coRRELATION [5 308 ‘AND SELECTION TEST prepicrive |) STACK RANKING ee, 310 | —_—4 qnTerview |” 402 TEST DESIGN rs 404 1 SY TEST ADMINISTRATION, << 46 _ —_______s_—____ EMPLOYEE PERFORMANCE EVALUATION FIG. 4U.S. Patent Oct. 20, 2009 Sheet 3 of 11 US 7,606,778 B2 OB VACANCY WIT AREQUREVENT FOR ANCRLINE CREAN AD SELECTION SOLUTION Spy BE) a) PERE) 7 amare] a scaTion | | wttcaion } | FECREMENT| | seat tomecrrRon | |aovenrises vacevennr’s| | vaaoe | FPMRRENT 7 secure | | oneal} compa ene | cus Foes gras |, owe ||» NETWORK URL TOAAY Ne cUTIONStESENED NO BAST UTTONSTHROIED SINE DATAFEOM BARS ATA WAREHOUSE CRIN n y arson, a | suceumcn 7 we Tee? TALE OF MRLCANTS = ——————] SoS A] = soeaws a ne Tare TODATA HES RT oe aE + wecare = t a (POAEBED) tL ene | ras SouuTiON | eras no jee 0 J 4 STAC) oT aE e weaey Sa i Er STE ALAN 46 DMCSEESTNDE) —OTHERDEASTON DATA SERED IN STARING FIG.5 (RRM Dara FORGES | THRE 7 APLIONTCOLECEDATADATEUS 7,606,778 B2 Sheet 4 of 11 Oct. 20, 2009 U.S, Patent 9914 Teeny NES] _arere] eS en] Se Tea PE oneal [1 =a aewemeceamaniona en O 8 pmumee ne mens O ¢ seme pang misma 0% ‘nen nn pun cpa ro ean HY “mpenwannean tana yan| emt gen a pon OR AED scoenesgtem O-3 sanesoiem O 9US 7,606,778 B2 Sheet 5 of 11 Oct. 20, 2009 U.S, Patent =D om ous Eee —+ ESE eta ; eae E Eee 3 tetera : See : eee ae eee ete Eee e Fe =e] Ta ea ES]US 7,606,778 B2 Sheet 6 of 11 Oct. 20, 2009 U.S, Patent et Yets- a Pg Dw oOo as.o- a]US 7,606,778 B2 Sheet 7 of 11 Oct. 20, 2009 U.S, Patent 206 "504 WAUBNRY- SUOHYSOG PIUPD HED 'AUONNS B1ANG WISN apn RO Gotn-B SG Daneel E--FaTU.S, Patent Oct. 20,2009 Sheet 8 of 11 Taras : rooms ‘NIA TRE | WEBSITE, GOES TO COMPANY'S. CUO ON APY HEE USE ND IDs HERUSER CHA oTANNO | | WHDIs ao ATTE east SLECTSAIOB SOTTOMOF THE AD SOEDING souTiON (WPRICANTS AY FORA JOHONLNE) 5 AMLICANTS RECTED TO THE CMP SOLE ARICATTON ROCESS TLS NATAL STATS ETHAN APRIATION FORM 17 SEEING SOUTIONIS ANTOMATICALY SERED TORQUE A NBER OF SUMMARY SCRE AND A INA. SC THAT DEES IF THE APRIAN ISSUTTARE CRATE (AL APACS WOKE SEAMESS INTO THE SCRA COMPONENT FT RICATION APS, MANTIS A CUSTOVIEDWeSSAGE NDICATNG TAT THEY HAE PASSED ND WILLBCONTACED Wy HERA, (8 FA, APLIONTRECENES A STONED NES DOKATIG HAT THEY HAVENDT PASSED AD THE NEXT STRSASREQLESTED YT COMPANY 5. CIMPANT AS OFTINOF ERECTING cone TONY PART OFTHE WERSTE TROUGH Te 9ST FIG. 10 US 7,606,778 B2U.S. Patent Oct. 20, 2009 Sheet 9 of 11 US 7,606,778 B2 ‘SELECTION SOLUTION (SUCCESSFUL APPLICANTS FROM TH seBON ‘SOLUTION ARE INVITED INTO THE COMPANY'S PREMISES FOR PURTHER ASSESSMENT) 10.CONPANY REVIEWS SUMMARY REPORT AND ALAPLIANTISINATED 12. COWRANY VUFTES THE TNATESARLICANTS TATO COMPAS |_| TOTIVOF THE APLCAT| |i ancan srs He INTOTHEDRRREWSES. | ]PRENESES AND LOGS To] ND AUTHORIZES THER TO)” SLECTION SOITION. FRANKEN SECTION SCUTIN STARS TH SECTION DEPTH ASSESSMENT, ‘SOLUTION. 15 STABELASSESSHENTS AE icone REA. TLE So THAT APRICANT| CAN BE RORRESSES ROUGH THE SOLUTION DRO OWT WATSS, APIANT MOVES SEAMLESS INTO THE SEND STE OF THESEECTIN SOUTION 1 APLICANT CoMnETES THE THE SECTION SOLITIN, HATES, AACA FECENES AGUSTOMIZED MESSAGE THANKING THEN FOR HER PARTICPATION TAL S2CIONSEMTT ARORATE ‘ea IFFAL, APLCANT RECEIVES A “THANKING THEW FOR THERPARTITEATION Rr scoRALE COMPONENTS ‘Ma IF FAL, ALCAN ECENYESACUSTONIZED ESSAGEINDATING HAT THEY HAVE COMAETED THE RCATIONROES. USTOMDED MESSAGE COMPANY TS ALE "ONE i REALTINE COUN, WRIOANTSRESKTS ND) THER RANK ROEU.S. Patent Oct. 20, 2009 Sheet 10 of 11 US 7,606,778 B2 (RNY OFA. GESTOWEHOSTS WEBSTED LOESONASAGIENT [ ‘STA IEW APLANT SETWPASEECTIN] —— [SETIRANINTBVEE soepung sovToy BESTS SdQuTION SOTO COWPAN RUT TB DETALSOF TH 108 TOWPRNTNUTS TE DETALSOF TE CE FOR WHAT WiSATO GEATEASOTION TOMA SETS FW A SBUESCE OP (ORG SETSRON ASRESCE DC KN QS THE EeRLES THATHEST ESO DIFFERENT COMPONENTS OF A SOLUTIONS (OF WHC 6 coven ts mOVTDED WITH -AURLAND AKEINSTRUCTED TO AD THER TOTHER ONE T CNP ATTAESTR TORRE ADVERTISEVENT ND WATSFORHICANS ane FIG. 12 PONT SOESIN STACIANEU.S. Patent Oct. 20, 2009 Sheet 11 of 11 US 7,606,778 B2 1307 — ‘SUCCESSION — RECRUITING 1306 1302 TRAINING & DEVELOPMENT MEASUREMENT ‘AND DATA 1305 ek 1303 PERFORMANCE MANAGEMENT.US 7,606,778 B2 1 ELECTRONIC PREDICATION SYSTEM FOR "ASSESSING A SUITABILITY OF JOB APPLICANTS FOR AN EMPLOYER RELATED APPLICATION This application claims the benefit of U.S. Provisional Patent Application No, 60/211,044, fled Jun. 12,2000. BACKGROUND OF THE INVENTION job hiring and promotion, 1978 the US. Federal Government established rigorous stan- dards Known as the “Uniform Guidelines” for the use of testing and screening instruments used to distinguish among ‘candidates fora given position. (11 CFR $§ 60-3). These standards are designed to prevent testing and screening instruments from ereating an adverse impact on any minority ‘orprotected groups during the hiring or promotion ofemploy~ ‘Over the last twenty years, a number of test booklets have been developed and published by various publishers in com- pliance with the “Uniform Guidelines." One example isthe ‘Customer Service & Clerical Potential Inventory (*CSCPT") developed by Richardson, Bellows, Henry and Co. Ine. The > ‘CSCPFis unlike most other tests in that responses are not right ‘orwrongin the traditional sense. Instead, the performance of the group picking each individual item aitemative have been statistically corelated across large samples of potential and tal employees fora position so as to create test that ean produce total score for that position. Ths total score may Jegally be used asa factor in the hiring or promotion process. ‘With the advances in computer systems and the advent of the Intemet, many different aspects of human resources man- agement have been computerized, including online reruit- ing. In lange part duc tothe rigorous standards imposes by the “Uniform Guidelines.” such online recruiting systems use ‘only certain minimum candidate qualifications (eg. college level degree, possesses a drivers license, number of years ‘experience fora skill) as a way of identifying potential can- o> sate Messe cane’ tiking stl High soe arity 10 Ie or eam goo placing ant ‘otitis. Meas the ends esi fo enlist ake ‘hr, an artnet on allny 9b hy nln oa orthestvee isober Mess the ene sity ‘ele tem eho ar send, optimise saute find denon igh ese ofprotsiontsn Meum ane’ scone iy prude ad rlsonis. They ao ve fet deep isin the se efocvty une uerel et mpety chance y the {ilies comple probes, ‘har erpetey chute head 1 verally explain complex ‘afation othe.US 7,606,778 B2 31 2 “TABLE THIRTEEN TADLE FIFTEEN-consined sonia Sein Scrpie_Detahion teat Compe _Detaion eas a Mina Cunmar — Mesne ayo ‘responses in realtime, the scoring syslem comparing applicant responses for requirements questions (0 employer requirements and being validated to predict ‘oth perfoemance andl turnover potential: 8 scoring database connected to the applicant sereening ‘an upplicant input system located on the employer's pre ‘mises and confighred to administer an in-depth assess- ‘ment ton applicant at the employer's premises fterthe Applicant has come t© the employer's premises and logged on; and 4 viewing system for permitting the employer to view Applicant results from the electronic peedicion system and the applicants rank order, the applicant resuls pro viding information on applicants who have high prob- ability of performing successfully and not teeminating carly. 2. Anclecttonie priction system for assessing asta ay ofjob applicants for an employer, the electronic prediction system comprising: plurality of terminals connected tthe Internet and scces- ‘sible by the applica; ‘an applicant sereening server connected through the Tnter- ‘et tothe terminals, the applicant screening server hav ing a testing computer program and storing test data; ‘statistical eorelation system for validating a set of appl ‘ation questions by statistically correlating job pertor- ‘mance ratings ofa plurality of workers who were hired ‘with previous responses given by the pluniity of work esto application questions before the plurality of work crs were hited; a resource identified by a uniform resource locator, the resource configured fo present application questions to the applicants atthe temminals and to receive applicant 0 34 responses entered st the terminsls in response to presen- tation ofthe application questions, the application ques tions comprising requirements questions eliciting informationon whether ihe applicants meet employment requirements; and ‘validated questions validated by the statistical eorrcla- tion systems; 1 scoring system for slomaticaly scoring the applicant responses in realtime, the scoring system being va dated bythe statistical correlation system to predict both performance and tumaver porential 1 Scoring database conaccted to the applicant sereaing server and 4 viewing system for permitting the employer to view applicant results from the eleetroni prediction system ‘and the applicants nk order, the applicant resus pro- ‘viding information on applicants who haves igh prob- ability of performing successfully and not terminating carly. 3. An electronic prediction system for assessing «stab ity of job applicant foran employer, the electronic prediction system comprising: ‘aphuraliy of terminals comnccted tothe Inert and acces sible by the applicants; ‘an applicant screening server connected through the Inter- ‘ne tothe terminals, the applicant sereening server hav- ing esting computer program and storing test dat 4 atistcal correlation system for validating a set of app ‘ation questions by statistically eorlating job perfor- mance ratings of a plurality of workers who were hired ‘with previous responses given by the plurality of work esto application questions before the plurality of w com were hited: ‘resource identified in an employerjob advertisement, the resource configured to present application questions the applicants atthe teminals andl to receive applicant responses entered tthe termina in response to presen tation ofthe application questions, the application ques- tion comprising: requirements questions eliciting information on whether the applicants meet employment requirements; and ‘validated questions validated by the statistical corela- tion system: 4 scoring system for automaticaly scoring the applicant ‘response in realtime, the scoring system being validated to predict both performance and turnover potential; 1 scoring database connected to the applicant sereeing server and 4 viewing system for permitting the employer to view aplicants results fom the electtoaie prediction system land the applicant’ rank order the applicant results pro- ¥iding information on applicants who have s high prob ability of performing successfully and not terminating carly.UNITED STATES PATENT AND TRADEMARK OFFICE CERTIFICATE OF CORRECTION PATENT NO. 7,606,778 B2 Page lof 1 APPLICATION NO. : 09/878245 DATED October 20, 2009 INVENTOR(S): Dewar Itis certified that error appears in the above-identfied patent and that said Letters Patent is hereby corrected as shown below On the Title Page [+] Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 USC 154(b) by 1,065 days Delete the phrase “by 1,065 days” and insert ~ by 1,848 days ~ Signed and Sealed this ‘Twentieth Day of July, 2010 [ued ST. Caypes David. Kappos Director ofthe United Sates Patent and Trademark: Ofce