Mettl Hack

MATCHING OPPORTUNITY TO TALENT

MERCER METTL IN NUMBERS

2010 $4.5
Founding Year
Acquired by Mercer
billion
50% 2400+
CAGR clients
Revenue for Mercer Globally For Mettl in the past 3 years AIG, Accenture,
in 2018
Amazon, Ford,

~400
Fujitsu, SAP,

employees
Including 150+
product & tech
employees
12+ Assessments
Annually
With ~33k daily
Microsoft, Novartis,
PepsiCo, TCS and
Toshiba

million tests conducted

3000+ monthly
qualified leads
23000+ Mercer employees

140+ countries 20+ languages 300+ skills

Delivered in With Mercer Colleagues Supported for assessment delivery Covered with 80k+ questions
AT T R A C T I N G T H E R I G H T TA L E N T I S A N Y C O M PA N Y ’ S
BIGGEST CHALLENGE IN 2019

Source: Mercer’s Global Talent Trends 2019

A C O M PA N Y ’ S K E Y H R I M P E R AT I V E S :
I D E N T I F Y I N G , N U RT U R I N G A N D E N G A G I N G I T S TA L E N T

IDENTIFY NURTURE ENGAGE

• Fresher & Experienced Hiring • Training Need Identification • Hackathon

• High Potential Identification • Employee Certification • Feedback Surveys, 360
• Best Fit Hire • Individual Development plan • Contests

M E T T L H E L P S C O M PA N I E S I N A L L 3 H R I M P E R AT I V E S
 ASSESSMENT USE CASES ACROSS THE EMPLOYEE LIFECYCLE

Mapping stages in Employee progression with

Consistent and Objective assessments

P R O J E C T L E A D E R S H I P
R E C R U I T M E N T T R A I N I N G P R O M O T I O N S
D E P L O Y M E N T R O L E S
External Hiring • Identify training needs • Run Competency driven • Identify High Potential • Conduct Blended and Virtual
• Using Psychometric, Cognitive, across and benchmark filters (using Personality employees with all round leadership assessments for
Domain tools to gauge Technical employees on behavioral Profilers & Cognitive tools) assessments (Technical + mid to senior level employees
and Behavioral competencies and domain skills per a to shortlist for Project Functional + Behavioral)
• Use Pre-built Assessments
• Leverage our Hackathon client’s competency allocation
framework for Leadership Potential to
capabilities to identify the right • Conduct ‘Bridge input into succession planning
hires from a large candidate pool • Gauge Training Assessments’ mandated by
Internal Job Transfers Effectiveness through clients
custom assessments as per • Update Candidate Skill
• Identify Alternate Job Role Fit using the learning programs profile with results of
breadth of skill assessments to
inform Individual Developmental Training Interventions
Plans (IDP)
Assess candidates on a robust Platform that Utilize Certification Platform to facilitate Secure the assessment delivery using our
can be integrated with internal continuous learning programs through integrated state-of-the-art Proctoring Technology and
LMS, ATS and any other HR systems Candidate Leaderboard and grading logics trained team of human proctors
OUR CORE BUILDING BLOCKS

CONTENT TECHNOLOGY REPORTING

Certification Platform
Instant
Personality
HireTrack Platform Reports
+ +
360 Platform
Customized
Cognitive Hackathon Platform Reports
+ API +
IT/Tech Talent
Simulators
Simulators
Skills Analytics
+ Proctoring +
Proctoring
Domain Skills Benchmarking/
(White/Blue-collared) Validation
Core Assessment Platform
CORE ASSESSMENT PLATFORM
 Content Prowess
Business Intelligence
Web Development Total Sub-Skills: 13
Total Sub-Skills: 17

IT Infrastructure and Services

• High Quality SME Verified Content Total Sub-Skills: 23
• Over 2000+ Skills, 32+ languages, 45+ Data Management SAP
Software's Covered
Total Sub-Skills: 21 Total Sub-Skills: 25
• Dedicated Quality & Research Team
• Custom Content as per Need Software Development
Total Sub-Skills: 58
Software Testing
Simulator Based Skills
Total Sub-Skills: 17
Total Sub-Skills: 46
 Content Quality
MCQ Code Simulators
Most of our competitors get
an inverted graphs which Competitors
signifies that either
candidate could or could not
solve a problem.
Differentiation between
good coders and great coder
is hard to find. 

Mettl Simulator based test's

Mettl
With our content and methodology we are able move from a give you more spread graph
filtration process to a selection process . Typically for a which helps in differentiating
normal test (MCQ based) if we plot a graph between %Score between good and great
Vs Number of candidates as shown above. Assessments are coders. Varied test cases are
able to discriminate well between high and low performers added in coding question,
enabling you to discriminate
at various performance levels.
Simulators Spread

Front End Test Hands-On Skills

Back End
HTML C
CSS
Auto-Graded C++
JavaScript Customized Scoring C#
jQuery Java
AngularJS
Self-Create Test Cases Python
Bootstrap 10 More..

Database Case Study Mobile

MySQL • Check Design Thinking Android
Oracle • Architectural Decisions iOS
MS SQL • Project /Product Swift
Management Decisions

Most Extensive Range of Simulators to Assess Candidates

Simulators Spread

Backend Technologies Frontend Technologies

Database Technologies
Simulators Spread

Code Project R Studio

Android Full Stack -MEAN

Report Strength

Capture Coding Essentials

Reflect Coding Journey
Insights into Approach and not just Final Output
Coding Time-lapse Available for Playback
Capture Code Correctness
Static Code Analysis
Auto-evaluated results for test cases
Measure Code Scalability
Cyclomatic & Time Complexity
CPU Usage and Processing Time for Test Cases
Easy to Configure and Customize
What all is Possible?
• Multiple Report Types - Single Page, In-Depth, High Level
• Alternate Views of Same Report
• Appealing visual representation of candidate scores
• Comparison of candidate scores with benchmarks
• Analysis of candidates’ strengths, weaknesses, red flags etc.
• Recommendation of candidate for a particular job role
• Developmental Plan, Interview Questions
 Our Core Offerings

Assessment Certification
Hackathons
Battery Platform
• Ready to use tests for 500+ • Single click setup with full • Quickly set-up and roll out
job roles with relevant customization certification tests
industry benchmarks
• Leaderboard and analytics • Build developer communities
• Customized tests curated as
per job role & competency • Social media integration • Certify tech platforms,
framework* frameworks, libraries..

*Also available –Technical Competency Framework Development

Assessment Battery - Pre-Built Tests
 Ready to use
 Multiple Difficulty Levels
 Industry Benchmarked
 Validated
Over 50+ Tests in…
Operating Systems & Cloud
Unix/Linux Fundamentals, Android
Amazon Web Services
Front End & Backend
HTML5, AngularJS, JavaScript
C, C++, C#, Java, Perl, PHP, Ruby, Python
Database & Big Data
DBMS Fundamentals, SQL,
PL/SQL, MySQL, Hadoop
Programming & Testing Concepts
Basic, Advanced Programming
Manual, Automation, Performance Testing
Assessment Battery - Curated Tests

Job Analysis Mapping Assessment Reporting &

Configuration Analytics

1 2 3 4

Understand the Key Skills Map Key Skills to Create assessments as per Tailored Reports –
critical for the job role Competencies mapping Band analysis, Strong and
weak competencies,
Development Plans

Customized Assessment Tailored as per Job Role

Hackathons

Fully customized solution Leader Board

Have full control on the event Complete view of event in one-page
Create your own Challenges, Shows over-all ranking, Individual
Invite users & Create Custom Reports scores and overall score distribution
High Engagement
Brand Positioning
Reach & Access
Social Media Connect
Quick Scheduling Marketing Support
Up and running Create buzz about the event on
in a few clicks Facebook, Twitter and other social media

Challenge Programmers using Mettl Hackathons

Hackathons

Hackathons

• Single click setup with full

customization
• Leaderboard and analytics
• Social media integration
 Certification Platform

Quickly Roll-out a Secure, Scalable & Robust Software Certification Program

Author Rich Assessments Payment gateway Certification Management

Create and upload custom content, Seamless Integration with Paypal, Award certificates real-time on test
Gauge hands-on capabilities using Discount coupon management, completion, Email and sms result
software simulators Reports around payments notification

Control Workflow White labelling

Schedule level based Assessments, White labelled URL
Set pre-requisites and pass/fail criteria and Candidate Experience
 Mettl Hack - Key Benefits

Objectivity in People Decisions Scalability

Make Accurate and Consistent Decisions Based on Data Assess a Wider Pool of Applicants and Employees

Blended Assessments Process Optimization Gains

Use both technical and psychometric tests to assess people Time to Offer Reduction, Panel Hours Saved

Integration with Existing Processes

Seamlessly incorporate solutions into wider HR processes
 Marquee Logos
Campus Hiring Lateral Hiring L&D

Certification
Platform
 Media Mentions

Winner of Michael Mr. Thomas

Named among the
Porter & IFC-Mint Featured in Friedman talked
Top 14 Start-ups
Strategy Award for CNBC’s Young about Mettl and
to watch out for
Technology Turks for how it can
by Economic
Enabled Innovation transform
Times
Assessments assessments
 Team

Ketan Kapoor Tonmoy Shingal Siddhartha Gupta Guneet Sahai

Chief Executive Officer Chief Operations Officer Chief Revenue Officer Chief Technology Officer

Investors
 Code Snippet

• Automatically evaluates the code on various Evaluates the hands-on

parameters experience and capability of a
• Candidates can choose the language to attempt the candidate to solve a problem
question in his/her desired
• Allows candidate to run their own test cases programming language.
• Multiple editors like Emacs, Vims, Sublime
• Supports 9+ languages like C, C++, Java, Php,
Swift etc
• Allows the candidate to compile and run the code
Appendix
Simulators
Code Snippet – Candidate View
Code Snippet – Candidate Report

• Case pass/fail details with scores

• Compilation status
• Preferred language
• Cyclomatic complexity
• Candidate code

Sample Report
 Code Project

• Here we provide project explorer interface in

tree like structure for easy navigation
Used to assess the development
• On demand database connectivity with which
skills of a candidate within an candidate’s programming skills with
Integrated Development Environment underlying data storage can be easily
evaluated.
• Allows candidate to write their own unit test
cases
• Supports languages like C, C++, Java with
oracle and MS SQL data connectivity
• Both Automated and manual grading
available
Code Project – Candidate View
Code Project – Candidate Report

• Test case pass/fail details with

scores
• Static code analysis
• PMD for Java
• FxCop for C#
• CPP Check for C
• Candidate Code with Output

Sample Report
 Database Query Question Type

Evaluates a candidate’s • Admin can create their own tables with

capabilities to write correct and multiple datasets
optimised queries to access data • Supported database : MySQL, MS SQL,
in MySQL, MS SQL and Oracle DB Oracle DB
• Allows candidate to run the query and the
check the results
Data Base Query – Candidate View
 Data Base Query – Candidate Report

• Test case pass/fail details with scores

• Candidate response
• Queries written by the candidate

Sample Report
 Front End Simulator

Evaluates a candidate’s
• Create custom, simulated assessments for the
capabilities to implement web front end language
designs and to solve problems
• Create auto-scored or manually scored
using front-end technologies
assessments
like HTML, CSS, JavaScript
• Test candidates on micro skills within a larger
skill set
For example - CSS>>CSS effect>>Box
Shadow effect
• Supported environment : HTML, CSS, Java
script , jQuery, Angular js , React js
Front End Simulator-Candidate View
 Front End Simulator – Candidate Report

• Test case pass/fail details with

scores
• Candidate Code with Output

Sample Report
 Android Simulator
Android Simulator questions can
be used to assess the Android app
development skills of a candidate
• Easy Question Creation - Authors can add
their own source templates or use Mettl
recommended blank templates
• Candidates can download the source template
and create their app and upload them on
Mettl, we would build them in sandboxed
environment create an APK and share a QR
code
• Candidates can install their app on their
mobiles and test if things are working fine or
not
Android Simulator-Candidate View
 Android Simulator – Candidate Report

Test administrators would be able to

download the candidate source code
uploaded by the candidate and a QR
code to scan and download the
mobile app on their android devices.
Simulators – Expertise Matrix
Code Snippet Database
Apprentice Apprentice
Experienced Experienced
Mentor Mentor
Master Master
Coding Simulator’s
Expert Matrix
Code Project Front End Simulator
Apprentice Apprentice
Experienced Experienced
Mentor Mentor
Master Master
Conduct ‘Contests’. Hire through Engagement
Image Based Cheating alerts
Additional Person There Candidate Not Present
1. Advanced Computer Vision technology based
on Deep Learning
2. Algorithms trained on 1M+ images
• 0.3M new images captured daily
3. 6 Distinct Alerts Generated in real-time
• Strong Ability to Raise alerts for Difficult cases Candidate Face not Visible Candidate Face Partially Visible

4. Key techniques used – Object Detection, Face

Landmark Detection, Head Pose Detection,
Face Verification
5. Accuracy for matured flags > 95%+, Accuracy
for new flags >80%+
Mobile Phone Detected Candidate Looking Away

IMAGE BASED ALERTS

AUDIO Based Cheating alerts
1. Using Mix of Deep Learning and ML based
techniques
2. Alerts generated for –
1. Detection of Human Voice in Audio Feed
2. Distinct Human Voices Detected
3. Key techniques used – Voice Activity
Detection, Speaker Diarization
4. Unique Differentiator globally

Person1 Speaking Person2 Speaking

Appendix
Use Cases
Use Cases

• Campus Hiring

• Lateral Hiring

• L&D - Platform

• L&D – Implementing a Technical Competency Framework

• Certification
Campus Hiring

Marquee Logos
Hire Right
Customized assessments as per job role
Hire Fast
Automated reports, Ready to use question banks
Scalability
Conduct online & offline assessments
simultaneously at multiple locations
Reduce Interview Costs
Use coding simulators or behavioural
assessments to filter relevant candidates
Lateral Hiring

Marquee Logos
Hire Right
Customized assessments as per job role
Hire Fast
Automated reports, Ready to use question banks
Scalability
Conduct tests for large applicant pool integrate
with ATS, HRMS
Reduce Interview Costs
Use coding simulators or behavioural
assessments to filter relevant candidates
 L&D - Platform

Marquee Logos
• Administer trainings and workshops on
Mettl platform
• Author or Upload Custom Content on
platform
• Pro-active feedback on candidate
performance and other analytics
• Active support on platform usage

*Also available –Technical Competency Framework Development

 L&D – Implementing TCF*

Marquee Logos
Implementation of Technical Competency
Framework Based on Org Needs
4 Step High Level Process Divided into 13
Detailed Steps
• Understanding
• Developing
• Executing
• Reporting

*Also available –Technical Competency Framework Development

 Certification Platform
Marquee Logos
Custom Author Assessments
Simulator based or knowledge based
Control Workflow
Schedule level based assessments, set perquisites /
pass-fail criteria
Certification Management
Award certificates real time on test completion
Payment Gateway & While Labelling
Integration with Paypal, Discount Coupon
Management, Payment Reports

*Also available –Technical Competency Framework Development

Appendix
Case Studies
 Campus Hiring : AmDocs
Business Challenge
• The company decided to undertake their campus hiring for the season with the aim of hiring
highly talented fresher from prominent IITs / NITs

Solution “Mettl is far superior

than any of its
competitors. Their test
• Provided online assessments and platform which served as a solution to company’s issue of
results have 50%
length and costly recruitment process
correlation with
• Identified areas of requirements for the specialized assessments and created standardised
eventually hires. We
assessments for IITs consisting of skills including coding, case studies, and guesstimates
have no complains !”
Head India
Recruitment Team ,
Impact Amdocs
• Optimised the hiring process for each candidate by giving real time auto graded results
• Improved correlation with use of coding simulators with eventual hire achieving av1:2 for
each candidate interviewed.
 Engage your Employees : Wipro

Business Challenge
• Learning and Development team wanted to understand the growing gaps in skills for all employees
• Accounting scale , acceptability , neutrality and faster results

Solution
• Provided online assessment platform for creation of new question statements and challenges across the stack of
technologies
• Online simulator based challenges to engages employees having cloud based IDEs giving real time feedback

Impact

• 10k+ employees participating in the last year for Learning Weeks

• Easier Training gaps identified and Skills champions specially for new technologies
Appendix
Technical Competency Framework
 Technical Competency Framework (TCF)
Overview
TCF outlines specifically what people need to do to
be effective in their roles.
Each individual role has its own set of competencies
– integrated knowledge, skills and attitudes (KSA) –
needed for performing effectively in that role
Benefits
Helps organisation know expected competencies
required in each role to achieve overall objectives
Helps in showing workers what KSA’s the
organisation values
Application of TCF
Recruitment
Recruit & select new staff more effectively
Workforce Development
Identify skills gaps more effectively
Provide more customized training and
professional development
Performance & Change Management
Evaluate performance effectively
Plan sufficiently for succession
Manage change management processes
more efficiently
Designing & Implementing a TCF : High Level Steps

Understanding
Understand the Organization Structure and various Job Roles

Developing
Develop Technical Competencies, Skills and expected Proficiency levels for each Job role

Executing
Create Assessment blueprints, Test items and Actual assessments

Reporting
Conduct Benchmarking exercise, Custom reporting and Continuous improvement
 Designing & Implementing TCF : Detailed Steps

Understanding the Identifying job clusters /

organization structure job families for which
Understanding and its various bands and TCF needs to be
levels across job roles implemented

Mapping job roles to

Developing / finalizing Mapping each technical Defining proficiency
expected proficiency
Developing technical competencies competency with relevant levels for each technical
levels across different
for each job cluster skills for every job role competency and skill
skills

Developing assessment Creating links and

Developing test items / Developing assessments
blueprints based on coordination for
Executing mapped skill sets for
questions based on based on the blueprint on
conducting assessments
blueprint (if needed) the Mettl Platform
each job role as per agreed schedules
Revisit predictive
Conducting a Using Standardized
validity scores and
benchmarking exercise reports or Creating
Reporting across skills for each job custom reports at
benchmarks every 6
months for continuous
role competency level
improvement
Expected Output for Each Job Family

Job Family 1
Proficiency Level 1 Proficiency Level 2 Proficiency Level 3
Competencies Job Role 1 Job Role 2
PL1 PL2 PL3

Competency 1 <Definition> <Definition> <Definition> PL1 PL1

Competency 2 <Definition> <Definition> <Definition> PL2 PL1
Competency 3 <Definition> <Definition> <Definition> PL1 PL2
Competency 4 <Definition> <Definition> <Definition> PL3 PL1
Competency 5 <Definition> <Definition> <Definition> Pl1 PL2

Expected Proficiency Level for Job

Role 1 Across Various Skills
 Sample TCF : Software Development
Technical Proficiency Level 1
Competencies PL1
Knows the basics of
database design and UI.
Software Participates in design
Design workshops and makes
suggestions. Understands
complex design patterns.
Demonstrates basic
Software programming language
programming/ skills, packages, and writes
coding codes for basic applications
as per the specs
Understands testing
Software processes and policies, able
testing to own the unit testing of
sub-modules
Job Collection : Software Development
Job Role 1 Job Role 2 Job Role 3
Proficiency Level 2 Proficiency Level 3 Software Sr. Software Lead
PL2 PL3 Developer Developer Software
Developer
Conceptualizes database Demonstrates in-depth
design, UI and design knowledge of UI, database
patterns from the design. Analyze software
--- PL1 PL2
requirements. Prepares design architecture that will impact the
documentations. (relevant design quality. Implements best
certifications preferable) practices
Demonstrates in-depth
Defines coding standards,
knowledge of coding standards,
implements design patterns,
thorough coding principles and PL1 PL2 PL2
reviews programs and debugs
best coding practices, excellent
codes
debugging skills
Possesses knowledge of
Demonstrates in-depth
testing processes policies,
knowledge of testing processes
Implements testing of
and policies, establishes testing
complete modules, able to PL1 PL2 PL2
strategies for integrated systems,
detect issues and
identifies the level of testing
communicates to those
required based on the architecture
accountable
 TCF Mapped to Skill Sets : Sample
Java Developer Blueprint
Proficiency Multiple Choice Questions Coding
Competencies Level 1 Skills Sub Skills
PL1 Easy Medium Hard Easy Medium Hard

Software
--
Design
Core Java 6 4 1 1
collections 3 3 1 1
Threads 1     1
Software
PL1 Java Generics 1     1
Development
Exception handling 2 2   1
Hibernate 1     1
JDBC 1     1
Software Simple unit testing 2 1 1 1
PL1
Testing Manual testing 2 1   1
 TCF Mapped to Skill Sets : Sample
Sr. Java Developer Blueprint
Proficienc Multiple Choice Questions Coding
Competencies y Level 1 Skills Sub Skills
PL1 Easy Medium Hard Easy Medium Hard

Data Stacks 1    
Software Design PL1 Structures Queues 1    
Design Patterns Basic Design Patterns 1    
Core Java   4 1 1
collections 1 1 1 1
Threads 1     1
Generics       1
Software Exception handling 1 1   1
PL2 Java
Development Hibernate 1
1 1 1
Servlets - Filters 1   1 1
Spring - Advance 1     1
Spring - Core       1
XML Processing   1   1
Simple unit testing 1     1
Software Testing PL2 Manual testing 2 2 1
Selenium 2 2 1 1
Sample Reports
Appendix
Mettl vs Competition
 Mettl vs Competition (1/3)

Coding 1 1 1 1 1
Plagiarism 1 1 0 1 0
Partial Scoring 1 0 1 0 0
Code Project 1 0 0 1 0
SQL 1 1 0 1 1
Auto 1 1 0 1 1
Front End 1 1 0 1 0
Auto 1 0 0 0 0
 Mettl vs Competition (2/3)

Devops 0 0 0 1 0
Android 1 0 0 1 0

Auto 0 0 0 1 0
Interview 0 1 0 1 1
Content 1 1 0 1 1
Their 1 1 1 1 1
Self 1 1 0 1 1
Analytics 1 1 0 1 1
 Mettl vs Competition (3/3)

Proctoring Cut/Copy 1 0 0 1 0
Snapshots 1 1 1 0 0
Live Feed 1 0 1 0 0
Screen Feed 1 0 0 0 0
 Mettl is India’s leading talent measurement firm offering
innovative technology based assessment solutions

Assessments Languages Clients Countries

10 Million+ Assessments | 20+ Languages | 2000+ Clients | 80+ Countries
Processes we make more Efficient

Recruitment L&D

+ Fresher & Lateral Hiring + Training Needs Identification

+ Campus Engagement + Succession Planning
+ Recruiter Branding + Employee Certification

Solutions for both prospective hires & current employees