LAKSHAY GOYAL

BIG DATA DEVELOPER

goyal.lakshay1993@gmail.com

+91-7986309816

Hi, I'm Lakshay a big data developer with 3 years of

experience in designing, implementing, testing,
deploying and maintaining hadoop clusters. I have
KEY SKILLS OTHERS
worked extensively using Scala, Hive, Hadoop and
Spark, now trying to get to know more about java and
nodejs . Looking for good opportunities where I can
contribute positively to build intuitive products that PYTHON LINUX BASH
HBASE IMPALA Phoenix GIT JENKINS
help people live more sustainable lives. SCALA SPARK HADOOP HIVE

EDUCATION : BTECH IN CSE

DOMAINS : [ BFSE ]
EXPERIENCE
JULY 2018 - NOW ITC INFOTECH

PROJECTS SNAPSHOT
Common-Layer Avalon

Credit Risk Data Migration

Common Layer acts as Data Lake used for all the ETL, migration,
reporting and auditing purposes in the organization. I was involved in
analyzing banking reporting and audit requirements, development of
migration within different systems, shell scripting for automatic data
pipelines which are ingested in Data Lake. Our team consisted of 4
members and we followed scrum.
outcomes for reporting on day-to-day basis, transforming of raw layer
Avalon is a strategy that underpins the transformation of Finance,
Account & Risk functions. The overall goal for Avalon remains to deliver
a single granular data repository for financial, accounting data providing
traceability, transparency, automation and new reporting and analytical
capabilities. I was involved in analyzing bank data for possible regulatory
involved in analysis and design of target table structure of CRDW and
data, improving batch timings and efficiency of the process and also on
process for migrating from Spark 1.6 to Spark 2.2 including new data
pipeline structure, new validation process for scala/spark developments.
Our team consisted of 5 members and we followed scrum.
Credit Risk data warehouse is a system used in Santander to store
balances, financials and is used by Risk team to prepare reports in SAS
for end users. The initiative involved creating Credit Risk data in Data
Lake to save the licensing cost of existing CRDW in Oracle and
Mainframe, and improve the efficiency of the whole batch. I was
writing queries to generate on transformation tracker in HiveQL, writing
scala/spark code to do the transformations , creating new validation
libraries for Cucumber .Our team consisted of 7 members and we
followed scrum.

TECHNOLOGIES USED TECHNOLOGIES USED

TECHNOLOGIES USED
Jenkins, Spark (3, 2.2, 1.6), Scala Jenkins Spark, Scala, Cucumber, Scala Test, Shell
Jenkins Spark, Scala, Cucumber, Scala Test,
(2.10.4,2.11.8), Cucumber testing, Scala Test, Scripting, Control-M, GitLab

Shell Scripting, Control-M, GitLab

Shell Scripting, Control-M, GitLab, Axiom,
Impala, HBase, Phoenix