Professional Documents
Culture Documents
Email: pvidyasagar221@gmail.com
Mobile: +91 9848699964.
Objective
Seeking a Lead Bigdata Developer position at highly reputed organization where I can maximize my technical
and management skills.
Profile Summary
A BigData Engineer with overall experience in 8+ years in Application Development, Spark, Spark SQL,
Databricks, Power BI and Agile Methodology experience as Hadoop/Spark developer in total IT experi-
ence.
Insightful experience in multithread programming and optimization techniques including configuration, mon-
itoring, debugging Hadoop/Spark clusters using Apache, AWS, Databricks.
Good Working Knowledge on Azure Data Factory.
Specialist in developing Spark jobs to process data in HDFS/AWS S3 and storing into Oracle DB and DBFS
Hands-on experience in development tools, programming techniques, and computing equipment
Implementing aspects of Scrum planning and exhibiting Accolade-India team with Accolade-US
An effective communicator with excellent relationship building analytical and negotiation skills and an op-
timistic mindset towards the task assigned.
Work Experience
Education
Technical Skills
Project Details
Project #1
Project Name: Emirates – Technology Analysis Wing
Client- Dubai Emirates
Role: Associate Data Scientist
Environment: Design & Development
Tools/Applications & Languages: Spark, Scala, AWS, ADF, Amazon S3, Databricks, Power BI
Team Size: 7
Key Responsibilities:
Collect and pre-process large volumes of call data, ensuring data quality and accuracy.
NLP techniques to analyse text data from call transcripts, chat logs, and customer feedback.
Assess customer sentiment and identify trends to improve customer satisfaction.
Work closely with cross-functional teams including data engineers, software developers, and business
analysts to implement data-driven solutions.
Administered Sprint planning with Stakeholders in Onsite
Analysed work as per ticket assigned in current sprint based on work-priority
Code fixing and debugging of issues across the Pipeline
End to End responsibilities from running the workflow and validation of DATA in Downstream applica-
tion for all Data partners in Test and Staging Environment.
Code fix and merge to Master after validation
Review of PR raised by Team (on shore and offshore).
Project #2
Project Name: Emirates – Enterprise Technology Module
Client- Dubai Emirates
Role: Senior Developer
Environment: Design & Development
Tools/Applications & Languages: Spark, Scala, AWS, ADF, Amazon S3, Databricks, Power BI
Team Size: 7
Key Responsibilities:
Established Sessions for different teams on Spark/Scala and Big Data technologies
Administered Sprint planning with Stakeholders in Onsite
Analysed work as per ticket assigned in current sprint based on work-priority
Code fixing and debugging of issues across the Pipeline
End to End responsibilities from running the workflow and validation of DATA in Downstream applica-
tion for all Data partners in Test and Staging Environment.
Code fix and merge to Master after validation
Review of PR raised by Team (on shore and offshore).
Project #3
Project Name: FlyDubai
Client- Airline Wing - flyDubai
Role: Migration Lead
Environment: Development
Tools/Applications & Languages:Hive, Spark, AWS, EC2 Cluster, Amazon S3, Databricks
Team Size: 4
Key Responsibilities:
Performance Optimization of Spark Jobs in Prod Environment
Administered Sprint planning with Stakeholders in Onsite
Analysed work as per ticket assigned in current sprint based on work-priority
Code fixing and debugging of issues across the Pipeline
End to End responsibilities from running the workflow and validation of DATA in Downstream applica-
tion for all Data partners in Test and Staging Environment.
Code fix and merge to Master after validation
Project #4
Project Name: Hertz-DA Analysis
Client: Accolade: US
Role: Software Development Engineering (SDE): Senior Developer
Environment: Design and Development
Tools / Applications and languages: GitHub, Spark, Scala, AWS, EC2 Cluster, Amazon S3
Team Size: 6
Key Responsibilities:
Debugged, reviewed and code fixed Dev components & checked the updated code in GitHub for various
modules
Supervised the workflow and validation of DATA in Downstream for all data partners in Test and Staging
Environment
Took part in Scrum planning and managed current sprint and prioritize the requirements
Spearheaded 6-member team and monitored the status of the team’s ticket assignment
Performance tuning and send the Stats to the Client
Project #5
Project Name: BCBS Data Analysis
Client: IH-US
Role: Senior Software Engineer
Environment: Design & Development
Tools / Applications and languages: GitHub, spark, Scala, AWS Databricks
Team Size:4
Key Responsibilities:
Implemented Spark Framework in EPDB-EDH migration using Scala
Performed codes with Spark SQL
Participated in the scrum, requirement clarification and sprint planning, technical discussion, estimation,
and work assignment
Programmed assigned Jira tickets and focused on completion within due date
Project #5
Project Name: Sikuli Migration (Magneta-BX)
Client: RADIUS
Key Responsibilities:
Designed functional documents, technical design phase and release documents
Deployed and debugged an application in a different integrated environment
Conducted business discussions and requirement gathering
Managed business and ensured it is delivered on time
Developed and maintained back-end Python-based application for the trading platform
Established business requirements and reusable component.