RAHUL BANDEWAR
Experience Summary
• 4+ years of experience in designing,
developing, deploying, and maintaining
scalable batch and streaming data
pipelines using cloud-native and open-
source.
• Experienced in deploying production-
grade, data pipelines on GCP, AWS, and
Azure.
Certifications
• Google Cloud Certified - Associate Cloud
Engineer
• AWS Certified Cloud Practitioner
Key Skills
• Languages: Python, Scala, Unix
• Analytics: SQL
• Big Data: PySpark, Spark, Hive, Kafka
• Databases: Postgres, MySQL, Cosmos
DB
• AWS : EMR, S3, RDS, IAM
• Azure: Event hub, Stream Analytics, ADF,
ADL, Azure DWH, Databricks. Cosmos DB
• GCP: Biguery, Pubsub, Dataproc, Cloud
composer, GCS, CloudSQL
• Orchestration: ADF, Airflow, Git
Education
• Postgraduate Diploma in Advanced
Computing, Pune, India – Aug’16 to
Feb’17
• Bachelor of Engineering – Electronics
and Telecommunication, Pune
University, India – Aug’12 to Jun’16
Employment History
• Core Compete – Sep’19 to present
• Atos Global IT – Mar’17 to Aug’19
Personal Details
Name – Rahul Deelip Bandewar
Address – Hadapsar, Pune
Email – bandewarrahul@gmail.com
Phone – 9604367453 / 9420456733
LinkedIn -
linkedin.com/in/rahul-bandewar-
5a988a102
Project Details
Consultant – Data Engineer, IBM (December’20 – Present)
Project: Data Enablement and Open Banking platform ( BEN )
Role: Data Engineer
Assignment: Data Enablement for Product and Pricing module by serving the data need of pricing
computation component, building streaming and batched pipeline with AWS cloud.
Activities:
• Participated in the detailed design discussion, developing the base framework to deal with
common functionality required for the different portfolio.
• Worked on building multiple batch and streaming pipeline using the Spark.
• Followed the test-driven approach, and software engineering practices.
• Deploying and supporting application at different environment
Technology stack: AWS EMR, S3, RDS, Confluent Kafka, PySpark(structure streaming), Boto3
Consultant – Data Engineer, Core Compete (September’19 – Present)
Project: SaaS analytics platform for retail promotions (AEO - Experiment)
Role: Data Engineer
Assignment: To build SaaS analytical platform to test the retail promotions and product launch
across its retail stores. It involved creating batched pipelines to serve purpose of the data science
requirement using GCP data services.
Activities:
• Involved in designing data pipeline, and data warehouse schema, based on querying patterns and
requirements of the analytics team, to minimize data movement for online analytics on the GCP
cloud.
• Develop a configurable, client agnostic warehouse schema and data processing framework with
microservice architecture.
• Developed a scalable, config-driven object-oriented framework for ETL by creating wrappers
around APIs of services like BigQuery, PubSub, GCS.
• Orchestrated pipeline with Airflow to performed scheduled data loads.
• Followed the test-driven approach, and software engineering practices.
Technology stack: BiqQuery, Pubsub, GCS, Python, PyTest.
Data Engineer, Atos Global IT (March’17 – August’19)
Project: ENEL Next Platform (Migrating traditional ETL pipelines into CDH)
Role: Data Engineer
Assignments: Migrated traditional ETL process into cloud-based Cloudera platform which involved
building batched pipelines migrating data from Oracle DB to HBase data store.
Activities:
• Developed transformation layer which involves validation and conversion over data using Spark.
• Preparing System Test Cases.
Technology stack: Cloudera CDH, Spark, Scala, Flat Spec
Project: Codex iFabric (predictive maintenance SaaS platform for windmills)
Role: Data Engineer
Assignments: SaaS solution which will notify the predictive maintenance measure for the windmills
deployed across the globe based on real time streaming feeds from the sensors. Streaming pipeline
was built with azure services.
Activities:
• Involved in the planning, design, and development of batched and near real-time services using
Azure.
• Developed the batched pipeline to support data & analytics capabilities using azure services like
ADF, HDInsight, Blob Storage.
• Developed the near real-time data pipeline using capabilities of azure like event hub, azure stream
analytics, and cosmos DB.
• The transformation layer was developed using HDInsight & azure stream analytics.
Technology stack: ADF, Azure stream analytics, Event hub, HDInsight, Cosmos DB, ADL
Project: Codex Fabric (PaaS cloud product)
Role: Software Developer
Assignments: Built cloud native scalable platform used by data engineer and data scientist for
analytical purposes. Platform was compatible to AWS, Azure and tai cloud.
Activities:
• Involved in implementing security over the cloud environment by developing the effector-based
enhancement to support data encryption at rest and malware protection.
• Implementing private cloud infrastructure using open stack.
• Involved in technical support cycle.
Technology stack: bash scripting, core java, AWS, Azure, TAI cloud