Big Data Engineer/Data Engineer

What we are solving

Welcome to today’s business data world where:

• Unification of all customer data into one platform is a challenge

• Extraction is expensive
• Business users do not have the time/skill to write queries
• High dependency on tech team for written queries

These facts may look scary but there are solutions with real-time self-serve analytics:

• Fully automated data integration from any kind of a data source into a universal
schema
• Analytics database that streamlines data indexing, query and analysis into a single
platform.
• Start generating value from Day 1 through deep dives, root cause analysis and
micro segmentation

At Propellor.ai, this is what we do.

• We help our clients reduce effort and increase effectiveness quickly

• By clearly defining the scope of Projects
• Using Dependable, scalable, future proof technology solution like Big Data
Solutions and Cloud Platforms
• Engaging with Data Scientists and Data Engineers to provide End to End Solutions
leading to industrialisation of Data Science Model Development and Deployment

What we have achieved so far

Since we started in 2016,

• We have worked across 9 countries with 25+ global brands and 75+ projects
• We have 50+ clients, 100+ Data Sources and 20TB+ data processed daily

Work culture at Propellor.ai

We are a small, remote team that believes in

• Working with a few, but only with highest quality team members who want to
become the very best in their fields.
• With each member's belief and faith in what we are solving, we collectively see
the Big Picture
• No hierarchy leads us to believe in reaching the decision maker without any
hesitation so that our actions can have fruitful and aligned outcomes.
• Each one is a CEO of their domain. So, the criteria while making a choice is so
our employees and clients can succeed together!
 About the role

We are building an exceptional team of Data engineers who are passionate developers
and wants to push the boundaries to solve complex business problems using the latest
tech stack. As a Big Data Engineer, you will work with various Technology and Business
teams to deliver our Data Engineering offerings to our clients across the globe.

Role Description

• The role would involve big data pre-processing & reporting workflows including
collecting, parsing, managing, analysing, and visualizing large sets of data to turn
information into business insights
• Develop the software and systems needed for end-to-end execution on large projects
• Work across all phases of SDLC, and use Software Engineering principles to build scalable
solutions
• Build the knowledge base required to deliver increasingly complex technology projects
• The role would also involve testing various machine learning models on Big Data and
deploying learned models for ongoing scoring and prediction.

Education & Experience

• B.Tech. or Equivalent degree in CS/CE/IT/ECE/EEE

3+ years of experience designing technological solutions to complex data problems,

developing & testing modular, reusable, efficient and scalable code to implement those
solutions.

Must have (hands-on) experience

• Python and PySpark expertise

• Distributed computing frameworks (Hadoop Ecosystem & Spark components)
• Must be proficient in any Cloud computing platforms (AWS/Azure/GCP)
• Experience in in any cloud platform would be preferred - GCP (Big Query/Bigtable, Pub
sub, Data Flow, App engine )/ AWS/ Azure
• Linux environment, SQL and Shell scripting Desirable
• Statistical or machine learning DSL like R
• Distributed and low latency (streaming) application architecture
• Row store distributed DBMSs such as Cassandra, CouchDB, MongoDB, etc.
• Familiarity with API design

Hiring Process:

1. One phone screening round to gauge your interest and knowledge of fundamentals
2. An assignment to test your skills and ability to come up with solutions in a certain time
3. Interview 1 with our Data Engineer lead
4. Final Interview with our Data Engineer Lead and the Business Tine architect