Job Description - Data Engineer

Our Data Engineers are skilled in creating data pipelines for ingest, transformation and
storage of data usually at scale, and are familiar with standing-up analytics clusters.

Experience and skills you’d need

 Experience working on data pipelines, platforms and projects
 Working in one or more of the main Cloud providers (AWS, GCP, Azure)
 Experience in developing solutions in some of SQL (+ variants), Python, Scala, Java
 Working with a variety of RDBMS databases, ideally in production environments
 Creation and support of highly available data pipelines:
- Using ETL platforms and/or coded equivalents
- Using scheduling tools and/or familiarity with working in streaming
environments
- Ensuring reliability and availability
 Working with other data storage and processing technologies including:
- Spark
- Document databases
- Graph databases
- Columnar databases
 Working with configuration control (Git/Github, Terraform, ansible etc.) and CI/CD
tools
 Understanding and being able to support data scientists or business intelligence
teams - in data prep, mentoring and support functions