Technology stack
Azure Databricks, Microsoft Azure, Apache Spark, PySpark, Spark SQL, Python, SQL, Azure Data Factory, Azure Data Lake Storage Gen2, Delta Lake, Lakehouse architecture, Git
Client
- […]'s client is a London-based international investor that operates in the private equity market.
- Project overview
- The Data Platform project focuses on delivering cloud based data engineering solutions in the Microsoft Azure ecosystem. You will work with Databricks, Spark, and Azure services to build and optimize reliable data pipelines and support modern Lakehouse architecture.
Team
- Small team (1-10 people)
- […]'s team in this project consists of 8 people who constantly interact with the technical team on the client side which consists of 20+ technical specialists. The work is SCRUM-based with weekly sprints.
- Position overview
- We are looking for a Strong Middle / Senior Databricks Developer with Azure to build scalable data platforms, develop complex data pipelines, and support cloud based data engineering solutions.
Responsabilità
Responsibilities
Design data solutions using Databricks
Develop data pipelines for structured and unstructured data
Build ETL and ELT workflows in Azure
Develop high performance solutions using PySpark and Spark SQL
Design Lakehouse architectures using Delta Lake
Integrate data from databases APIs cloud services and streaming platforms
Optimize Spark workloads for performance scalability and cost efficiency
Ensure data quality governance security and monit
I contatti del datore di lavoro (email/telefono/telegram) sono nascosti nell'anteprima pubblica.