Join […]’s data transformation program and help us build reliable and scalable solutions on our GCP data platform.
You will work on reusable data processing frameworks, ingestion pipelines, automation and platform capabilities supporting data and AI use cases. You will also develop technical FinOps solutions that improve cost transparency and help engineering teams optimise platform usage. Cooperate with modern cloud technologies and make a real impact on the reliability, efficiency and future development of our data platform.
Develop reusable data processing and testing solutions on GCP using BigQuery, Cloud Storage, Dataflow/Dataproc and Cloud Composer.
Build and maintain batch and streaming data pipelines integrating databases, Kafka/MQ, APIs and files.
Implement automated testing, data quality checks, monitoring and security controls.
Develop and manage cloud infrastructure using Terraform and CI/CD.
Collaborate with analysts, data scientists and engineering teams to deliver reliable and well-documented data solutions.
Monitor, troubleshoot and optimise data pipelines for performance, scalability, reliability and cost.
Develop technical FinOps capabilities, including GCP billing data integration, cost allocation, monitoring and anomaly detection.
Cooperate with an external provider delivering the initial FinOps