← Todos los empleosData Engineer - Informatica
Senior6500 SGD · periodo no indicadoSingapore, SGhoy
Detalles
- Experiencia
- 8+ años
- Prácticas
- CI/CD, DevOps
- Formación
- Máster
Postular
Abre la empresa y el enlace de arriba: tu candidatura va directamente al sistema de selección de la empresa, sin intermediarios.
Descripción
Postion Overiew
We are hiring a Data Engineer (2 years Direct Contract) for data migration projects (Primarily utilizing AWS, IDMC, Databricks and Tableau)
- Roles and responsibilities
- Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake
- Integrate Informatica IDMC for metadata management and data cataloging
- Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance
- Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica Power Center/IDMC for data transformation and quality
- Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica Power Center/IDMC for optimizing data workflows
- Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring compliance with data privacy regulations. Employ Informatica IDMC for data governance and compliance
- Implement automation for routine tasks, such as data ingestion, transformation, a
Descripción completa, empresa y enlace para postular: después de iniciar sesión.
Iniciar sesiónLos contactos del empleador (correo/teléfono/telegram) están ocultos en la vista previa pública.