← Toutes les offresData Engineer - Informatica
Senior6 500 SGD · période non indiquéeSingapore, SGaujourd'hui
Détails
- Expérience
- 8 ans et plus
- Pratiques
- CI/CD, DevOps
- Formation
- Master
Postuler
Ouvrez l'entreprise et le lien ci-dessus — votre candidature arrive directement dans le système de recrutement de l'entreprise, sans intermédiaire.
Description
Postion Overiew
We are hiring a Data Engineer (2 years Direct Contract) for data migration projects (Primarily utilizing AWS, IDMC, Databricks and Tableau)
- Roles and responsibilities
- Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake
- Integrate Informatica IDMC for metadata management and data cataloging
- Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance
- Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica Power Center/IDMC for data transformation and quality
- Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica Power Center/IDMC for optimizing data workflows
- Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring compliance with data privacy regulations. Employ Informatica IDMC for data governance and compliance
- Implement automation for routine tasks, such as data ingestion, transformation, a
Description complète, entreprise et lien pour postuler : après connexion.
Se connecterLes contacts de l'employeur (e-mail/téléphone/telegram) sont masqués dans l'aperçu public.