← Alle StellenData Engineer - Informatica
Senior6.500 SGD · Zeitraum nicht angegebenSingapore, SGheute
Details
- Erfahrung
- ab 8 Jahren
- Methoden
- CI/CD, DevOps
- Ausbildung
- Master
Bewerben
Öffnen Sie oben das Unternehmen und den Link — Ihre Bewerbung geht direkt in das Recruiting-System des Unternehmens, ohne Vermittler.
Beschreibung
Postion Overiew
We are hiring a Data Engineer (2 years Direct Contract) for data migration projects (Primarily utilizing AWS, IDMC, Databricks and Tableau)
- Roles and responsibilities
- Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake
- Integrate Informatica IDMC for metadata management and data cataloging
- Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance
- Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica Power Center/IDMC for data transformation and quality
- Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica Power Center/IDMC for optimizing data workflows
- Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring compliance with data privacy regulations. Employ Informatica IDMC for data governance and compliance
- Implement automation for routine tasks, such as data ingestion, transformation, a
Vollständige Beschreibung, Unternehmen und Bewerbungslink — nach der Anmeldung.
AnmeldenKontaktdaten des Arbeitgebers (E-Mail/Telefon/Telegram) sind in der öffentlichen Vorschau ausgeblendet.