Lead innovative data engineering initiatives at the Ministry of Public and Business Service Delivery. This senior DataOps position focuses on cloud solutions and data manipulation using cutting-edge tools.
The Ministry of Public and Business Service Delivery is looking for a Senior DataOps Engineer for a contract from June 1, 2026, to October 5, 2027. This role requires extensive knowledge in data engineering, particularly with pandas and pyspark, along with experience in managing data with AWS services like Glue and S3. You'll be responsible for designing data lakehouse architectures and transforming various data formats into usable structures.
Key Responsibilities:
• Design data lakehouse architectures with Databricks
• Transform data from XLSX, CSV, and JSON into usable formats
• Manage data pipelines leveraging AWS S3 and Glue
• Execute ETL processes using Informatica IDMC
Requirements:
• Proficiency in data engineering, particularly with pandas and pyspark<...