About the Job
We are seeking a skilled Data Engineer to architect, build, and optimise scalable data platforms on cloud infrastructure. The role involves close collaboration with cross-functional teams to deliver robust, secure, and high-performance data solutions that support analytics and business operations.
Core Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines, data lakes, and data warehouse solutions.
- Build and optimize data ingestion frameworks for batch and real-time processing.
- Develop and deploy containerised applications using Docker, Amazon ECR, and Amazon ECS.
- Design and implement RESTful APIs for system integrations using modern frameworks (e.g., Fast API).
- Implement Infrastructure as Code (Ia C) using Terraform and AWS Cloud Formation.
- Establish and maintain CI/CD pipelines for automated build, test, and deployment workflows.
- Ensure adherence to data security, governance, and compliance standards (e.g., enc...