Urgent requirement of Data Engineer - Contract - Sydney

Requirements

• Must have 5+ Years of experience
• Advanced proficiency in Python, including libraries such as Pandas, PySpark, and boto3
• Experience designing workflows in Apache Airflow (MWAA)
• Hands-on experience with Amazon Redshift for analytics and data warehousing
• Solid SQL skills and experience with data modeling and transformation
• Comfortable with Amazon S3, including setting up data lake architecture
• Familiar with AWS core services: EC2, S3, IAM, Lambda
• Experience using AWS Secrets Manager and AWS KMS for secure data access
• Knowledge of additional ETL/ELT tools like AWS Glue, AWS Athena
• Familiarity with DevOps practices and CI/CD pipelines
• Experience working in agile teams and data-focused environments
• Knowledge in ...