Enhance data management as a Data Engineer focusing on cloud technologies and data lakehouse solutions. Your expertise in AWS and data transformation will drive actionable results.
In this role, you will design and build powerful data pipelines, integrating diverse data sources and formats. Using your skills with AWS services like S3 and Glue, you will ensure data is efficiently managed and transformed with tools such as Informatica IDMC. Troubleshooting and optimizing these data processes will be key to your success.
Key Responsibilities:
• Create data pipelines with Databricks and Azure
• Handle both structured and unstructured data
• Optimize workflows for data extraction and transformation
• Collaborate using AWS services like Lambda
• Implement data modeling and storage solutions
Requirements:
• Experience with Databricks and Delta Lake solutions
• Proficiency in AWS, including Glue and StepFunctions
• Familiarity with data file formats: XLSX, CSV,...