Elevate your career as a Senior Azure Databricks Engineer focused on designing scalable data pipelines on Azure. Your expertise is crucial for developing advanced analytics solutions in this role.
We are looking for an experienced Azure Databricks Engineer with 10+ years in the field. You will leverage your skills in Azure Data Factory and big data processing to create and manage data pipelines that ensure data quality and performance. Collaboration with data scientists and analysts is essential as you develop innovative data solutions.
Key Responsibilities:
• Design scalable data pipelines using Azure Data Factory
• Develop and optimize workflows with Azure Databricks (PySpark/Scala)
• Implement ETL/ELT processes for large dataset management
• Integrate data from APIs, databases, and data lakes
• Monitor and troubleshoot pipeline performance issues
Requirements:
• Bachelor’s degree in Computer Science or related field
• 10+ years of Azure data engineering...