About the Role

Experience: 6+yrs

Work Location: Bangalore/Hyderabad

Mode of Work: Hybrid

Responsibilities

• Design, develop, and maintain data pipelines using Apache Airflow (including Managed Workflows for Apache Airflow - MWAA).
• Build and orchestrate data workflows and jobs in Databricks (Delta Lake, Jobs, Workflows).
• Develop robust Python scripts for data extraction, transformation, validation, and loading.
• Write and optimize advanced SQL queries (PostgreSQL, Azure SQL) for large-scale datasets.
• Implement and manage production-grade data pipelines for batch, incremental, and near-real-time processing.
• Design and optimize AWS Redshift schemas and manage data solutions using AWS services such as RDS, Redshift, Glue, and IAM.
• Ensure efficient data.

Qualifica...