About Position:
We are seeking experience Data Engineer responsible for building, optimizing, and operating reliable data pipelines using Stream Sets, Azure Data Factory, and SQL across batch and near real-time workloads.
Role: Data Engineer
Location: Pune
Experience: 5 to 7 years
Job Type: Full Time Employment
What You'll Do:
Design, build, and maintain scalable data ingestion and transformation pipelines using Stream Sets (DC/TF) and Azure Data Factory (pipelines, datasets, linked services, triggers).
Implement robust ETL/ELT logic using SQL, including window functions, CTEs, query optimization, and indexing/partitioning strategies.
Develop reusable pipeline components with strong error handling, checkpointing, monitoring, and alerting to ensure reliability and observability.
Integrate data pipelines with key Azure services such as ADLS Gen2, Azure SQL/Managed Instance, Key Vault, and Azure Dev Ops.
Ensure data quality and governance through validatio...