Key responsibilities:
- Support and monitor weekend batch loads, ensuring timely and accurate execution
- Perform outlier detection and root cause analysis for issues such as demand forecast drops or anomalies
- Translate findings into clear insights and communicate them effectively to leads and stakeholders
- Monitor scheduled jobs and data pipelines to ensure successful execution
- Validate dashboard outputs and analyze data trends, anomalies, and inconsistencies
- Support basic model validation and output analysis (e.g., forecast vs actuals, error trends)
- Write and optimize SQL queries and Py Spark transformations for debugging and analysis
- Identify patterns in recurring failures and recommend improvements
- Work with data science and engineering teams to debug model or data-related issues
- Escalate issues when required, with clear analysis and supporting insights
- Monitor workflows in Azure Data Factory (ADF) and Databricks
- Contribute to ...