Job Description
Insight Global is seeking a Senior Data Warehouse Modernization Developer to support a long term federal data modernization initiative. These engineers focus on modernizing data warehouse pipeline architecture by gradually reducing reliance on SSIS and SQL-only patterns, introducing Python based ETL, improving modularity, and setting the groundwork for a future move into PySpark, distributed compute, and eventually Databricks or similar cloud platforms. They should have an in depth understanding of the Kimball model in place, and experience incrementally replacing or re platforming components. Responsibilities include:
- Learn and understand the existing Kimball-modeled SQL Server structure over time.
- Reverse-engineer SSIS packages and convert them into Python-based modular ETL pipelines.
- Build reusable Python frameworks for extraction, transformation, and loading.
- Begin introducing PySpark for scalable transformation patterns.
- Contribute to pl...