Responsibilities

• Provide technical recommendations and evaluate project feasibility and workloads.
• Design and implement efficient pipeline architectures for data ingestion, transformation, and storage.
• Develop modular, efficient code for data transformation and integration, ensuring adherence to modern development practices.
• Perform data ingestion from source systems, including ETL processes, when tables are not available on the data platform.
• Conduct regular pipeline maintenance and upgrades, troubleshooting and resolving issues to ensure optimal performance.
• Implement data quality testing and validation to maintain high standards of data integrity and reliability.
• Collaborate closely with other data engineers, data modelers, data stewards, BI developers, data scientists, and subject matter experts to ensure seamless data integration, knowledge sharing, and delivery of impactful solutions.

Benefit...