Job Description:

The primary role of the Sr Data Engineer is to serve as a critical member of a data team, designing data integration solutions that deliver business value aligned with the company’s objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/PySpark and AWS tools.



Responsibilities:

• Provide scoping, estimating, planning, design, development, and support services to a project.


• Identify and develop the technical detail design document.


• Work with developers and business areas to design, configure, deploy, and maintain custom ETL Infrastructure to support project initiatives.


• Design and develop data/batch processing, data manipulation, data mining, and data extraction/transformation/loading (ETL Pipelines) into large data ...