Responsabilities:As part of the Data Engineering team, you will be responsible for design, development and operations of large-scale data systems operating at petabytes scale.
You will be focusing on real-tiime data pipelines, streaming analytics, distributed big data and machine learning infrastructure.
You will interact with the engineers, product managers, BI developers and architects to provide scalable robust technical solutions.Experience:
5+ years of Big Data development experience
Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development
Experience in agile models
Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built
Experience with Java, Python to write data pipelines and data processing layers
Experience in Airflow & Github
English conversational
Experience in writing map-re...