Responsibilities
The Hadoop EBP Engineer is responsible for designing, developing, and managing large-scale data processing systems using Hadoop and related big data technologies. The role focuses on building and maintaining enterprise-grade data platforms that support analytics, reporting, and data-driven decision-making.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Hadoop ecosystem tools. Manage and optimize Hadoop clusters (HDFS, YARN, MapReduce) in enterprise environments. Develop ETL workflows to ingest, process, and transform large datasets. Work with tools such as Hive, Spark, Sqoop, Kafka, and HBase for data processing. Ensure data reliability, availability, and security across the platform. Monitor and troubleshoot performance issues in big data systems. Collaborate with data scientists, analysts, and business stakeholders to support analytics use cases. Implement data governance, data quality, and compliance standards. Automate and...