This job is in your area. Enjoy a short commute and work close to home.
Job Description
Description
We are seeking a Senior Data Engineer (Databricks) to design, operate, and continuously improve our SAP data replication platform. The platform streams change data from SAP S/4HANA / ECC sources into downstream like Databricks. This is used across analytics, finance, supply chain, and operations. You will own end-to-end pipeline engineering roadmap.
Key Responsibilities
Pipeline Engineering
Design, build, and continuously improve pipelines from SAP to downstream
Develop and continuously improve on Kafka / Confluent topics, connectors, schemas (Avro / Schema Registry), and stream-processing jobs.
Build automation for deployment, validation, refresh, and reconciliation.
Tune capture and integrate jobs for throughput, lag, and resource efficiency.
Platform & DevOps
Deploy and manage Kafka and HVR components on AKS / Kubernetes and Azure in...