Overview

Perform admin functions related to setting up a Kafka cluster, migrating clusters, and monitoring activities with the support team. Handle the hands‑on monitoring tools Confluent Control Centre and Cloudera Manager. Deploy and manage Confluent Kafka, investigate performance issues and streams‑based application problems. Orchestrate containers using Kubernetes and Docker. Use infrastructure‑as‑code tools such as Terraform, Concourse, and Veracode. Monitor and graph services with Prometheus, Grafana, and Splunk. Maintain clusters across all environments, adding and removing nodes on production clusters and rebalancing. Set up DevOps pipelines with CI/CD for Kafka, Ansible deployments, Azure Databricks, on‑premises Hadoop and Spark, and all data pipelines.

Responsibilities

• Support and adhere to standards to make environments like production.
• Set up disaster recovery and run regular failover drills on the cluster.
• Develop prere...