Kafka Admin

Primary Focus: Ensuring smooth day-to-day supporting the application development team, IT operations, system uptime, and user support.

Key Responsibilities:

1. Cluster Management: Installation, configuration, and upgrades of Kafka brokers, ZooKeeper nodes, and related infrastructure (e.g., Confluent Platform).
2. Monitoring & Alerting: Monitoring cluster health, including broker uptime, partition availability, replication lag, and resource usage (CPU, memory, disk) to prevent bottlenecks.
3. Topic & Partition Management: Creating, updating, and managing Kafka topics, partition strategies, and replication factors to ensure data redundancy.
4. Security Administration: Implementing security measures, including Authentication (SASL), Authorization (ACLs), and Encryption (TLS/SSL).
5. Performance Tuning: Optimizing Kafka cluster performance through configuration adjustments, JVM tuning, and resource management.
6. Troubleshooting & Support: Providing 24/7 support to diagnose and resolve production issues, such as broker failures, network issues, or producer/consumer lag.
7. Automation & Scripting: Using tools like Ansible, Terraform, or Bash/Python scripts to automate provisioning and operational tasks.
8. Backup & Disaster Recovery: Developing, validating, and maintaining backup techniques and roll-back strategies.

Qualifications

1. 5- 8 Years of total Experience,
2. Experience with Apache Kafka and Zookeeper in production environments.
3. Knowledge of Linux system administration.
4. Experience with cloud platforms (AWS/Azure) or containerization (Kubernetes, OpenShift).
5. Scripting skills (Bash, Python) for automation