Job Summary:
We are seeking a highly skilled Kafka Administrator with over 6 years of experience in Cloudera CDP Kafka Administration. The ideal candidate will have proven experience with Apache Kafka in a production environment and strong knowledge of Kafka architecture, including brokers, topics, partitions, and replication. This role requires expertise in designing, implementing, maintaining, and optimizing Kafka-based messaging systems.
Key Responsibilities:
- Design and implement Kafka-based messaging systems to support real-time data streaming and processing.
- Deploy Kafka producers and consumers for various data sources and sinks.
System Maintenance and Optimization:
- Troubleshoot and resolve issues related to Kafka brokers, topics, and data flow.
- Optimize Kafka configurations for performance, scalability, and fault tolerance.
- Monitor Kafka clusters to ensure optimal performance and availability.
Integration and Development:
- Integrate Kafka with other data systems such as databases, data lakes, and big data platforms.
- Develop and maintain data pipelines using Kafka Streams, Kafka Connect, or other related technologies.
Collaboration and Support:
- Work closely with data engineers, software developers, and system administrators to ensure seamless integration of Kafka with applications.
- Provide technical support and guidance to teams using Kafka for data streaming.
Documentation and Best Practices:
- Document Kafka architecture, configurations, and processes.
- Promote and enforce best practices for Kafka usage and data streaming.
Required Qualifications:
- Over 6 years of experience in Cloudera CDP Kafka Administration.
- Proven experience with Apache Kafka in a production environment.
- Strong understanding of Kafka architecture, including brokers, topics, partitions, and replication.
- Experience with Kafka Streams, Kafka Connect, and schema registries is highly desirable.
- Knowledge of distributed systems and data streaming principles.
- Ability to create Topics as per the requirements.
Preferred Skills:
- Strong problem-solving and troubleshooting skills.
- Excellent verbal and written communication skills.
- Ability to work independently and as part of a team.
- Experience in managing large-scale Kafka deployments.
If you are a Kafka expert with a passion for data streaming and a proven track record in Kafka administration, we encourage you to apply for this exciting opportunity.