Job Summary
We are seeking a skilled Developer with 4 to 8 years of experience in Apache Hadoop and Kafka Admin. The ideal candidate will contribute to our projects by leveraging their technical expertise in a hybrid work model. This role involves working during the day shift with no travel requirements.
Responsibilities
- Develop and maintain scalable data processing systems using Apache Hadoop.
- Administer and manage Kafka clusters to ensure high availability and performance.
- Collaborate with cross-functional teams to design and implement data solutions.
- Monitor and troubleshoot Hadoop and Kafka environments to ensure optimal performance.
- Provide technical support and guidance to team members on Hadoop and Kafka-related issues.
- Implement best practices for data security and compliance within the Hadoop and Kafka ecosystems.
- Optimize data workflows and pipelines for efficiency and reliability.
- Conduct regular performance tuning and capacity planning for Hadoop and Kafka systems.
- Create and maintain documentation for data processing systems and procedures.
- Participate in code reviews and contribute to the continuous improvement of development processes.
- Stay updated with the latest industry trends and technologies related to Hadoop and Kafka.
- Ensure data integrity and consistency across all data processing systems.
- Collaborate with stakeholders to gather requirements and deliver data solutions that meet business needs.
Qualifications
- Possess strong experience in Apache Hadoop and Kafka administration.
- Demonstrate proficiency in managing and optimizing Kafka clusters.
- Have a solid understanding of data processing and ETL workflows.
- Show expertise in troubleshooting and resolving issues in Hadoop and Kafka environments.
- Exhibit knowledge of data security and compliance best practices.
- Have experience in performance tuning and capacity planning for data systems.
- Display excellent communication and collaboration skills.
- Be able to work independently and as part of a team.
- Show a proactive approach to problem-solving and continuous improvement.
- Have a strong attention to detail and commitment to quality.
- Demonstrate the ability to document technical processes and procedures effectively.
- Stay current with industry trends and advancements in data technologies.
- Possess a bachelors degree in Computer Science Information Technology or a related field.
Certifications Required
Certified Apache Hadoop Developer Confluent Certified Developer for Apache Kafka