Sr Data Engineer - Apache DolphinScheduler - Chennai
Photon
2 - 5 years
Chennai
Posted: 13/08/2025
Job Description
Key Responsibilities:
- Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation.
- Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions.
- Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler.
- Integrate DolphinScheduler with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka.
- Work closely with data engineers, DevOps, and software teams to enhance workflow automation.
- Develop custom plugins and extensions for DolphinScheduler as needed.
- Monitor and optimize job execution, resource allocation, and workflow efficiency.
- Maintain best practices for CI/CD, version control, and infrastructure automation.
Required Skills & Qualifications:
- Strong experience with Apache DolphinScheduler in a production environment.
- Proficiency in Java, Python, or Scala for workflow scripting and automation.
- Experience with big data technologies like Hadoop, Spark, Hive, Flink, and Kafka.
- Understanding of workflow orchestration, DAG execution, and scheduling strategies.
- Strong problem-solving skills and ability to work in a fast-paced environment.
About Company
Photon is a global digital consulting and technology services company specializing in digital transformation, customer experience, and enterprise modernization. Headquartered in Dallas, Texas, Photon works with Fortune 100 companies to deliver solutions in areas like omnichannel commerce, mobile and web applications, cloud adoption, AI, and data analytics. The company focuses on creating seamless digital experiences by integrating design, technology, and strategy to help businesses engage customers and improve operational efficiency.
Services you might be interested in
One-Shot Campaign
Reach out to ideal employees in one shot!
The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).