Backend Engineer - Big Data

We are seeking a talented and motivated Software Developer to join our growing team. The ideal candidate will be an expert in object-oriented programming language, possess a strong aptitude for solving Bigdata problems, and have a passion for designing and developing sophisticated Bigdata solutions. As a key member of our development team, you will contribute to the creation of innovative software solutions in the data security domain.

Responsibilities:

• Develop high-quality software solutions using Java programming language
• Develop high-performance data pipelines for real-time and batch processing
• Collaborate with cross-functional teams to understand project requirements and translate them into technical specifications.
• Design and implement complex, scalable, and reliable systems that meet business requirements.
• Troubleshoot, debug, and optimize code to ensure performance and reliability.
• Stay up-to-date with the latest industry trends, tools, and technologies.
• Work closely with DevOps to deploy and maintain applications using Docker and Kubernetes.
• Utilize cloud platforms such as AWS to build, deploy, and scale applications.
• Integrate and utilize various cloud services to enhance system functionality.

Requirements:

• Energetic self-starter, with a desire to work in a startup environment
• Experience in Bigdata processing using any of Snowflake, Redshift, Spark, Flink, Iceberg, Kafka etc.
• Proficient in DSA and advanced Java/Python programming skills
• Expert in Application development cloud/on premise end to end. Middle layer, DB layer.
• Should have worked for cloud based applications, built on microservices based paradigms, achieving horizontal scaling.
• Good hands on and understanding of RMQ, Elasticsearch, SQL, NoSQL DB (e.g. mongoDB etc), K8s, Kafka streams, etc
• Good hands on in Complex Event Processing systems.
• Good to have solved scale and performance issues with respect to cloud applications
• Experience of debugging applications running on Unix like systems (e.g. Ubuntu, CentOS)
• Experience developing RESTful APIs for complex data sets
• Knowledge of container based development & deployment (e.g. Dockers, rkt)

Exposure to AWS, Google Cloud Platform, Microsoft Azure, etc.

• Expertise in software security domain, a plus