Job Title: Data Engineer (PySpark)

Location: [Location] - Pune

Job Type: Full time

Job Summary:

We are looking for a talented and experienced Data Engineer to join our team. The ideal

candidate will have expertise in Python, PySpark, SQL, Mongo DB, Shell Scripting, Linux, and

Pandas, and will be responsible for designing, building, and maintaining scalable data

pipelines and infrastructure.

Specifically we are looking for immediate joiners and people should be local to Pune.

Bachelor's or Master's degree in Computer Science, Information Technology, or a related

field.

3+ years of experience in data engineering or a similar role.

Design, develop, and maintain robust and scalable data pipelines using Python, PySpark,

and SQL for data ingestion, processing, and storage.

Ability to manage large data sets with tens of millions of records while achieving fast

performance using Spark

Knowledge on latest trends in data engineering space such as druid, elastic search, etc

Knowledge in big data technologies such as Hadoop, Hive, etc

Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and various cloud

services.

Experience on scheduling/orchestration tools

Excellent problem-solving skills and attention to detail.

Strong understanding of ETL processes and tools.

Experience with shell scripting and Linux for automation and server management.

Knowledge of data modeling, data architecture, and data warehousing concepts.

Strong communication and collaboration skills.

Ability to work independently and as part of a team.

Experience on AI/ML/LLM is a plus

Preferred Qualifications:

Certification in cloud platforms (e.g., AWS Certified Data Analytics, Google Cloud

Professional Data Engineer).

Senior Data Engineer