Data Engineer

Job Title - Data Engineer with Pyspark

Location -Pune/ Indore

Experience- 5-8 Years

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark
• Process large volumes of structured and semi-structured data
• Optimize Spark jobs for performance, scalability, and reliability
• Develop batch and streaming data processing solutions
• Integrate data from databases, APIs, files, and event streams
• Collaborate with analytics and data science teams
• Prepare technical documentation and participate in code reviews

Required Skills & Qualifications

• Strong hands-on experience with PySpark
• Proficiency in Python programming
• Strong understanding of Apache Spark architecture
• Advanced SQL skills
• Experience with ETL / ELT frameworks
• Hands-on experience with big data technologies

Good to Have Skills

• Databricks platform experience
• Apache Kafka or other streaming technologies
• Airflow or similar workflow orchestration tools
• CI/CD pipelines for data engineering
• Knowledge of data modeling and data warehousing
• Exposure to cloud data platforms such as Snowflake