Data Engineer

Job Title: Data Engineer

Location: Bengaluru

Work Mode: Hybrid / Work from Office

Travel Requirement: Initial 4 weeks onboarding and collaboration from Hyderabad office

Experience: 4+ Years

Employment Type: Full-Time

About the Role

We are looking for a skilled Data Engineer with strong expertise in AWS, Python, PySpark, and SQL to design, develop, and optimize scalable data pipelines and data processing solutions. The ideal candidate will have experience working with large datasets, cloud-based data platforms, and modern data engineering practices.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines.
• Build and optimize data processing workflows using PySpark.
• Develop robust data solutions using Python and SQL.
• Work with AWS services to build cloud-native data platforms.
• Integrate data from multiple sources and ensure data quality and reliability.
• Optimize data storage, processing, and query performance.
• Collaborate with Data Scientists, Analysts, and Business Teams to understand data requirements.
• Implement data governance, security, and best practices.
• Troubleshoot and resolve data pipeline and performance issues.
• Participate in code reviews and contribute to continuous improvement initiatives.

Required Skills

• Strong experience in Python development.
• Hands-on experience with PySpark and distributed data processing.
• Advanced SQL skills for data extraction, transformation, and analysis.
• Experience with AWS cloud services such as S3, Glue, EMR, Lambda, Redshift, Athena, or similar.
• Strong understanding of ETL/ELT frameworks and data warehousing concepts.
• Experience working with large-scale structured and unstructured datasets.
• Knowledge of data modeling and performance tuning.

Preferred Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• Experience with data orchestration tools such as Airflow.
• Exposure to CI/CD and DevOps practices.
• Experience in Agile development environments.
• AWS certifications are an added advantage.

Candidate Profile

4+ years of Data Engineering experience

Strong expertise in AWS, Python, PySpark, and SQL

Experience building scalable data pipelines and cloud-based data solutions

Strong problem-solving and analytical skills

Willingness to work from Hyderabad office for the initial 4 weeks