Data Engineer

Position Connectivity & Data Engineer

Experience - 5 to 7 Years

Company - German MNC Product Based

Location - Chhatrapati Sambhajinagar

Work Mode - Office ( 5 Days Working )

Notice Period : Immediate Joiner

Job Type - Permanent Role on Direct Payroll of German MNC

Contact For More Details : omkar@agile-tech.in

We are looking for a skilled Data Engineer with strong expertise in AWS, Python, PySpark, Databricks, and AWS Glue to design, build, and maintain scalable data solutions. The candidate will work on integrating data from OT, IoT, and IT systems, creating reliable pipelines, and enabling analytics, reporting, and digital transformation initiatives.

Key Responsibilities:

• Design, develop, and optimize scalable data pipelines for structured and unstructured data sources.
• Build ETL / ELT workflows using AWS Glue, PySpark, Python, and Databricks.
• Develop batch and real-time data ingestion frameworks using AWS services.
• Integrate data from OT, IoT, ERP, CRM, and enterprise applications.
• Ensure data quality, consistency, governance, and security across pipelines.
• Work with AWS S3, Redshift, Lambda, Athena, RDS, IAM, CloudWatch and related cloud services.
• Create reusable data models, APIs, and standardized interfaces.
• Support analytics, dashboards, BI reporting, AI/ML, and Digital Twin use cases.
• Monitor pipeline performance and troubleshoot production issues.
• Collaborate with Cloud Architects, BI Analysts, Developers, and Business teams for end-to-end delivery.
• Maintain technical documentation and follow best coding practices.

Required Skills:

• Strong experience in AWS Cloud Platform
• Hands-on expertise in Python programming
• Strong knowledge of PySpark and Spark optimization
• Experience with Databricks platform
• Expertise in AWS Glue for ETL development
• Knowledge of SQL and data warehousing concepts
• Experience with APIs, JSON, CSV, Parquet, Delta Lake
• Understanding of CI/CD, Git, DevOps practices

Soft Skills / Communication:

• Good verbal and written communication skills
• Ability to interact with cross-functional global teams
• Strong analytical and problem-solving skills
• Ability to explain technical solutions clearly to business stakeholders
• Self-driven with ownership mindset