Big Data Specialist

Company Description

SE-Mentor Solutions is a software engineering company specializing in DevOps implementation, Data Engineering, and Software Test Automation. With extensive experience across industries, we enable clients to optimize their software engineering practices and drive successful outcomes. We cater to leading software companies, government organizations, and educational institutions. Our expertise spans various sectors, including Telecom, E-commerce, Banking, Education, and Airlines, addressing challenges in web, cloud, mobile, IoT, and platform-based applications.

Role Description

This is a full-time on-site role for a Big Data Specialist with 5+Y experience,located in Cochin, . The Big Data Specialist will be responsible for designing, developing, and implementing Big Data solutions. Responsibilities include executing Extract, Transform, Load (ETL) processes, managing data warehousing activities, and performing data mining to extract insights. The role also involves collaborating with cross-functional teams in software development and ensuring the effective handling of large-scale data.

Key Skills Required:

• Strong experience inPySparkandSpark SQL
• Hands-on experience withAzure Data Factory (ADF)
• Expertise inAzure Databricks
• Experience withAzure Data Lake Storage (ADLS Gen2)
• Good knowledge ofAzure Synapse Analytics
• Strong proficiency inPython and SQL
• Experience in ETL/ELT pipeline development
• Knowledge of CI/CD and DataOps practices is an added advantage