Data Engineer - Redshift, Pyspark, Glue

Data Engineer - Redshift, Pyspark, Glue

Greetings from TCS!!!

TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and theres nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project.

Make sure you have a valid EP number before interview.

To create an EP Number, please visit https://ibegin.tcs.com/iBegin/register

Kindly complete the registration if you have not done it yet.

Position: Data Engineer - Redshift, Pyspark, Glue

Experience: 5 to 10 years

Location: Chennai / Pune/Banglore/Indore

JOB DESCRIPTION

Desired Competencies (Technical/Behavioral Competency)

Must-Have

• Strong hands-on experience in Python programming and PySpark
• Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda)
• Experience working with Apache Spark and Hadoop ecosystem.
• Experience in writing and optimizing SQL for data manipulations
• Good Exposure to scheduling tools. Airflow is preferable.
• Must Have Data Warehouse Experience with AWS Redshift or Hive
• Experience in implementing security measures for data protection.
• Expertise to build/test complex data pipelines for ETL processes (batch and near real time)
• Readable documentation of all the components being developed.
• Knowledge of Database technologies for OLTP and OLAP workloads

Good-to-Have

• Good understanding of Data warehouse and Data Lakes
• Familiarize ETL tools like Netezza or Informatica.
• Experience working with NoSQL databases like DynamoDB or MongoDB.
• Good to have exposure to AWS services (Step Functions, Athena)
• Data Modelling exposure
• Familiarity with Investment Banking domain

Responsibility of / Expectations from the Role

1 Create and maintain optimal data pipeline architecture for efficient and reliable data processing.

2 Assemble large, complex data sets that meet functional / non-functional business requirements.

3 Database management, ETL process, Data modelling, ensuring data quality and integrity.

4 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

5 Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

TCS Eligibility Criteria: *BE/B.tech/MCA/M.Sc./MS with minimum 3 years of relevant IT-experience post

Qualification. *Only Full-Time courses would be considered.

*Candidates who have attended TCS interview in the last 1 months need not apply.

Referrals are always welcome!!!

Kindly don't apply if already attended interview in last 1 months.

Thanks & Regards

• Amrutha