Pyspark Developer

TCS

6 - 8 years

Hyderabad

Posted: 02/05/2025

Job Description

Job Description

Analyze existing Teradata tables and Data Warehouse structures.

Design and implement a strategy to migrate data from Teradata to Spark 3.x and Delta Lake.

Develop PySpark scripts to extract, transform, and load (ETL) data from Teradata to Delta Lake.

Optimize and refactor existing SQL queries and ETL processes for performance in Spark.

Collaborate with data engineers, database administrators, and business stakeholders to ensure data accuracy and integrity.

Location
Hyderabad
Job Function
TECHNOLOGY
Role
Engineer
Job Id
359681
Desired Skills
Spark
Desired Candidate Profile
Qualifications : BACHELOR OF ENGINEERING

About Company

Tata Consultancy Services (TCS) is one of the largest multinational IT services and consulting companies in the world, headquartered in Mumbai, India. It operates in over 50 countries and is a part of the Tata Group, India's largest business conglomerate. TCS offers a wide range of services including software development, consulting, digital transformation, and business solutions, serving industries such as finance, healthcare, retail, and telecommunications. Known for its global reach, technological expertise, and innovation, TCS is consistently ranked among the top IT services companies globally.

Services you might be interested in

One-Shot Campaign

Reach out to ideal employees in one shot!

The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).