Pyspark

TCS has been a great pioneer in feeding the fire of Young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.

TCS Hiring for Pyspark

Experience Range: 04 To 07 Yrs

Job Locations : Chennai/Hyderabad/Kolkata

Job Description:

46 years of total experience in data engineering or big data development.

23 years hands-on experience with Apache Spark.

Strong programming skills in PySpark, Python, and Scala.

2+ years of experience in Scala backend development.

Proficient in Scala, both object oriented and functional programming concepts.

Deep understanding and application of advanced functional programming concepts like category theory, monads, applicatives, and type classes.

Hands-On knowledge with Scala Typelevel libraries like Cats, Shapeless, and others used for building applications with strong typing and efficient concurrency.

Solid understanding of data lakes, lakehouses, and Delta Lake concepts.

Experience in SQL development and performance tuning. Proficient in cloud services (e.g. S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM).

Familiarity with Airflow, dbt, or similar orchestration tools is a plus.

Experience in CI/CD tools like Jenkins, GitHub Actions, or Code Pipeline.

Knowledge of data security, governance, and compliance frameworks.