PySpark Developer
TCS
4 - 15 years
Bengaluru
Posted: 13/05/2026
Job Description
Key Responsibilities:
- Design, develop, and maintain data processing pipelines using PySpark
- Implement ETL workflows to ingest, transform, and load large datasets
- Optimize Spark jobs for performance, scalability, and reliability
- Work with structured and unstructured data from multiple sources (HDFS, S3, RDBMS, APIs, streaming sources)
- Collaborate with data engineers, analysts, and data scientists
- Ensure data quality, validation, and consistency
- Perform debugging, profiling, and tuning of Spark applications
- Write clean, reusable, and well-documented code
- Support production deployments and troubleshooting
- Follow best practices in data engineering, security, and governance
Required Skills & Qualifications:
- Strong experience with PySpark and Apache Spark
- Proficient in Python
- Experience with SQL and relational databases
- Solid understanding of Spark architecture (RDDs, DataFrames, Spark SQL, DAGs)
- Hands-on experience with big data ecosystems (Hadoop, Hive, HDFS)
- Experience with cloud platforms (AWS / Azure / GCP) and object storage
- Knowledge of data modeling, ETL concepts, and pipeline design
- Familiarity with version control tools (Git)
- Understanding of Linux/Unix environments
About Company
Tata Consultancy Services (TCS) is one of the largest multinational IT services and consulting companies in the world, headquartered in Mumbai, India. It operates in over 50 countries and is a part of the Tata Group, India's largest business conglomerate. TCS offers a wide range of services including software development, consulting, digital transformation, and business solutions, serving industries such as finance, healthcare, retail, and telecommunications. Known for its global reach, technological expertise, and innovation, TCS is consistently ranked among the top IT services companies globally.
Services you might be interested in
Improve Your Resume Today
Boost your chances with professional resume services!
Get expert-reviewed, ATS-optimized resumes tailored for your experience level. Start your journey now.
