Pyspark

Cognizant

9 - 11 years

Chennai

Posted: 4/18/2025

Job Description



Job Summary

We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role is based in our office and operates during day shifts. The candidate will play a crucial role in developing and optimizing data solutions to drive business success.


Responsibilities

  • Develop and maintain data solutions using Databricks SQL Databricks Delta Lake and Databricks Workflows.
  • Optimize and enhance existing data workflows to improve performance and efficiency.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
  • Implement data transformation and processing using PySpark to ensure data quality and integrity.
  • Provide technical guidance and support to junior developers and team members.
  • Conduct code reviews and ensure adherence to best practices and coding standards.
  • Troubleshoot and resolve issues related to data workflows and processing.
  • Monitor and maintain data pipelines to ensure smooth and reliable operation.
  • Participate in the design and architecture of data solutions to support business objectives.
  • Stay updated with the latest industry trends and technologies to continuously improve data solutions.
  • Document technical specifications and maintain comprehensive documentation for data solutions.
  • Ensure data security and compliance with relevant regulations and standards.
  • Collaborate with stakeholders to gather requirements and provide regular updates on project progress.

  • Qualifications

  • Possess strong expertise in Databricks SQL Databricks Delta Lake and Databricks Workflows.
  • Have extensive experience with PySpark for data transformation and processing.
  • Demonstrate excellent problem-solving skills and attention to detail.
  • Exhibit strong communication and collaboration skills to work effectively with cross-functional teams.
  • Show proficiency in optimizing and enhancing data workflows for performance and efficiency.
  • Have a solid understanding of data security and compliance requirements.
  • Display the ability to provide technical guidance and support to junior team members.
  • Maintain a proactive approach to staying updated with industry trends and technologies.
  • Possess strong documentation skills to maintain comprehensive technical specifications.
  • Demonstrate the ability to troubleshoot and resolve data workflow issues effectively.
  • Show experience in conducting code reviews and ensuring adherence to best practices.
  • Exhibit the ability to gather requirements and provide regular project updates to stakeholders.
  • Have a proven track record of developing and maintaining data solutions that drive business success.

  • Certifications Required

    Databricks Certified Associate Developer for Apache Spark Databricks Certified Professional Data Engineer

    About Company

    Cognizant is a global leader in technology and consulting services, helping businesses transform their operations through digital solutions. Specializing in IT services, including software development, business process outsourcing, and consulting, Cognizant supports clients across industries such as healthcare, financial services, manufacturing, and retail. With a focus on innovation, Cognizant assists organizations in modernizing their technology, improving operational efficiency, and enhancing customer experiences. Headquartered in the U.S., it is consistently ranked among the most admired companies in the world and is a member of the NASDAQ-100.

    Services you might be interested in

    One-Shot Campaign

    Reach out to ideal employees in one shot!

    The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).