Databricks/Lead

I hope you're doing well! I came across your profile and was impressed by your extensive experience as an/a (mention role/skill). We have a similar opportunity to join our dynamic team at TCS

Job Title: Databricks/Lead

Location: Pan India

Mode: Full Time

Experience: 7 to 15 years

Job Summary: An experienced Databricks Developer / Lead to design, develop, and optimize data solutions using Databricks, Spark, and related technologies. The ideal candidate should have a strong background in data engineering, data science, and programming languages like Python, Scala, or Java.

Responsibilities:

Data Solution Development: Design, develop, and optimize data solutions using Databricks, Spark, and related technologies.

Data Engineering: Develop and maintain data pipelines, data lakes, and data warehouses using Databricks, Delta Lake, and other tools.

Data Science: Collaborate with data scientists to deploy machine learning models and optimize data science workflows.

Performance Optimization: Optimize Spark jobs, Databricks notebooks, and data pipelines for performance and scalability.

Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality

Required Skills:

Databricks: In-depth knowledge of Databricks, Spark, Delta Lake, and related technologies.

Programming: Strong programming skills in Python, Scala, or Java.

Data Engineering: Experience with data engineering, data warehousing, and ETL tools.

Expertise in SQL, Unity Catalogue, Workflows/Jobs

Data Science: Experience with data science, machine learning, and statistical modeling.

Communication: Excellent communication and collaboration skills.

Preferred Skills:

Cloud Experience: Experience with cloud-based data platforms, such as AWS, Azure, or Google Cloud.

Machine Learning: Experience with machine learning frameworks, such as TensorFlow, PyTorch, or Scikit-learn.

Certifications: Relevant certifications, such as Databricks Certified Developer or Databricks Certified Data Scientist