Data Engineer - Databricks

Job Title: Data Engineer - Databricks

Experience: 5+ Years

Location: Coimbatore

Employment Type: Full-time - On-site

Job Summary:

We are looking for a highly skilled Data Engineer with strong expertise in Databricks, SQL, and modern data engineering practices. The ideal candidate should be Databricks certified and capable of building scalable, high-performance data pipelines to support analytics and business intelligence needs.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and optimize ETL/ELT workflows for large-scale data processing.
• Write complex and optimized SQL queries for data transformation and analysis.
• Work with big data technologies like Apache Spark (PySpark).
• Ensure high data quality, reliability, and performance.
• Collaborate with cross-functional teams including Data Science, Analytics, and Business teams.
• Implement data governance, security, and best practices.
• Troubleshoot and optimize data workflows for performance and cost efficiency.

Required Skills:

• 5+ years of experience in Data Engineering.
• Strong hands-on experience with Databricks (Spark, Delta Lake).
• Advanced proficiency in SQL.
• Experience with Python / PySpark.
• Strong understanding of data modeling and ETL/ELT processes.
• Experience with cloud platforms such as AWS / Azure / GCP.

Certifications:

• Databricks Certified Data Engineer Associate or Professional (highly preferred)

Nice to Have:

• Experience with Airflow or other orchestration tools.
• Familiarity with Snowflake, BigQuery, or Redshift.
• Experience with real-time data processing (Kafka, streaming).
• Exposure to BI tools like Power BI or Tableau.