Databricks Data Architect

About Position:

We are seeking a Databricks Data Architect with hands on experience in azure, databricks, pyspark, aws, etc.,

• Role: Databricks Data Architect
• Location: All Persistent Locations
• Experience: 12 to 18 Years
• Job Type: Full Time Employment

What You'll Do:

• Design and implement enterprise Databricks Lakehouse architecture using Delta Lake, Unity Catalog, and Medallion patterns
• Define end to end data architecture standards for batch and streaming data workloads
• Build and optimize ETL/ELT pipelines using Databricks, Apache Spark, and AWS Glue
• Develop scalable data transformations using PySpark, Spark SQL, and SQL
• Implement and manage Databricks Jobs, Workflows, and Auto Loader for ingestion pipelines
• Design and support real time and event driven streaming solutions using Structured Streaming
• Apply best practices for performance tuning, cluster optimization, and cost management
• Define and implement data modeling strategies including dimensional, normalized, and analytical models
• Enforce data governance, security, and access control using Unity Catalog
• Integrate CI/CD pipelines using Jenkins and Azure/AWS DevOps tools
• Collaborate with platform, DevOps, and analytics teams to support reliable deployments
• Review designs, resolve technical risks, and drive architecture level decisions
• Support internal and client technical discussions, reviews, and interviews as required

Expertise You'll Bring:

• 12+ years of experience in Data Engineering and/or Data Architecture
• Strong handson expertise with Databricks and Apache Spark
• Deep understanding of Databricks Lakehouse concepts and latest platform features
• Proven experience designing enterprisescale Lakehouse platforms
• Strong proficiency in Python (PySpark), SQL, and Spark SQL
• Experience with Delta Lake, Unity Catalog, Jobs, Workflows, and Auto Loader
• Solid understanding of batch and streaming architectures
• Handson experience with AWS services including Glue, S3, and compute services
• Experience implementing CI/CD pipelines using Jenkins
• Strong knowledge of data performance tuning, cost optimization, and scalability
• Experience working in large enterprise or complex data environments
• Strong problemsolving, analytical, and stakeholder communication skills

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Lets unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.