Senior Data Engineer

Company Description:

bolt is the leading insurance exchange for the P&C insurance industry, uniting distributors and providers on a single platform to transform the way insurance is bought and sold. We work with two-thirds of Americas leading carriers, connecting more people with ways to protect the things they value.

Website: https://bolttech.io/

Role Description:

We are seeking a Senior Data Engineer to join our AI & Analytics group. You will design and build scalable data pipelines, architect modern data platforms, and enable BI and analytics solutions that power actionable insights across our SaaS platform. This role requires strong expertise in distributed data processing, cloud-native architecture, and hands-on experience with Databricks, Spark, Scala, Python, and SQL.

You will also leverage GenAI and AI prompting techniques to enhance analytics workflows, automate data preparation, and accelerate insight generation.

Roles & Responsibilities:

• Design, build, and optimize data pipelines using Databricks, Spark, Scala, and Python.
• Develop and maintain data warehouses and data models to support BI and analytics.
• Write and optimize complex SQL queries and stored procedures.
• Perform Unit Testing (UT) and Quality Checks (QC) to ensure data accuracy and reliability.
• Integrate GenAI capabilities (AI prompting, foundation models) into analytics workflows.
• Collaborate with BI teams to enable reporting and visualization (Power BI, Tableau, Looker).
• Implement APIs and data services with robust monitoring, logging, and security.
• Support production environments with proactive system monitoring and troubleshooting.
• Drive adoption of best practices in Agile delivery, CI/CD, and Infrastructure as Code.
• Research and evaluate emerging technologies in big data, GenAI, and BI platforms

Qualifications & Skills:

• Graduate or Masters in Computer Science, Data Engineering, or related field.
• 6+ years of experience in data engineering and analytics platforms.
• Hands-on expertise with Databricks, Spark, Scala, and Python.
• Strong proficiency in SQL, with proven ability to perform UT and QC for data pipelines.
• Experience with data warehousing (Snowflake, Redshift, BigQuery, or equivalent).
• Familiarity with BI tools (Power BI, Tableau, Looker).
• Experience with GenAI projects, including AI prompting and foundation models.
• Strong knowledge of cloud platforms (AWS, Azure, GCP); AWS preferred.
• Familiarity with ETL/ELT orchestration tools (Airflow, dbt).
• Experience with CI/CD and IaC tools (Terraform, CloudFormation).
• Knowledge of REST APIs, Postman, and microservices architecture.
• Strong communication skills and ability to work with cross-functional teams.