Data Architect

Insight Global is hiring a Technical Lead / Data Architect to drive the build-out of an enterprise-grade digital supply chain data platform. This is a hands-on architecture and delivery leadership role: you'll own the migration of legacy Alteryx workflows and flat-file processes into a modern, governed Databricks/Azure ecosystem, and you'll be the technical authority other teams look to for direction. This is a senior, hands-on role. Candidates must demonstrate direct, hands-on build experience in both Azure Databricks and Alteryx.

Required Qualifications

• 812+ years in data engineering or data architecture
• Hands-on, production-level experience with Azure Databricks building, optimizing, and operating pipelines
• Hands-on, production-level experience with Alteryx building and maintaining workflows, with direct experience migrating Alteryx workflows to a cloud-native platform
• Proven track record building medallion/layered architectures (Bronze/Silver/Gold), ETL/ELT pipelines, and production-grade Python and SQL
• Direct experience migrating legacy systems (Alteryx, flat-file processes) to modern cloud platforms
• Strong data modeling, performance tuning, and testing strategy skills
• Experience leading technical teams in Agile/Scrum environments

Certifications Required

• Databricks Certified Data Engineer (Associate or Professional)
• Microsoft Azure Data Engineer Associate (DP-203) or equivalent Azure data certification
• Alteryx Designer Core/Advanced Certification preferred

Key Responsibilities

Architecture & Platform Design

• Lead design and optimization of medallion architecture across enterprise data pipelines
• Set and enforce data architecture standards across ingestion, transformation, storage, and consumption
• Redesign gold-layer datasets for performance, scalability, and downstream analytics
• Build the platform for reliability, performance, and governance from day one

Migration & Modernization

• Architect and own the migration of 40 Alteryx workflows to Databricks and ~500 flat-file sources into scalable pipelines
• Set the conversion strategy for simple vs. complex pipelines
• Define flat-file ingestion strategy, including automation and replacement with stronger data sources where feasible
• Validate parity between legacy and new systems through comparison testing and SIT/UAT readiness

Engineering Excellence & Delivery

• Drive production-grade Python/SQL development and enforce engineering best practices
• Stand up CI/CD pipelines, testing frameworks, and automated validation
• Define and lead test strategy (unit, SIT, UAT, regression) with stakeholders
• Deliver complete technical documentation: architecture diagrams, runbooks, technical specs

Platform & Ecosystem Integration

• Lead implementation across Dev, QA, and Prod Azure environments
• Design scalable ingestion frameworks for structured and semi-structured data
• Enable downstream integrations, including Tableau dashboards and data sharing

Leadership & Stakeholder Management

• Act as the technical authority across architecture, engineering, and delivery
• Translate business requirements into scalable data solutions with Product, Business SMEs, and QA
• Guide development teams and hold the line on architectural alignment
• Own sprint planning and technical backlog for the workstream