Data Engineer L3 - Data Architecture [T500-20144]

About Costco Wholesale

Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members.

About Costco Wholesale India

At Costco Wholesale India, we foster a collaborative space, working to support Costco Wholesale in developing innovative solutions that improve members experiences and make employees jobs easier. Our employees play a key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale.

Position Title: Data Engineer L3

Job Description:

Roles & Responsibilities:

• Lead the design and implementation of enterprise data platforms: Architect and oversee the deployment of scalable, reliable, and secure data infrastructure for large organizations.
• Drive innovation and adoption of new technologies: Research and integrate cutting-edge tools and frameworks for data ingestion, processing, and governance.
• Mentor and guide junior and mid-level data engineers: Provide technical leadership, code reviews, and career development support.
• Collaborate with stakeholders across teams: Align data engineering initiatives with business objectives and ensure cross-functional alignment.
• Establish and enforce data engineering best practices: Define standards for pipeline architecture, data quality, security, and compliance across the organization.
• Present findings and recommendations to senior leadership: Communicate technical concepts and business impacts to executives and decision-makers.

Technical Skills:

• 8 12 years of experience
• Expert-level proficiency in programming, automation, and orchestration: Mastery of Python, and workflow orchestration tools.
• Deep understanding of data storage, processing, and governance: Advanced knowledge of data warehousing, Lakehouse architectures, and real-time streaming.
• Proven ability to build and deploy scalable data systems: Design and implement robust, production-grade data platforms on GCP.
• Experience with big data technologies: Use Dataflow, Dataproc, Pub/sub, or similar for large-scale data processing.
• Strong security and compliance expertise: Implement and enforce security controls, encryption, audit logging for data systems, and compliance standards or data systems.
• Excellent communication and presentation skills: Articulate technical concepts and business value to diverse audiences.

Must Have Skills:

• Python, orchestration tools (e.g. Airflow, Cloud Composer)
• Data architecture: data lakes, warehouses, streaming (e.g. Pub/Sub, Dataflow, Dataproc)
• Experience with GCP and production-grade data platform deployment
• Data security, compliance, and governance standards
• Data modeling skills - Experience with different data modeling techniques (dimensional modeling, relational modeling, should be able to design scalable data models)
• SQL Skills level - Expert
• Deep understanding of bigquery, have experience on partitioning, clustering and performance optimizations
• Experience on Cloud function, Composer and Cloud run, dataflow flex templates - should be able to write.