EY - GDS Consulting - AI and DATA - Cloud Architect - Senior Manager

AWS Data Architect- Senior Manager

We are seeking a highly skilled and motivated Data Architect/Senior Manager with 14+ years of experience as a cloud data architect and who is familiar with modern data stack (AWS) to join our dynamic team. As a Data Architect/Senior Manager, you will be responsible for designing, building and operationalizing enterprise level data platforms or warehouses at scale

Responsibilities

• Strong expertise in AWS tech stack- well versed with all AWS services, cloud concepts, data concepts, building architectural framework in AWS and design thinking
• Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue and any data platforms/warehouse like Databricks or Snowflake.
• Perform detail assessments of current state data platforms and create an appropriate transition/migration/modernization path to AWS cloud.
• Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
• Design and build production data pipelines from ingestion to consumption within a big data architecture, using Spark / Beam / Flink etc.
• Lead design & development of AWS based reusable frameworks for ingestion/DQ/catalog etc.
• Knowledge on data modelling, devops methodologies (CI/CD tools) and ability to guide the team to adopt appropriate methodologies that suits the data landscape
• Experience in building AWS cloud formation templates
• Experience in building spark-based data processing frameworks and handling optimizations
• Experience in troubleshooting new and existing ETL packages
• Domain experience and knowledge on financial services and products (especially on asset wealth management or banking experience (NOT insurance))
• SM/AD level who can initiate technical and strategic conversations with the CDO, CTO from the client side

Skills

• Overall experience of 14+ yrs, with more than 7 yrs in data/warehousing/BI related projects in cloud technologies
• A minimum of 5+ projects experience with AWS solutions with at least 3+ prior experience in leading large scale data migration/modernization programs
• Has experience in any of the following AWS services
  • Proficiencies in more than 3 analytical services – Glue, EMR, Athena, Redshift, Kinesis, Lambda, DynamoDB, Sagemaker
  • Strong experience in the foundational services – S3/Glacier, Cloud trail/watch
  • Exposure to third party services like – Snowflake, Databricks, Kafka etc.
• Sound knowledge of distributed systems, data architecture and AWS well architected principles
• Expertise in building real time and batch data pipelines that handle big data, low latencies and resource optimized
• Ability to integrate data governance into solutions through - data lineage, ensuring data quality, and improving discoverability of data.
• Ability performance tune data pipeline (Glue/EMR) and Redshift, knows how to optimize the distribution, partitioning, and MPP of high-level data structures.
• Sound understanding of DevOps on AWS with prior experience using AWS or open source stacks
• Knowledge of Engineering and Operational Excellence using standard methodologies.