Technical Lead-Data Engg

Area(s) of responsibility

 Data Management (AWS) developer

We are looking for a Data Management (AWS) developer who will serve as the technical counterpart to data stewards across various business domains. This role will focus on the technical aspects of data management, including the integration of data catalogs, data quality management, and access management frameworks within our data lakehouse.

Key Responsibilities:

- Integrate Acryl data catalog with AWS Glue data catalog to enhance data discoverability and management.

- Develop frameworks and processes for deploying and maintaining data classification and data quality rules in the data lakehouse.

- Implement and maintain Lake Formation access frameworks, including OpenID Connect (OIDC) for secure data access.

- Build and maintain data quality and classification reports and visualizations to support data-driven decision-making.

- Develop and implement mechanisms for column-level data lineage in the data lakehouse.

- Collaborate with data stewards to ensure effective data ownership, cataloging, and metadata management.

Qualifications:

- Relevant experience in data management, data governance, or related technical fields.

- Strong technical expertise in AWS services, particularly in AWS Glue, Lake Formation, and data quality management tools.

- Familiarity with data security practices, including OIDC and AWS IAM.

- Experience with AWS Athena, Apache Airflow.

- Relevant certifications (e.g., CDMP) are a plus.

- Terraform, Github, Python,