Primary : Collibra , with experience in dealing with RDBMS data bases like Oracle, Postgres SQL.
Secondary : Experience in Azure PaaS services with the ability to integrate Collibra DQ workflows with Azure data pipelines, using API’s and batch jobs.
6+ years of diverse experience in designing and managing innovative solutions. Experience in the Financial / FinTech industry is a plus
? Proven experience in Python and web service integration skills.
? Strong focus in TDD and/or BDD
? hands-on experience with web/application development (html, css, apis ? rest, json)
? good experience with relational DBs like Postgres, Oracle SQL, MS SQL, or MySQL. Non-relational DB experience is a plus!
? knowledge in the Data Engineering space: distributed big data processing, data profiling, ETL / ELT workflows. Experience with Apache Spark or Databricks is recommended
? knowledge of data management standards and data governance practices
? proven experience in agile development methodology
? azure cloud base technology is a plus