Responsibilities
Build robust, performing and high scalable, flexible data pipelines with a focus on time to market with quality. Responsibilities: · Act as an active team member to ensure high code quality (unit testing, regression tests) delivered in time and within budget. · Document the delivered code/solution · Participate to the implementation of the releases following the change & release management processes · Provide support to the operation team in case of major incidents for which engineering knowledge is required. · Participate to effort estimations. · Provide solutions (bug fixes) for problem mgt.
Technical Requirements
You have experience with most of these technologies: HDFS, Ozone, Hive, Impala, Spark, Atlas, Ranger. Knowledge of GraphQL, Venafi (Certificate Mgt) and Collibra (Data Governance) is an asset. · Experience in a telecommunication environment and real-time technologies with focus on high availability and high-volume processing is an advantage: o Kafka o Flink o Spark Streaming · You master programming languages as Java & Python/PySpark as well as SQL and are proficient in UNIX scripting · Data formats like JSON, Parquet, XML and REST API have no secrets for you · You have experience with CI/CD (GitLab/GitHub, Jenkins, Ansible, Nexus) for automated build & test. Knowledge of the Azure DevOps toolset is an asset. As project is preparing a “move to Azure”, the above will change slightly in the course of 2025. However, most of our current technological landscape remains a solid foundation for a role as EDH Data Engineer
Preferred Skills
Technology->Analytics - Packages->Python - Big Data
Technology->Big Data - Data Processing->Spark
Additional Responsibilities
• Good knowledge on software configuration management systems • Strong business acumen, strategy and cross-industry thought leadership • Awareness of latest technologies and Industry trends • Logical thinking and problem solving skills along with an ability to collaborate • Two or three industry domain knowledge • Understanding of the financial processes for various types of projects and the various pricing models available • Client Interfacing skills • Knowledge of SDLC and agile methodologies • Project and Team management
Educational Requirements
Bachelor of Engineering
