Sr. Software Engineer

What You’ll Do 

• Implement data quality controls and monitoring systems
• Evaluate and recommend new data technologies and tools
• Deploy and manage cloud-based data solutions (AWS/Azure/GCP)
• Ensure data security, compliance, and governance standards are met
• Design, development, and maintenance of our data engineering infrastructure
• Implement scalable data pipelines for batch and real-time processing
• Establish best practices, coding standards, and technical documentation
• Mentor and provide technical guidance to junior data engineers
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements
• Optimize data models and database designs for performance and reliability
• Develop end-to-end data solutions, including data collection and storage, data modelling, and data consumption.
• Migrating on-prem applications to cloud-based PaaS, focusing on data warehouse and big data solutions.
• Drive innovations by keeping current on emerging cloud technologies
• Migration and transfer of multi-terabyte databases or data warehouses from one data-tier technology to another, based on enterprise strategy.
• Data Modelling: Expertise in data modelling techniques and tools, such as ER modelling, dimensional modelling, and UML (Unified Modelling Language). Design conceptual and logical data models and flowcharts, including source-to-target mappings, transforms, and data lineage.
• Partner with Application Architects to design data-intensive applications with APIs and streaming data pipelines.
• Design solutions to prepare and transform data into a usable state for multi-platform consumption.
• Create data architecture, engineering and migration patterns for MSSQL, MYSQL, Oracle, IBM DB2 assisting data tier migrations with multiple technologies including No SQL/SQL, Relational, Analytical, Big Data, Data Stores, Data Warehousing, supporting Solera Technology Standards and Strategies (TSS) and Cloud Technology Mapping for software versions, licensing, cost savings and implementation in AWS

What You’ll Bring 

• 4+ years of experience in data engineering roles
• Utilizing Real-Time, Batch, and NoSQL/SQL.
• Proficiency in data warehousing, data modelling, ETL design, and optimisation
• Deep understanding of data enrichment, transformation, security, movement, data architecture, golden record, and data integrity.
• Experience with big data technologies (e.g., Hadoop, Spark, Kafka)
• Experience with data orchestration tools (Airflow, Luigi, etc.).
• Familiarity with AWS migration services like Database Migration Service (DMS) and Server Migration Service (SMS).

Required Qualifications
 

• Bachelor's degree in Computer Science, Engineering, or related technical field (Master's preferred)
• Hands-on technical involvement
• Experience with agile development practices
• Strong problem-solving and debugging skills
• **Product Based Company Experience Mandatory