Data Engineer – CBI

JD - Data Engineer (Contract)

This is a contractual position for D Square Consulting Services Pvt Ltd

Experience 5-7 Years

LocationBangalore

Work mode Hybrid

Notice period:Immediately to 30 days

Job Summary

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have strong hands-on experience with data platforms, including Snowflake/Databricks,PySpark,Streamlit, GitHub, and Python. You will design, build, andmaintainscalable data pipelines to support analytics and reporting needs.

Must-Have skills

• 5+ years of experience in data engineering ora relatedrole.
• Hands-on experience with Snowflake/Databricks,PySpark,Streamlit, GitHub, and Python.
• Strong knowledge of ETL/ELT processes, data modeling, and data warehousing.
• Proficiencyin SQL for querying and analysis.
• Familiarity with data visualization tools likePowerBI.
• Excellent problem-solving skills and attention to detail.
• Strong communicationand collaboration in team environments.

Good-to-have skills

• Knowledge of data governance and security practices.
• Experience with data observability best practices.
• Proficiencyin Scala or Java.

Roles & Responsibilities

• Design, implement, andmaintainrobust data pipelines using Databricks for ingesting, transforming, and delivering data for analytics and reporting.
• Utilize Snowflake/Databricks for data storage, management, and optimization to ensure high performance and reliability.
• Develop and manage data transformation workflows usingPySpark, focusing on data quality, consistency, and documentation.
• Collaborate withPower BIdevelopers and stakeholders to build interactive dashboards and data applications usingStreamlitfor actionable insights.
• Write efficient Python code to automate processes, cleanse data, and handle ETL workflows.
• Partner with cross-functional teams (analysts, business stakeholders) to gather requirements and deliver solutions.
• Implement monitoring for data quality and pipeline health; troubleshoot issues andoptimizeperformance.
• Follow GitHub best practices for version control.
• Document data workflows, methodologies, and best practices for team knowledge sharing

Qualifications

• Bachelors degree in Computer Science, Engineering, Data Science, or related field.