Data Engineering - Experienced Associate

PWC

0 - 3 years

Bengaluru

Posted: 05/02/2025

Job Description

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Advisory - Other

Management Level

Associate

Job Description & Summary

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Job Description and Key Responsibilities

Design, develop, and maintain robust, scalable ETL pipelines using tools like Apache Spark, Kafka, and other big data technologies.
Ingest, process, and store structured, semi-structured, and unstructured data from various sources.
Demonstrate proficiency in Python, PySpark, Spark, and a solid understanding of design patterns (e.g., SOLID).
Optimize ETL processes to ensure scalability and efficiency.
Work with various file formats, such as JSON, CSV, Parquet, and Avro.
Should have intermediate level knowledge of RDBMS, NoSQL databases, and CAP theorem principles
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and optimize data models for performance and scalability.
Document data processes, architectures, and models comprehensively to facilitate cross-team understanding and maintenance.
Implement and maintain CI/CD pipelines using tools like Docker, Kubernetes, and GitHub.
Ensure data quality, integrity, and security across all systems and processes.
Implement and monitor data governance best practices.
Stay up-to-date with emerging data technologies and trends, and identify opportunities for innovation and improvement.
Knowledge of other Cloud Data/Integration/Orchestration Platforms- Snowflake, Databricks, Azure Data Factory etc. is good to have

Minimum years’ experience required 3-4 of experience in Programming Language (Any of Python, Scala, Java) (Python Preferred), Apache Spark, ADF, Azure Databricks, Postgres, Knowhow of NoSQL is desirable, ETL (Batch/Streaming), Git , Familiarity with Agile.

Required Qualification: BE / master’s in design / B – Design / B.Tech / HCI – Certification (Preferred)

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required:

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Optional Skills

Accepting Feedback, Accepting Feedback, Active Listening, Agile Scalability, Amazon Web Services (AWS), Apache Hadoop, Azure Data Factory, Communication, Data Anonymization, Database Administration, Database Management System (DBMS), Database Optimization, Database Security Best Practices, Data Engineering, Data Engineering Platforms, Data Infrastructure, Data Integration, Data Lake, Data Modeling, Data Pipeline, Data Quality, Data Transformation, Data Validation, Data Warehouse, Data Warehouse Indexing {+ 13 more}

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Up to 20%

Available for Work Visa Sponsorship?

Yes

Government Clearance Required?

Yes

Job Posting End Date

March 27, 2025

About Company

PricewaterhouseCoopers (PwC) is a global professional services firm providing audit, tax, and consulting services. PwC helps organizations manage financial risks, comply with regulations, and improve performance through its expertise in industries like finance, healthcare, and technology.

Data Engineering - Experienced Associate

PWC

Job Description

About Company

Services you might be interested in

One-Shot Campaign