Senior Data Engineer

Job Title: Senior Data Engineer with Python

Experience: 68 Years

Location: Hyderabad

Job Summary:

We are seeking a skilled Data Engineer with strong expertise in Python and cloud platforms, along with experience in large-scale data computation.

The ideal candidate will design and build high-performance data pipelines and computational frameworks to process and analyze large volumes of data efficiently.

Key Responsibilities:

Design, develop, and maintain scalable data pipelines using Python.

Develop data computation workflows for large-scale data processing and analytics.

Work with cloud platforms (AWS / Azure / GCP) to build data solutions.

Implement distributed data processing using tools like Spark or similar frameworks.

Optimize data processing performance, including query tuning and job optimization.

Build and maintain data lakes, data warehouses, and computational data layers.

Ensure data quality, consistency, and governance across pipelines.

Collaborate with data scientists and analysts to support advanced analytics use cases.

Required Skills:

Strong programming experience in Python.

Hands-on experience with data computation frameworks (Apache Spark / PySpark).

Experience in ETL/ELT pipeline development.

Strong knowledge of SQL and database systems.

Experience with cloud platforms (AWS / Azure / GCP).

Knowledge of big data technologies (Hadoop ecosystem, distributed systems).

Experience with workflow orchestration tools (Airflow, etc.)

Strong understanding of data structures, algorithms, and performance optimization.

Preferred Skills:

Experience with real-time streaming tools (Kafka, Spark Streaming, etc.)

Familiarity with data warehouse platforms (Snowflake, Redshift, BigQuery)

Knowledge of containerization (Docker, Kubernetes)

Exposure to ML data pipelines or feature engineering workflows.

Experience in handling large-scale data computations and transformations.

Qualifications:

Bachelors/Masters degree in Computer Science, Engineering, or related field.

68 years of experience in data engineering and data processing.