Data Engineer (DE) - Big Data
Publicis Sapient
3 - 7 years
Gurgaon
Posted: 8/16/2023
Job Description
Job description:
- Experience: A background in data engineering and Big Data technologies, typically requiring several years of relevant experience.
- Hadoop: Proficiency in working with the Hadoop ecosystem, including HDFS, MapReduce, and related tools and technologies.
- Big Data: Strong understanding of Big Data concepts, principles, and best practices for processing and analyzing large datasets.
- Hive: Experience with Hive, a data warehousing and SQL-like query language for Hadoop.
- Spark: Proficiency in Apache Spark, a powerful open-source data processing and analytics engine.
- Scala: Knowledge of the Scala programming language, often used with Apache Spark for building data pipelines.
- Kafka: Familiarity with Apache Kafka, a distributed event streaming platform, and the ability to set up and manage Kafka clusters.
- NOSQL: Experience with NoSQL databases, which could include technologies like MongoDB, Cassandra, or others.
- Cloud (Azure): Hands-on experience with cloud platforms, specifically Microsoft Azure, for deploying and managing Big Data solutions in the cloud.
- Java: Proficiency in Java programming, which is commonly used in Big Data development and integration.
- Data Processing: Strong skills in processing and transforming raw data into usable formats for analysis and reporting.
- Data Modeling: Ability to design and implement effective data models for Big Data solutions.
- ETL: Experience with Extract, Transform, Load (ETL) processes and tools for moving and transforming data between different systems.
- Problem-Solving: Strong problem-solving abilities to troubleshoot issues related to data processing, performance, and integration.
- Collaboration: Good communication and teamwork skills to work effectively with data scientists, analysts, and other stakeholders.
- Cloud Services: Familiarity with cloud services and technologies, especially those related to data storage, processing, and analytics in the cloud.
- Continuous Learning: A willingness to stay updated with the latest advancements in Big Data technologies and practices.
About Company
Publicis Sapient is a global digital transformation consulting company and the digital business transformation hub of Publicis Groupe with 20,000 people and over 50 offices worldwide. It was originally established as Sapient in Cambridge, Massachusetts in 1990. In 2015, Sapient became an Independent subsidiary of French multinational advertising firm Publicis, following a deal worth 3.7 billion dollars. It continues to remain headquartered in Boston Massachusetts and the leadership is retained.
Services you might be interested in
One-Shot Campaign
Reach out to ideal employees in one shot!
The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).