Data Engineer
Accenture
2 - 4 years
Pune
Posted: 9/9/2024
Job Description
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Google Cloud Data Services
Good to have skills : GCP Dataflow, Data Engineering
Minimum 3 year(s) of experience is required
Educational Qualification : standard 15 years
Summary: As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems using Google Cloud Data Services. Roles & Responsibilities: - Design, develop, and maintain data solutions for data generation, collection, and processing using Google Cloud Data Services. - Create data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems. - Collaborate with cross-functional teams to identify and resolve data-related issues and ensure data accuracy and consistency. - Develop and maintain data models, data dictionaries, and data flow diagrams to support data integration and data management processes. JOB SUMMARY & PRINCIPAL DUTIES: A solid experience and understanding of considerations for large-scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on GCP is a must. Monitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right times. Design, build and test scalable data ingestion pipelines, perform end to end automation of ETL process for various datasets that are being ingested. Determine best way to extract application telemetry data, structure it, send to proper tool for reporting (Kafka, Splunk). Create reports to monitor usage data for billing and SLA tracking. Work with business and cross-functional teams to gather and document requirements to meet business needs. Provide support as required to ensure the availability and performance of ETL/ELT jobs. Provide technical assistance and cross training to business and internal team members. Collaborate with business partners for continuous improvement opportunities. Must have experience working in an Onshore/Offshore model. Be responsible for removing any blockers to tasks, communicating with the client stakeholders to manage delivery risks Requirements JOB SPECIFICATIONS: Education: Bachelor's Degree in Computer Science, Information Technology, Engineering, or related field Experience, Skills & Qualifications: 3+ years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics. 3+ years of experience with one of the leading public clouds. 2+ years of experience in design and build of salable data pipelines that deal with extraction, transformation, and loading. Mandatory Experience 3+ years of experience with Python with working knowledge on Notebooks. Mandatory - 3+ years working on a cloud data projects Nice to Have Scala experience. Must have for Onshore candidate- 2+ years hands on experience on GCP Cloud data implementation projects (Dataflow, DataProc, Cloud Composer, Big Query, Cloud Storage, GKE, Airflow, etc.). At least 2 years of experience in Data governance and Metadata Management. Ability to work independently, solve problems, update the stake holders. Analyze, design, develop and deploy solutions as per business requirements. Strong understanding of relational and dimensional data modeling. Experience in DevOps and CI/CD related technologies. Excellent written, verbal communication skills, including experience in technical documentation and ability to communicate with business managers and executives. Additional Information: - The candidate should have a minimum of 3 years of experience in Google Cloud Data Services. - The ideal candidate will possess a strong educational background in computer science, information technology, or a related field, along with a proven track record of delivering impactful data-driven solutions. - This position is based at our Pune office.
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Google Cloud Data Services
Good to have skills : GCP Dataflow, Data Engineering
Minimum 3 year(s) of experience is required
Educational Qualification : standard 15 years
Summary: As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems using Google Cloud Data Services. Roles & Responsibilities: - Design, develop, and maintain data solutions for data generation, collection, and processing using Google Cloud Data Services. - Create data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems. - Collaborate with cross-functional teams to identify and resolve data-related issues and ensure data accuracy and consistency. - Develop and maintain data models, data dictionaries, and data flow diagrams to support data integration and data management processes. JOB SUMMARY & PRINCIPAL DUTIES: A solid experience and understanding of considerations for large-scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on GCP is a must. Monitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right times. Design, build and test scalable data ingestion pipelines, perform end to end automation of ETL process for various datasets that are being ingested. Determine best way to extract application telemetry data, structure it, send to proper tool for reporting (Kafka, Splunk). Create reports to monitor usage data for billing and SLA tracking. Work with business and cross-functional teams to gather and document requirements to meet business needs. Provide support as required to ensure the availability and performance of ETL/ELT jobs. Provide technical assistance and cross training to business and internal team members. Collaborate with business partners for continuous improvement opportunities. Must have experience working in an Onshore/Offshore model. Be responsible for removing any blockers to tasks, communicating with the client stakeholders to manage delivery risks Requirements JOB SPECIFICATIONS: Education: Bachelor's Degree in Computer Science, Information Technology, Engineering, or related field Experience, Skills & Qualifications: 3+ years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics. 3+ years of experience with one of the leading public clouds. 2+ years of experience in design and build of salable data pipelines that deal with extraction, transformation, and loading. Mandatory Experience 3+ years of experience with Python with working knowledge on Notebooks. Mandatory - 3+ years working on a cloud data projects Nice to Have Scala experience. Must have for Onshore candidate- 2+ years hands on experience on GCP Cloud data implementation projects (Dataflow, DataProc, Cloud Composer, Big Query, Cloud Storage, GKE, Airflow, etc.). At least 2 years of experience in Data governance and Metadata Management. Ability to work independently, solve problems, update the stake holders. Analyze, design, develop and deploy solutions as per business requirements. Strong understanding of relational and dimensional data modeling. Experience in DevOps and CI/CD related technologies. Excellent written, verbal communication skills, including experience in technical documentation and ability to communicate with business managers and executives. Additional Information: - The candidate should have a minimum of 3 years of experience in Google Cloud Data Services. - The ideal candidate will possess a strong educational background in computer science, information technology, or a related field, along with a proven track record of delivering impactful data-driven solutions. - This position is based at our Pune office.
About Company
Accenture is a global professional services company that provides a broad range of services in strategy, consulting, digital, technology, and operations. Headquartered in Dublin, Ireland, Accenture operates in more than 120 countries and serves clients in various industries, including finance, healthcare, technology, and consumer goods. The company focuses on delivering innovative solutions and digital transformation services to help businesses improve efficiency, enhance performance, and drive growth. Accenture is known for its extensive use of technology and data analytics to solve complex business challenges and maintain a competitive edge in a rapidly changing market.
Services you might be interested in
One-Shot Campaign
Reach out to ideal employees in one shot!
The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).