Senior Data Engineer

Senior Data Engineer - Chennai

About The Role:

Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The idealcandidate will supportdevelopment of data infrastructure for our clientsby participating in activities which may includestarting from up- stream and down-stream technology selection to designingand building of different components. Candidate will also involve in projects like integrating data from various sources, managing big data pipelines that are easily accessible with optimized performance of overall ecosystem. The ideal candidate is an experienced data wrangler who will support our software developers, database architects and data analysts on business initiatives. You must be self-directed and comfortable supporting the data needs of cross-functional teams, systems, and technical solution.

Responsibilities:

• Responsible for the design, deployment, configuration, and operations for a multi-node big data cluster.This includes working with open sourceand/or commercial stacks to support thefull SDLC. Resourcewill work to deploy, manage, and maintain development, test and production environments for the big data platform.
• Develop scripts to automate and streamline operations and configurations in the infrastructure
• Specify, design, build, and supportBI solutions by working closelywith datalake team
• Create dashboards and KPIs to show the business performance to management.
• Design and maintaindata models used for reportingand analytics
• Work to identifyinfrastructure needs and providing supportto developers and business user
• Research performance issues; Optimize platformfor performance
• Troubleshoot and resolve issuesin all operational environments
• Work with a cross functional team delivering softwaredeployments
• Forward thinkingby continuously adoptingnew ideas and technologies to solve businessproblems
• Own the design and development of automated solutionsfor recurring reporting and in-depth analysis.
• A problemsolver and criticalthinker.

Skills and Qualifications Skills needed:

• Strong Experience in Data lake Spark, distributed file system, Yarn, Cloud services(preferably GCP / AWS).
• Strong Experience in SQL tools Vertica,Dremio product or any big data SQL
• Scripting Knowledge Shell, python
• Experience with ETL and OLAP concepts in building highlyscalable data pipelines
• Exposure to any Visualization systemsis a plus (like Apache Superset, Tableau)
• Experience with Agile, data structures, data analysis and wrangling tools and technologies.
• Familiar with versioncontrol and relational databases.
• Strong Experience in monitoring, debugging and troubleshooting of services.
• Experience in providing on-call support.

Basic Qualifications:

• Bachelors / Masters Degreein Computer or related field in a reputed institution
• 5+ years of professional experience in software with most of them from a product company

Preferred Qualifications:

• Proficient in one or more technologies like:
• AWS, EMR
• Hadoop , Spark
• SQL
• Python
• Data Structures
• Experience with workingin Linux based environment
• Good communication and design skills

If Interested, Share your updated resume at chandershekhar.verma@eucloid.com