Data Engineer - StreamSets

Job Description

Role Purpose

The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters

͏

JD :

 

Kafka & Steamsets

 

Responsibilities:

• As a Lead Developer, Analyze, design and develop components, tools and custom features using Databricks and  streamsets as per business needs.

• Analyze, create and develop technical design to determine business functional and non-functional requirements & processes and review them with the technology leads and architects.

• Work collaboratively with all the teams as required to build a data model and setup things in Databricks and streamsets as appropriate to transform the data and transfer it as appropriate.

• Develop solutions to publish/subscribe Kafka topics.

• Experience with web services API requirements analysis, definition and security.

• Participate in application deployments, release calls and post deployment reviews.

• Manage routine delivery services, ensure prompt delivery of all committed service deliverables, identify, articulate and mitigate the risks associated to the releases with key IT and Business stakeholders of the project.

 

Qualifications:

• Kafka, Streamsets, Databricks and strong SQL skills are required.

• Sr. Developer with 4-6 years of experience in .NET Technologies with Kafka.

• Experience using Microsoft Visual Studio to develop/maintain complex applications in C# and/or ASP.NET for n-tier web deployment is optional

• Knowledge on API.

• Understanding of relational database like Oracle and PL/SQL.

• Experience interpreting and analyzing complex business requirements and building the logic within an application's code to meet those requirements.

 

͏

2. Perform coding and ensure optimal software/ module development

• Determine operational feasibility by evaluating analysis, problem definition, requirements, software development and proposed software
• Develop and automate processes for software validation by setting up and designing test cases/scenarios/usage cases, and executing these cases
• Modifying software to fix errors, adapt it to new hardware, improve its performance, or upgrade interfaces.
• Analyzing information to recommend and plan the installation of new systems or modifications of an existing system
• Ensuring that code is error free or has no bugs and test failure
• Preparing reports on programming project specifications, activities and status
• Ensure all the codes are raised as per the norm defined for project / program / account with clear description and replication patterns
• Compile timely, comprehensive and accurate documentation and reports as requested
• Coordinating with the team on daily project status and progress and documenting it
• Providing feedback on usability and serviceability, trace the result to quality risk and report it to concerned stakeholders

͏

3. Status Reporting and Customer Focus on an ongoing basis with respect to project and its execution

• Capturing all the requirements and clarifications from the client for better quality work
• Taking feedback on the regular basis to ensure smooth and on time delivery
• Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members.
• Consulting with engineering staff to evaluate software-hardware interfaces and develop specifications and performance requirements
• Document and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code
• Documenting very necessary details and reports in a formal way for proper understanding of software from client proposal to implementation
• Ensure good quality of interaction with customer w.r.t. e-mail content, fault report tracking, voice calls, business etiquette etc
• Timely Response to customer requests and no instances of complaints either internally or externally

͏

Deliver

No.	Performance Parameter	Measure
1.	Continuous Integration, Deployment & Monitoring of Software	100% error free on boarding & implementation, throughput %, Adherence to the schedule/ release plan
2.	Quality & CSAT	On-Time Delivery, Manage software, Troubleshoot queries, Customer experience, completion of assigned certifications for skill upgradation
3.	MIS & Reporting	100% on time MIS & report generation