Principal Consultant –Databricks Senior Engineer
Genpact
5 - 10 years
Kolkata
Posted: 9/3/2024
Job Description
Responsibilities
· Collaborate with business stakeholders and data architects to understand data requirements and translate them into technical specifications.
· Design, develop, and test data solutions using Greenplum, including data modeling, ETL (Extract, Transform, Load) processes, and SQL queries. Write efficient, optimized SQL code to extract insights from large datasets.
· Optimize Greenplum queries, indexes, and database configurations for performance and scalability. Identify and resolve performance bottlenecks through query optimization, data partitioning, and workload management.
· Design data models, mappings, and transformations to ensure accurate and efficient data integration and analysis. Implement data quality checks and validation rules to maintain data integrity.
· Design and implement integrations between Greenplum and other systems, databases, and applications. Ensure seamless data flow and interoperability between Greenplum and heterogeneous environments.
· Implement security measures in Greenplum solutions to protect sensitive data and ensure compliance with regulatory requirements such as GDPR, HIPAA, or PCI DSS. Implement encryption, access controls, and data masking techniques as needed.
· Set up monitoring tools and processes to track the health and performance of Greenplum databases and clusters. Proactively identify and troubleshoot issues to minimize downtime and data loss.
· Create technical documentation, including design documents, deployment guides, and operational manuals for Greenplum solutions. Provide training and knowledge transfer to team members and end-users as needed.
· Manage version control for Greenplum scripts and artifacts using tools like Git or SVN. Implement deployment pipelines and automation scripts for continuous integration and deployment (CI/CD) of Greenplum solutions.
· Collaborate effectively with cross-functional teams, including data architects, database administrators, and business analysts. Communicate project status, issues, and risks to stakeholders and project managers.
· Stay updated with the latest features and best practices in Greenplum and data analytics technologies. Identify opportunities for process improvements, tool enhancements, and skill development within the team.
About Company
Genpact is a global professional services firm delivering digital transformation by putting digital and data to work to create competitive advantage.
Services you might be interested in
One-Shot Campaign
Reach out to ideal employees in one shot!
The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).