Palantir Data Engineer

Role: Palantir Data Engineer

Location: PAN India

Experience:

Optimally between 4 16 years of experience as data engineer manipulating large data sets, creating data lakes and help building machine learning models using Palantir.

Must Have:

• Palantir with Python or PySpark and SQL or NoSQL

Requirements:

• Design, create and maintain an optimal data pipeline architecture in Foundry
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc in Foundry
• Palantir scheduling jobs for pipeline, monitoring Data pipeline health and configuring health checks and alerts. (Data expectations)
• Build analytics tools using Contour, Quiver, Workshop Application, Slate that utilize the data pipeline to provide actionable insights into KPIs like customer acquisition, operational efficiency and other key business performance metrics
• Good Understanding and working knowledge on Foundry Tools: Ontology, Contour, Object-explorer, Ontology-Manager, Object-editor using Actions/ Typescript, Code workbook, Code Repository, Foundry ML
• Act as a contact person for our customers and advise them on data-driven projects.
• Responsible for architecture topics and solution scenarios in the areas of Cloud Data Analytics Platform, Data Engineering, Analytics and Reporting.
• Experience in Cloud and Big Data architecture.
• Responsibility for designing viable architectures based on Palantir, Microsoft Azure, AWS, Snowflake, Google (or similar) and implementing analytics.
• Experience in DevOps, Infrasturcure as a code, DataOps, MLOps.
• Experience in business development (as well as your support in the proposal process).
• Data warehousing, data modelling and data integration for enterprise data environments.
• Experience in data analysis, modelling (logical and physical data models) and design specific to a data warehouse / Business Intelligence environment (normalized and multi-dimensional modelling).
• Experience with ETL tools primarily Talend and/or any other Data Integrator tools (Open source / proprietary), extensive experience with SQL and SQL scripting (PL/SQL & SQL query tuning and optimization) for relational databases such as PostgreSQL, Oracle, Microsoft SQL Server and MySQL etc., and on NoSQL like MongoDB and/or document-based databases.
• Must be detail oriented, highly motivated and work independently with minimal direction.
• Excellent written, oral and interpersonal communication skills with ability to communicate design solutions to both technical and non-technical audiences.
• Ideally: Experience in agile methods such as safe, scrum, etc.
• Ideally: Experience on programming languages like Python, Pyspark, JavaScript, Java/ Scala etc.

Roles and Responsibilities:

• Provides data services for enterprise information strategy solutions - Works with business solutions leaders and teams to collect and translate information requirements into data to develop data-centric solutions.
• Design and develop modern enterprise data centric solutions (e.g. Palantir, DWH, Data Lake, Data Lakehouse)
• Responsible for designing of data governance solutions.