Data Engineer (Azure Databricks)
Teradata
3 - 6 years
Bangalore, Hyderabad, Mumbai, Pune
Posted: 25/07/2023
Job Description
Job description:
- Education and Experience:
- Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.
- Proven work experience as a Data Engineer, preferably with experience in Azure Databricks.
- Technical Skills:
- Strong proficiency in working with Azure Databricks for data processing, data transformation, and data storage.
- Experience with big data technologies such as Apache Spark, Apache Hadoop, and data lake storage solutions (e.g., Azure Data Lake Storage Gen2).
- Proficiency in programming languages commonly used in data engineering, such as Python, Scala, or SQL.
- Knowledge of data modeling, data warehousing, and ETL (Extract, Transform, Load) processes.
- Familiarity with cloud-based data storage solutions, such as Azure SQL Database, Cosmos DB, or Azure Synapse Analytics (formerly known as Azure SQL Data Warehouse).
- Experience with data integration and data pipelines using tools like Azure Data Factory or Apache NiFi.
- Database and Querying Skills:
- Strong understanding of relational and non-relational databases.
- Proficiency in writing efficient SQL queries for data extraction and manipulation.
- Data Governance and Security:
- Knowledge of data governance best practices and data security measures.
- Understanding of data privacy regulations and compliance (e.g., GDPR).
- Data Visualization:
- Familiarity with data visualization tools like Power BI or Tableau.
- Data Quality and Testing:
- Experience with data quality assurance and data testing processes.
- Problem-Solving and Analytical Skills:
- Ability to analyze complex data sets and troubleshoot data-related issues.
- Communication and Collaboration:
- Strong communication skills to work with cross-functional teams, including data analysts, data scientists, and business stakeholders.
About Company
Teradata is the connected multi-cloud data platform for enterprise analytics, solving data challenges from start to scale. Only Teradata gives you the flexibility to handle the massive and mixed data workloads of the future, today — making your data easier to consume everywhere, with no added risk. Our open approach embraces the modern ecosystem to create a seamless experience for ingestion, exploration, development, and operationalization. We’ve created the fastest path to analytics in the cloud at scale at the lowest risk. Our experience working with thousands of customers and partners around the world, across a wide range of verticals and industries, makes us the most effective platform for delivering business outcomes and unlocking unlimited value by turning data into your greatest asset.
Services you might be interested in
One-Shot Campaign
Reach out to ideal employees in one shot!
The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).