Databricks with Pyspark Developer

Area(s) of responsibility

About Us:
 Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise solutions. The company’s consultative and design-thinking approach empowers societies worldwide, enhancing the efficiency and productivity of businesses. As part of the multibillion-dollar diversified CKA Birla Group, Birlasoft with its 12,000+ professionals, is committed to continuing the Group’s 170-year heritage of building sustainable communities.

Azure Data Engineer with Databricks (7+ Years)
Experience: 7+ Years

      Job Description:
•    Experience in Perform Design, Development & Deployment using Azure Services ( Data Factory, Azure Data Lake Storage, Databricks, PySpark, SQL)
•    Develop and maintain scalable data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity.
•    Experience in create the Technical Specification Design, Application Interface Design.
•    Files Processing – XML, CSV, Excel, ORC, Parquet file Formats
•    Develop batch processing, streaming and integration solutions and process Structured and Non-Structured Data 
•    Good to have experience with ETL development both on-premises and in the cloud using SSIS, Data Factory, and related Microsoft and other ETL technologies (Informatica preferred)
•    Demonstrated in depth skills with Azure Data Factory, Azure Databricks, PySpark, ADLS (must have) with the ability to configure and administrate all aspects of Azure SQL DB. 
•    Collaborate and engage with BI & analytics and business team
•    Deep understanding of the operational dependencies of applications, networks, systems, security and policy (both on premise and in the cloud; VMs, Networking, VPN (Express Route), Active Directory, Storage (Blob, etc.),