Data Engineer (Pyspark) with AI

Job description:

Job Title: Data Engineer (Pyspark) with AI

Location: Bangalore

Experience Range: 6 - 10 yrs

Required skill:

• Minimum 5 years of PySpark Development experience, especially in Spark SQL and Complex Transformations
• Minimum 3 years of Python development experience
• Minimum 2 years of experience in ADF
• Strong design and data solutioning skills
• Good command and hands-on experience in Python
• Database skills- Oracle, Postgres, SQL Server any one database experience, Oracle PL/SQL or T-SQL experience, Data modelling
• Experience working with following concepts, packages, and tools, Object oriented and functional programming, NumPy, Pandas, Matplotlib, requests, pytest, Jupyter, PyCharm and IDLE, Conda and Virtual Environment

Good-to-Have

• Understanding and experience in Azure Synapse Analytics is a double plus
• Understanding of Hadoop ecosystem working experience is a plus
• NLTK, Scikit-learn, TensorFlow, Keras is a plus