Lead Software Engineer- Data Engineer & AI - Hyderabad

Know your role in Deloitte

About Deloitte

Deloitte is the brand under which tens of thousands of dedicated professionals in independent firms throughout the world collaborate to provide audit, consulting, financial advisory, risk management, and tax services to selected clients. These firms are members of Deloitte Touche Tohmatsu Limited (DTTL), a UK private company limited by guarantee. Each member firm provides services in a particular geographic area and is subject to the laws and professional regulations of the particular country or countries in which it operates. DTTL and each DTTL member firm are separate and distinct legal entities. Each DTTL member firm is structured differently in accordance with national laws, regulations, customary practice, and other factors and may secure the provision of professional services in their territories through subsidiaries, affiliates, and/or other entities.

In the United States, Deloitte LLP is the member firm of DTTL. Services are primarily provided by the subsidiaries of Deloitte LLP, including:

   Deloitte & Touche LLP

   Deloitte Consulting LLP

   Deloitte Financial Advisory Services LLP

   Deloitte Tax LLP

In India, Deloitte LLP has the following indirect subsidiaries: Deloitte & Touche Assurance & Enterprise Risk Services India Private Limited, Deloitte Consulting India Private Limited, Deloitte Financial Advisory Services India Private Limited, Deloitte Tax Services India Private Limited, and Deloitte Support Services India Private Limited. These entities primarily render services to their respective U.S.-based parents.

U.S. India Deloitte Tax Services India Private Limited

Deloitte Tax Services India Private Limited (Deloitte Tax Services India) commenced operations in January 2002. Since then, nearly all of the Deloitte Tax LLP (Deloitte Tax) U.S. service lines and region have developed their affiliations in India. Deloitte Tax offers you immense opportunities to learn and practice U.S. Taxation, a much sought after career option.

Our Vision:
To be the dominant global provider of tax services delivering unmatched value to our clients and our people through sustained relationships.

U.S. India Tax TTO

Deloitte Tax LLPs Tax Transformation (TTO) team is responsible for the design, development and deployment of tax tools for the US Tax Practice.  The professionals on the TTO team are focused on assisting Deloitte Tax in its efforts to deliver quality, comprehensive, value-added, and efficient client services using tax tools to our clients.  The team consults and executes on a wide range of initiatives involving tax technology management, tool development and implementation. 

Job description

Function	Deloitte Tax Services India Private Limited
Service line	TAX TTO
Job level	Senior Data Engineer
Specific skill set required	SQL and NoSQL, Python, Hadoop MapReduce, Kafka, Hive, Spark, Milvus Zilliz Cloud, RAG Architectures, understanding of LLM Pipelines, MongoDB, and Azure
Graduation	BE/B.Tech., M.C.A., M.Sc. Comp Sc., M.Tech.
Professional qualification
Work experience	6-9 years

The key job responsibilities include the following:

   Participate in requirements analysis.

   Collaborate with US and Vendors teams to produce software design and architecture.

   Write clean, scalable code using .NET programming languages.

   Test and deploy applications and systems.

   Revise, update, refactor and debug code.

   Develop, support and maintain applications and technology solutions.

   Ensure that all development efforts meet or exceed client expectations. Applications should meet requirements of scope, functionality, and time and adhere to all defined and agreed upon standards.

   Become familiar with all development tools, testing tools, methodologies and processes.

   Become familiar with the project management methodology and processes.

   Encourage collaborative efforts and camaraderie with on-shore and off-shore team members.

   Demonstrate a strong working understanding of the industry best standards in software development and version controlling.

   Ensure the quality and low bug rates of code released into production.

   Work on agile projects, participate in daily SCRUM calls and provide task updates.

   During design and key development phases, might need to work a staggered shift from 2pm-11pm to ensure appropriate overlap of the India and US teams and project deliveries.

   Responsible for the building, deployment, and maintenance of mission-critical analytics solutions that process terabytes of data quickly at big-data scales

   Contributes design, code, configurations, manage data ingestion, real-time streaming, batch processing, ETL across multiple data storages

   Responsible for performance tuning of complicated SQL queries and Data flows

   Design and operationalize multi-agent (agentic) Generative AI (GenAI) workflows (planner/worker patterns, tool use, agent memory, retries/fallbacks) integrated with enterprise data products and retrieval services

   Build and maintain agent tool backends (search/retrieval, document ingestion, SQL generation guardrails, governance checks) with strong observability (tracing, evaluation, quality metrics) for production reliability

   Own the vector retrieval layer end-to-end: embedding pipelines, indexing strategy, hybrid search patterns, and latency/throughput optimization for Retrieval-Augmented Generation (RAG) use cases

   Lead implementation of Zilliz Cloud / Milvus in production: collection design, partitions, index selection/tuning, bulk ingest patterns, and retrieval performance tuning

   Implement MongoDB-based data services for GenAI workloads (document modeling, aggregation pipelines, change streams for event-driven processing, and sharding/scale patterns)

Key skills required:

   6+ years of strong hands-on experience on C#, SQL Server, OOPS Concepts, Micro Services Architecture.

   At least one year hands-on experience on .NET Core, ASP.NET Core Web API, SQL, NoSQL, Entity Framework 6 or above, Azure, Database performance tuning, Applying Design Patterns, Agile.

   Skill for writing reusable libraries.

   Experience in Azure cloud data platform

   Experience working with vector databases (Milvus, Postgres, etc.)

   Knowledge of embedding models and retrieval-augmented generation (RAG) architectures

   Understanding of LLM pipelines, including data preprocessing for GenAI models

   Experience deploying data pipelines for AI/ML workloads, ensuring scalability and efficiency

   Familiarity with model monitoring, feature stores (Feast, Vertex AI Feature Store), and data versioning

   Experience with CI/CD for ML pipelines (Kubeflow, MLflow, Airflow, SageMaker Pipelines)

   Understanding of real-time streaming for ML model inference (Kafka, Spark Streaming)

   Knowledge of Data Warehousing, design, implementation and optimization

   Knowledge of Data Quality testing, automation and results visualization

   Knowledge of BI reports and dashboards design and implementation (PowerBI)

   Experience with supporting data scientists and complex statistical use cases highly desirable

   Hands-on experience delivering multi-agent systems using common orchestration patterns/frameworks (e.g., agent graphs, tool-calling, structured outputs), including evaluation and safety/guardrail approaches for enterprise use

   Production experience with Zilliz (Milvus) (self-managed or Zilliz Cloud): vector indexing methods, metadata filtering, hybrid retrieval, and performance tuning at scale

   Strong MongoDB experience: schema design for semi-structured data, aggregation framework proficiency, indexing strategies, and operational best practices (backup/restore, security, performance)

   Experience integrating MongoDB + vector search patterns and/or using MongoDB as a metadata store alongside Milvus/Zilliz for RAG pipelines

   Excellent Communication skills both oral & written.

   Excellent troubleshooting and communication skills, ability to communicate clearly with US counterparts.

Additional Information/Nice to Have:

   Knowledge on Angular, Mongo DB, NPM and Azure Devops Build/Release configuration.

   Self-starter with solid analytical and problem-solving skills.

   This is an experienced level position, and we will train the qualified candidate in the required applications.

About Company

Deloitte is a global professional services firm that provides a wide range of services, including audit and assurance, consulting, tax, risk management, and financial advisory. With a presence in over 150 countries and a network of member firms, Deloitte serves clients across various industries, helping them solve complex business challenges, improve operations, and innovate. Known for its expertise in management consulting, technology solutions, and strategy, Deloitte is one of the Big Four accounting firms and is recognized for its commitment to quality, integrity, and making an impact in the marketplace.