Large Language Model Architect
Accenture
2 - 5 years
Bengaluru
Posted: 04/06/2026
Job Description
Project Role Description : Architect large language models (LLM) that can process and generate natural language. Design neural network parameters, trained on large quantities of unlabeled text data.
Must have skills : Large Language Models (LLMs)
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
We are building out a world-class AI Delivery and Architecture team and are looking for exceptional engineers who want to shape how enterprise AI systems are designed, built, and operated at scale. This is a senior hands-on technical role that sits at the intersection of cloud engineering, LLM/GenAI application development, and AI infrastructure platform design.
You will drive architecture decisions, lead delivery across complex multi-cloud AI programs, and act as a force multiplier for the engineers around you. You will be equally at home writing production Python, reviewing infrastructure-as-code, and presenting architecture trade-offs to senior stakeholders.
Roles & Responsibilities:
- Architect and deliver end-to-end GenAI solutions
Define the AI roadmap for our key customers
Design RAG pipelines, agentic workflows, and multi-model orchestration patterns that go beyond prototypes into production-grade systems.
Lead technical design and governance
Own Architecture Decision Records , run design reviews, establish engineering standards, and ensure solutions are reusable and maintainable across teams.
Drive AI infrastructure platform engineering
Build and scale model-serving infrastructure (Bedrock, Vertex AI, Azure OpenAI), and AI gateway/routing layers.
Strong system integration Skills
Own multi-cloud delivery
Architect and deliver across AWS, Azure, and GCP using IaC (Terraform/Pulumi), Kubernetes (EKS/AKS/GKE), and GitOps workflows.
Embed observability and LLMOps from day one
Instrument AI systems with OpenTelemetry, LLM-specific tooling , token/cost dashboards, and drift detection.
Champion responsible AI and security
Implement guardrails, output filtering, prompt injection defenses, data residency controls, and OWASP LLM Top 10 mitigations.
Mentor and grow the team
Guide engineers through complex technical challenges, lead code and architecture reviews, and help set the bar for engineering quality.
Translate strategy into delivery
Work closely with product, data science, and business stakeholders to turn AI objectives into executable technical roadmaps.
Professional & Technical Skills:
12+ years of software engineering experience, with at least 2 years in AI/ML or GenAI delivery in production environments.
Demonstrated track record of leading end-to-end delivery of complex, multi-cloud AI solutions — not just prototypes.
Prior experience as a tech lead or principal engineer who had managed 10+ engineers .
Core engineering
Advanced Python — packaging, production-grade code quality.
Go or Java/Kotlin for platform and infrastructure services (advantageous).
REST, gRPC, event-driven architecture (Kafka / Kinesis), clean architecture and domain-driven design.
LLM & GenAI engineering
Prompt engineering
RAG pipeline design — chunking strategies, embedding models, vector stores
Knowledge graph design
Agentic frameworks — LangChain, LlamaIndex, AutoGen, or equivalent
Fine-tuning experience — LoRA, QLoRA, PEFT dataset curation and evaluation. – vry good to have
LLM evaluation frameworks — RAGAS, LLM-as-judge, regression testing, quality gates.
Cloud & infrastructure
Deep expertise in at least one of AWS, Azure, and GCP — compute, networking, IAM, storage.
Kubernetes (EKS, AKS, GKE)
IaC — Terraform (primary) Pulumi or AWS CDK also valued.
Architecture & leadership
Ability to produce and communicate architecture artefacts — ADRs, solution design documents — to technical and non-technical audiences.
Well-Architected Framework knowledge across cloud providers.
Responsible AI — guardrails, PII redaction, output filtering, OWASP LLM Top 10, AI Act / GDPR awareness.
Strong FinOps sensibility — cost governance, token cost optimization, multi-cloud spend visibility.
Additional Information:
Cloud certifications — AWS Solutions Architect Pro, Azure AI Engineer, Google Professional ML Engineer.
Experience with AI ethics, model cards, bias auditing, or fairness testing.
Background in platform engineering or building internal developer platforms (IDPs).
Exposure to service mesh (Istio / Linkerd) and API gateway patterns for AI microservices.
Experience working in regulated industries (finance, healthcare, public sector).
15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
About Company
Accenture is a global professional services company specializing in consulting, technology, and outsourcing services. Headquartered in Dublin, Ireland, Accenture provides a wide range of services in strategy, digital, technology, operations, and consulting. It helps organizations improve their performance and create sustainable value by leveraging technology and industry expertise. Accenture works across various sectors, including financial services, healthcare, telecommunications, energy, and more. Known for its deep focus on innovation, Accenture partners with leading technology companies to drive digital transformation and help clients navigate complex challenges in an increasingly digital world.
Services you might be interested in
We Search & Apply Jobs for You!
Our team scans through 1000s of opportunities and applies to roles best suited to your profile
Save 100+ hours and focus on what matters - cracking interviews and landing offers.
