AI/ML Backend Engineer (Java)
Call For Referral
2 - 5 years
Hyderabad
Posted: 19/06/2026
Job Description
Role & Responsibilities
About the Role:
We are seeking strong Senior Java + AI Platform Engineers to work on strategic enterprise initiatives focused on building scalable AI Governance, Observability, and Compliance platforms.
The ideal candidate will have strong expertise in Java backend engineering, distributed systems, AI
integrations, telemetry pipelines, and cloud-native architectures. This role involves designing scalable enterprise-grade platforms capable of monitoring, governing, and securing AI interactions across large-scale enterprise environments.
Key Responsibilities:
Design and build pluggable evaluator services using Java and Spring Boot
Develop scalable SaaS/cloud-native backend services and microservices
Integrate with AI platforms including AWS Bedrock, Azure AI Foundry, Google Vertex AI, OpenAI,
and Anthropic APIs
Build orchestration frameworks and schedulers for evaluation execution workflows
Develop AI risk scoring systems and evaluation pipelines
Design and implement telemetry, monitoring, and observability solutions
Build dashboards and reporting systems for evaluation results and governance insights
Develop integrations/connectors for cloud-native event streams and event-driven architectures
Collaborate with cross-functional engineering teams in an Agile sprint environment
Participate in code reviews, CI/CD setup, and quality engineering practices
Ensure adherence to software development lifecycle and engineering best practices
Services you might be interested in
We Search & Apply Jobs for You!
Our team scans through 1000s of opportunities and applies to roles best suited to your profile
Save 100+ hours and focus on what matters - cracking interviews and landing offers.
