🔔 FCM Loaded

AI Engineer

Penguin Ai

2 - 5 years

Hyderabad

Posted: 12/02/2026

Getting a referral is 5x more effective than applying directly

Job Description

Penguin Ai: Seeking an AI Engineer to Supercharge Our Healthcare Revolution!


Your Role: Generative AI Builder. LLM Magician. Production Pioneer. AI Architect's Right Hand.

Location: Hyderabad

Type: Full-time, Full-throttle!

Start Date: Immediate joiner preferred


Who We Are: The Penguin Ai Rebellion!

Were not your average AI company and we dont want average teammates. Penguin Ai was founded by healthcare veterans who knew the system needed more than hype and half-baked algorithms. We built an AI platform that actually works in healthcare across Prior Auth, HCC Coding, and all those soul-crushing workflows no one brags about. Our platform is fast to implement (think: 60 days), reduces administrative costs up to 40%, and makes payers look like heroes without writing a line of code.


This is AI for the real world of healthcare. And just to put a fine point on it: powerhouses like Snowflake and AWS don't just partner with anyone. Their trust in our platform speaks volumes about our robust, scalable, and secure technology.

We're growing faster than a penguin on a waterslide and were always on the hunt for customer-obsessed problem-solvers to help our clients unlock the full potential of their AI investments.

This isnt some futuristic sci-fi movie set, this is AI for the real, gritty, essential world of healthcare where speed & data matter.


About the Role: Your Epic Quest as Our AI Engineer!

You are the hands-on builder who brings our AI visions to life! As our AI Engineer, you'll be at the forefront of developing, implementing, and optimizing AI solutions using cutting-edge generative AI technologies. This role is all about getting your hands dirty from building innovative AI applications and integrating complex models to deploying them seamlessly into production. You'll be working side-by-side with our AI architecture team, turning blueprints into groundbreaking realities.

If you thrive on translating abstract ideas into tangible, high-performing AI systems that solve real-world problems in healthcare, then gear up your next great engineering challenge awaits!


Your Day-to-Day Superpowers: What Youll Actually Do:

Your AI Application Architect Superpowers:

  • LLM App Developer: Build and maintain powerful AI-powered applications, wielding LLM APIs from the biggest names (OpenAI, Claude, Gemini, etc.) like a true magician
  • Prompt Engineering Pro: Implement clever prompt engineering strategies and continuously optimize model interactions for peak performance and cost-efficiency
  • Custom AI Workflow Creator: Develop bespoke AI workflows, including advanced Retrieval-Augmented Generation (RAG) systems, pushing the boundaries of what's possible
  • Robust System Builder: Engineer resilient applications with robust error handling, intelligent fallback mechanisms, and precise response validation systems

Your Model Implementation & Fine-tuning Mastery:

  • Open-Source Optimizer: Fine-tune open-source models (like Llama, Mistral) to perfection for specific, high-impact business use cases and domains
  • Training Pipeline Pioneer: Implement cutting-edge training pipelines using modern frameworks (PyTorch, Hugging Face Transformers)
  • Performance Perfectionist: Conduct thorough model evaluation, A/B testing, and relentless performance optimization to ensure our AI is always at its best
  • Versioning Visionary: Master model versioning and experiment tracking, keeping our AI development organized and predictable

Your Production Deployment & Operations Command:

  • Deployment Dynamo: Seamlessly deploy AI models and applications using FastAPI, Docker, and Kubernetes, ensuring smooth transitions from development to production
  • Scalable Microservices Architect: Build scalable microservices architectures for our AI applications, ensuring they can handle immense loads with ease
  • Monitoring Maestro: Implement comprehensive monitoring, logging, and alerting systems for our production AI systems, catching issues before they even become problems
  • Inference Optimizer: Continuously optimize inference performance, latency, and resource utilization, making our AI run faster and more efficiently than ever

Your Integration & Data Engineering Genius:

  • System Integrator: Weave AI capabilities into existing systems and complex workflows, making our AI a seamless part of our customers' operations
  • Data Pipeline Architect: Design and build robust data pipelines for both model training and inference
  • Vector Database Virtuoso: Work expertly with vector databases and embedding systems, unlocking the power of semantic search and knowledge retrieval
  • Caching & Preprocessing Champion: Implement smart caching strategies and efficient data preprocessing pipelines to feed our AI with perfectly prepared data


What We're Looking For: Your AI Engineering Arsenal!

We need someone who embodies a blend of hands-on coding expertise, deep AI knowledge, and a passion for production-grade systems.

Your AI Engineering Experience:

  • ML/Software Engineering Veteran: 3+ years of battle-tested experience in machine learning or software engineering
  • Generative AI & LLM Integrator: 1+ years of hands-on experience integrating and building with generative AI and LLMs
  • Production Deployment Pro: Demonstrated experience deploying robust ML models into production environments

Your Technical Skills:

  • LLM API Expert: Proficiency with LLM APIs and SDKs (OpenAI, Anthropic, Google, etc.)
  • Transformer Tuner: Experience fine-tuning transformer models using Hugging Face, PyTorch, or similar
  • Python Powerhouse: Strong proficiency in Python and modern software development practices
  • Deployment Dynamo: Hands-on experience with FastAPI, Docker, and containerization
  • Kubernetes Commander: Experience with Kubernetes for container orchestration
  • Microservices Architect: Strong knowledge of RESTful API design and microservices architecture

Your Core Competencies:

  • Transformer Architect: Deep understanding of transformer architectures, embeddings, and attention mechanisms
  • Prompt Engineering Guru: Expertise in prompt engineering and model optimization techniques
  • MLOps Familiar: Familiarity with MLOps practices and tools (model versioning, monitoring, CI/CD)
  • Debugging Detective: Strong debugging and troubleshooting skills
  • Distributed Systems Dynamo: Ability to work effectively with large-scale data and distributed system




Bonus Points: Your Secret Weapons!

  • You've launched healthcare AI or automation products at scale
  • You've not just survived but thrived in the beautiful chaos of a high-growth startup
  • Have a knack for vector databases (Pinecone, Weaviate, Chroma, etc.) and RAG implementation
  • Are familiar with model quantization and optimization techniques
  • Have experience with cloud platforms (AWS, GCP, Azure) and their AI services
  • Have built streaming and real-time AI applications
  • Possess knowledge of AI safety and responsible AI practices
  • Have expertise in specific domains like NLP or computer vision


The Culture Fit: Join Our Colony!

You'll waddle with us if:

  • You like your coffee with a side of delightful chaos.
  • You're fuelled by complexity and obsessed with delivering amazing results.
  • You want to build something that fundamentally transforms healthcare, not just tweaks it around the edges.
  • You believe implementation isnt a handoff; its the start of an epic, trusted partnership!


Education & Qualifications:

A Bachelor's degree in Computer Science, Engineering, Data Science, or a related field


Comp & Perks: Because Even Superheroes Need Support!

  • Competitive salary : We reward your ingenuity!
  • Group Medical Insurance : Keep you healthy and smiling.
  • Generous vacation policy and company holidays: Recharge and conquer!
  • A front-row seat in one of healthcare's most exciting AI companies witness history in the making!

Services you might be interested in

Improve Your Resume Today

Boost your chances with professional resume services!

Get expert-reviewed, ATS-optimized resumes tailored for your experience level. Start your journey now.