Annotation Operations - Human QA Lead

About the Role

MicroAGI is building the data infrastructure that will power the next generation of embodied AI systems. We combine Domain Experts + High-Quality Reviewer Pool + Tech Platform to teach AI to reason and act in the physical world. Our globally distributed crowd reviews tens of thousands of hours of first-person video every week, across multiple countries and languages. We are looking for an Annotation Operations Associate/Manager to own the reasoning layer that turns active projects into high-quality delivered data from high-quality commercial environments. You will coordinate across partners, operators, deployment, engineering, and commercial teams to ensure our data annotation programs run on time and scale with high-quality. As models get more capable, the bar on data quality, taxonomy depth, and human judgement only rises. This vertical is one of the most strategic at MicroAGI.

We are looking for an Annotation Operations Lead to own MicroAGI's annotation vertical end-to-end. This is a builder's role you will set the technical blueprint for how we ingest, annotate, QA, and deliver hundreds of thousands of hours of first-person and embodied-AI video data per quarter, with the precision a frontier training stack demands. You will work hand-in-glove with engineering, our partner ecosystem (BPOs, AI annotation companies, skilled-trade networks), and the founders to industrialise what is today still a high-touch operation.

What You'll Do

• Own the annotation operations P&L throughput, quality, unit economics, partner SLAs, contributor retention
• Support deployment of the annotation framework: taxonomy design, golden datasets, performance buckets, consensus thresholds, inter-annotator agreement (Cohen's kappa / Krippendorff's alpha), reviewer onboarding flows
• Contribute towards the optimal review flow number of reviewers per task, AHT targets, sampling rate for QA-of-QA, fraud detection thresholds and treatment
• Industrialise the partner stack onboard, scale, and rationalise BPOs, AI annotation companies, skilled-trade networks (plumbers, electricians, mechanics, chefs and other trades), and direct community networks across India and globally
• Identify and recruit deep domain experts both white-collar (doctors, lawyers, engineers, physicists) and the skilled trades to act as senior annotators, golden-task creators, and arbitration reviewers
• Build the standards stack MSAs, partner intake, standardised payout structures, training material, QC SOPs, escalation paths, fraud playbooks, dataset rotation cadence
• Manage and grow a team of 35 (Manager + Associates today; will scale as the function does); hire and ramp a tier-1 bench of annotators, QA leads, partner managers, and trainers
• Partner with global stakeholders engineering, product, finance, legal to ensure on-time delivery on aggressive sprint goals
• Track and report on a daily cadence throughput, quality, cost per reviewed hour, partner SLAs, fraud alerts, reviewer retention; build the leadership dashboard for the vertical
• Own day-to-day execution of data annotation/quality analysis programs across India and other countries
• Build the playbooks, trackers, QA processes, and reporting systems needed to scale. Deploy these playbooks and processes on-ground to ensure high-quality data is recorded.

Requirements

• 10+ years of experience overall, with 5+ years in annotation / data-labelling / human-in-the-loop QA operations at a top-tier AI data company
• Background in STEM: BS or MS in computer science, maths, physics, etc.
• Demonstrated ability to design and ship operational frameworks from first principles not just operate someone else's playbook
• Experience managing multi-vendor partner ecosystems BPOs, annotation companies, gig networks, community networks
• Strong with numbers, unit economics, and operational data; proficient with SQL or BI tools, Sheets, Notion, Looker / Metabase, dashboards
• Excellent communicator equally credible with engineers, partners, and senior leadership
• High agency moves fast, takes ownership, builds systems out of ambiguity
• Comfortable working across global teams, different time zones, weekends and holidays if need be on-time execution is non-negotiable
• High agency you move fast, take ownership, and don't wait to be told what to do
• Deep understanding of AI and GenAI: technology and market trends, basic knowledge of statistics, ML and data science

Strong Plus

• Built and scaled an annotation function from 0 to 1 at a high-growth AI lab or data-services company
• Preferred background from top-tier institutions such as the IITs, NITs, or IIMs or startup accelerator programs or entrepreneurial experience
• Familiarity with sales, operations, project management and analytics
• Preferred educational background from top-tier institutions such as the IITs, NITs, or IIMs
• Experience in AI data operations, marketplace operations, gig-economy, robotics, trust and safety operations, or logistics-heavy environments
• Experience coordinating distributed teams or large contractor workforces
• Experience building processes from scratch in ambiguous, fast-moving environments

Why join microagi?

This role is ideal for a professional eager to gain experience in a high-growth, innovative environment in an industry growing at exponential speed. Youll work closely with experienced leaders who are shaping , develop a deep understanding of operations in physical AI, and make a meaningful impact from day one.