Login Sign Up

Python Automation Engineer

LeadSoc Technologies Pvt Ltd

2 - 5 years

Bengaluru

Posted: 21/05/2026

Getting a referral is 5x more effective than applying directly

Job Description

Key Responsibilities:

AI/ML Validation & Quality Ownership on Ubuntu & Yocto OS Variants

Lead the Team & Exeuctie validation efforts for complex AI/ML compute stacks across multiple platforms and environments

Define, develop, and execute comprehensive validation plans, test strategies, and methodologies for AI software and system pipelines

Own the defect lifecycle, including reporting, triage, root cause analysis, and closure

Ensure validation coverage across functional, performance, stress, regression, and scalability testing

End to End AI Pipeline Validation

Validate end to end AI workflows, including:

Validate end to end ROCmLibraries

o Model training, conversion, and optimization (e.g., PyTorch ONNX)

o Inference runtimes (ONNX Runtime, TensorRT, ROCm/HIP, OpenVINO)

o Compilers and toolchains (TVM, Vitis AI, XDNA, XLA)

o Kernel execution, memory transfers, and inference accuracy

Validate correctness, stability, and performance of AI workloads on Linux based environments (Ubuntu, Yocto)

AI Benchmarking, Profiling & Optimization

Define and execute AI benchmarking strategies for training and inference workloads across hardware platforms

Perform performance profiling and analysis of AI models to identify compute, memory, and latency bottlenecks

Collaborate with compiler, runtime, and hardware teams to drive model level and system level optimizations

Validate performance improvements across model architectures, batch sizes, precision modes (FP32, FP16, INT8), and execution paths

Ensure performance regressions are detected early and performance KPIs are met for production releases

ML Frameworks & Compute Stack Expertise

Validate integration, functionality, and performance of AI frameworks including PyTorch, TensorFlow, and ONNX Runtime

Execute and validate AI/ML workloads on compute stacks such as ROCm/HIP, CUDA, OpenCL, and heterogeneous accelerators

Analyze performance impact of framework, compiler, and runtime changes on real world AI models

Automation & Tooling

Design and implement Python based validation and benchmarking frameworks

Develop reusable automation for test execution, benchmarking, profiling, result analysis, and reporting

Drive continuous improvements in validation efficiency, benchmarking scalability, and coverage

Technical Leadership & Collaboration

Work closely with architecture, compiler, runtime, driver, and hardware teams to debug performance and functional issues

Provide technical guidance and mentorship to junior engineers and validation teams

Collaborate effectively with global, cross functional teams across time zones

Communicate validation, benchmarking results, performance risks, and quality metrics clearly to stakeholders


Required Skills & Qualifications:

8 to 12 years Experience in AI Validation & Strong Python & Scripting knowledge

Technical Expertise

Strong background in machine learning fundamentals, including:

o Deep learning

o Large Language Models (LLMs)

o Recommender systems

Strong experience with ROCm concepts and ROCm validation

Hands on experience with AI benchmarking, profiling, and performance optimization of AI models

Prior experience validating AI/ML compute stacks, including:

o HIP, CUDA, OpenCL

o OpenVINO

o TensorFlow / PyTorch integrations

Experience validating end to end AI pipelines, including model conversion, inference runtimes, compilers, kernel execution, and accuracy

Strong Python programming skills for automation, benchmarking, and validation

Experience profiling AI workloads to optimize throughput, latency, and resource utilization

Strong knowledge of Linux environments, specifically Ubuntu and Yocto

Validation, Quality & Process

Strong experience with software validation processes, defect management, and SDLC

Experience with production level quality assurance practices and performance driven validation

Strong focus on test quality, performance coverage, reproducibility, and release readiness

Ability to work independently with strong ownership of deliverables

Soft Skills

Excellent problem solving abilities with a performance driven and analytical mindset

Strong verbal and written communication skills

Proven ability to work effectively with global and cross functional teams

Services you might be interested in

We Search & Apply Jobs for You!

Our team scans through 1000s of opportunities and applies to roles best suited to your profile

Save 100+ hours and focus on what matters - cracking interviews and landing offers.