AWS Solution Architect

Role Overview

We are looking for a highly skilled AWS Solution Architect with deep experience in designing and optimizing scalable, compute-intensive, event-driven architectures .

Key Responsibilities

1. Architecture & System Modernization

• Own the redesign of the Truscan backend architecture:
• Multi-stage compute pipeline (Stage 14)
• High-performance Python workers (Blender, Open3D, CV, ML pipelines)
• RabbitMQ or AWS-native event orchestration
• Build an event-driven, scalable system architecture leveraging:
• AWS ECS Fargate / EKS for isolated compute
• AWS Lambda where applicable
• AWS Step Functions for orchestration
• AWS SQS/SNS as queueing alternatives to RabbitMQ
• Introduce horizontal scaling patterns for heavy Blender/Python workloads.

2. Performance Engineering

• Analyze slow-running compute code and provide architectural solutions:
• Worker isolation
• Parallel multi-processing
• Concurrency throttling
• Memory and CPU right-sizing
• Recommend improvements in Python, Blender, Open3D runtimes to reduce Stage 3 times (goal: 50% reduction ).

3. DevOps & CI/CD Engineering

• Establish full CI/CD pipelines using:
• AWS CodePipeline / GitHub Actions
• Dockerized environments for Python compute
• Automated deployments for Java Spring Boot + Python services
• Implement AWS-native observability:
• CloudWatch Logs
• Application Insights
• AWS X-Ray for traceability
• Prometheus/Grafana for performance dashboards (optional)

4. Security, Governance & Best Practices

• Harden the compute platform with AWS standards:
• VPC design (private subnets, NAT, security groups)
• Secrets Manager / Parameter Store
• IAM roles with least-privilege access
• Migrate static configs to AWS-managed secure storage.

5. Reliability, Fault Tolerance & Scaling

• Design fault-tolerant workers for handling:
• Failed scans
• Retries
• Idempotent processing
• Large file handling (USDZ, PNG, GLB)
• Implement S3 tiered storage & lifecycle policies for compute data.

6. Collaboration & Leadership

• Work directly with Java, Python, ML, and DevOps teams.
• Translate business performance goals (SLA improvement, throughput increase) into concrete technical plans.
• Provide sprint planning guidance and architectural documentation.

Required Skills & Experience

1. Core AWS Expertise

Must-have production experience with:

• ECS (Fargate), EKS, EC2 Autoscaling
• S3, Lambda, API Gateway
• Step Functions
• SQS/SNS
• CloudWatch, X-Ray, CloudTrail
• VPC, Subnets, NAT, SGs
• AWS Secrets Manager / Parameter Store
• IAM design

2. High-Performance Compute Experience

• Expert in running compute-heavy workloads (3D processing, ML workflows, or large image pipelines).
• Experience with containerized Blender/Open3D , GPU/CPU optimization, or similar pipelines.

3. Strong Python & Java Background

• Enough understanding to review and guide improvements in:
• Python multi-processing
• Asynchronous compute workers
• Java Spring Boot schedulers, producers, queue consumers
• File-locking, message-driven architecture

4. DevOps & Automation

• Docker, GitHub Actions, AWS CodeBuild, CodePipeline
• Infrastructure-as-Code: CloudFormation or Terraform
• Monitoring & alerting design

5. Architecture Skills

• Event-driven design patterns
• Microservices architecture
• Race-condition and concurrency safety
• Distributed locks, queues, idempotent consumers
• Circuit breaker, retry strategies