Senior AI/ML Architect – Conversational AI (100% Remote)

Company Description:

Hyly.AI is the multifamily industrys premier Intelligence Fabric, integrating Artificial, Business, and Human Intelligence into a single system designed to drive operational growth. By transforming raw data into actionable decisions and measurable results, Hyly.AI enables scalable operations without the need for additional resources. Founded in 2010, Hyly.AI has over a decade of experience in simplifying complex processes for multifamily leaders, helping them optimize efficiency and increase ROI. Trusted by 4 out of the top 5 NMHC managers, Hyly.AI empowers teams to focus on building meaningful communities rather than handling repetitive, manual tasks.

Role Description:

We are hiring a Senior AI/ML Architect Agentic Conversational AI (6+ Years Experience | 100% Remote) to own and evolve the end-to-end AI architecture behind Hylys conversational platform. This is a hands-on architectural leadership role for someone with 6+ years of production AI/ML experience, including deep experience in:

LLM orchestration & agentic workflows

Retrieval-Augmented Generation (RAG) Real-time, low-latency serving

Evaluation-driven development

Production observability and rollout safety. You will define how AI systems are designed, measured, deployed, and scaled across multiple channels.

Must Have Qualifications:

• 6+ years of professional AI/ML systems experience.
• 3+ years building conversational AI systems in production.
• Proven experience deploying LLM-based architectures (OpenAI, Claude, Llama/DeepSeek-class).
• Hands-on experience with agentic systems: Tool calling Structured outputs Policy control
• Strong RAG expertise with vector databases and reranking.
• Deep understanding of latency and cost optimization.
• Strong Python skills: experience with async services (Fast API preferred).
• MLOps experience: CI/CD Model & prompt versioning Containers and Kubernetes Feature flags and canary releases
• Strong systems design and cross-team leadership skills.
• Experience with observability in production AI systems.

Job Responsibilities:

Architecture & Platform Ownership

Own the architecture of Hylys agentic conversational platform across chat, voice, SMS, and email.

Define service boundaries, interface contracts, and scalability patterns.

Ensure reliability, modularity, and extensibility.

Agentic Orchestration

Design and evolve the orchestrator layer:

Intent routing

Tool schemas

Policy enforcement

Memory management

Structured outputs

RAG & Knowledge Systems

Build and standardize RAG pipelines:

Hybrid retrieval

Embeddings + reranking

Grounded responses with citations

Performance & Cost Optimization

Optimize real-time inference using:

Keyword & semantic caching

Streaming, batching, prompt compression

Cost/latency trade-off analysis

Evaluation & Quality

Establish eval-driven delivery:

Offline and online benchmarks

Regression detection

Rollout gates tied to business metrics

Ensure AI quality improves continuouslynot just features.

Observability & Reliability

Implement production-grade observability:

Distributed tracing

Error taxonomies

SLOs and alerting

Lead incident response and postmortems.

Leadership & Standards

Mentor engineers and set AI architecture standards.

Define best practices for versioning, rollouts, and documentation.

Partner closely with Product, API, FE, and QA teams.

Nice to Have (Qualifications):

1. Remote Team Management Experience: Experience managing teams in a remote environment, ensuring effective communication and productivity.

2. Cross-Functional Team Leadership: Proven ability to lead cross-functional teams, managing dependencies and ensuring smooth coordination.

3. Strong collaborative development skills using Git and version control systems.