Uses LLMs, prompt chains, and AI agents to build production workflows and evals—heavy vibe-coding with prompt engineering and rapid prototyping.
About the Role
Founding Applied AI Lead to design and own LLM-driven agents and workflows that automate prior authorizations and appeals for medical devices and diagnostics; translate complex payer rules and clinical records into reliable, testable AI behavior and work closely with product, engineering, and customers to deploy solutions in a hybrid Toronto/NYC team.
Job Description
Role
Paxos Health is hiring a hands-on Founding Applied AI Lead to design and own AI agents, prompt chains, structured-output schemas, evals, and workflow specs that turn payer rules, clinical records, and unstructured documents into reliable prior authorizations and appeals used by customers.
Key Responsibilities
- Design and improve AI workflows: own prompt chains, agent patterns, structured-output schemas, evals, and test cases that power customer implementations.
- Translate reimbursement complexity (payer rules, document requirements, clinical evidence standards, edge cases) into testable workflow logic and decision rules.
- Own AI quality and reliability: analyze failures, improve prompts/schemas, and build evals and test plans to prevent production issues.
- Work directly with customers during implementation to clarify requirements and convert learnings into reusable capabilities.
- Document systems: write workflow specs, prompt/eval documentation, implementation notes, and test plans for engineering and operations.
Requirements
- Minimum 2+ years of relevant work experience in technical implementation, AI operations, software technical writing, software engineering, technical customer success, or related roles.
- Active experimentation with LLMs and a strong belief in AI’s role in operations.
- Strong written and verbal communication in English.
- Extreme attention to detail and the ability to notice edge cases and quality issues.
- Comfortable interacting directly with enterprise customers.
- High ownership and ability to operate in a fast-moving startup with evolving processes.
- Comfortable with or able to quickly learn technical building blocks such as JSON, structured outputs, low-code workflow tools, and lightweight scripting; able to prototype, test, and debug AI workflows (production coding is not required).
Nice to have
- Experience building LLM agents, automations, prompt chains, or AI workflows for work or side projects.
- Experience writing technical specs, implementation docs, workflow documentation, or test plans.
- Experience with structured data, JSON, APIs, low-code tools, workflow builders, or lightweight scripting.
- Experience designing or maintaining evals, QA processes, or test cases for AI reliability.
- Background in early-stage startups or high-ownership environments.
- Experience with document-heavy, regulated domains such as healthcare, legal, fintech, insurance, or compliance; or direct experience with healthcare operations, reimbursement, prior authorizations, appeals, RCM, insurance, or clinical documentation.
Location & Working Model
This posting is for the Toronto location. Candidates should be based near New York City or Toronto or willing to relocate. This is an in-person / hybrid role requiring a minimum of 3 days per week in the office.
Compensation
- Salary range: CA$110,000–CA$200,000, calibrated to candidate level.
- Very generous equity package.
- Canadian employees are hired through an employer-of-record partner and receive benefits through that platform, including supplemental health coverage.
Team & Culture
Early-stage startup environment with high ownership, rapid iteration, and cross-functional collaboration across product, engineering, AI, and customer implementation.