AI Product Manager
Explicitly calls for early adoption of vibe-coding tools and an AI-native workflow; expects using vibe tools to improve automation and model-driven processes.
About the Role
Navigate AI is hiring an AI Accuracy Product Manager to own model evaluation, quality standards, and scalable evaluation pipelines for AI Copilots used in construction. The role partners with Product, Engineering, and GTM teams to define metrics, automate QA workflows, and drive measurable improvements in model precision and reliability at scale.
Job Description
Role
As the AI Accuracy Product Manager, you will own evaluation systems, validation sets, and quality metrics to ensure AI models perform reliably on messy, real-world customer data. You will define what “great” accuracy looks like across products and operationalize processes that turn model performance into dependable customer outcomes.
Key Responsibilities
- Own model evaluation and quality standards across products
- Maintain “golden sets” as the source of truth for accuracy and validation
- Lead initiatives to improve precision, recall, and overall model performance
- Define and track AI performance metrics and client SLAs
- Identify manual QA and data-entry processes and redesign them through automation
- Build scalable, repeatable evaluation pipelines for pilots and active customers
- Capture and analyze real-world model errors and close the feedback loop with Engineering
- Prioritize accuracy issues and partner with engineering to drive continuous improvement
Requirements
- Strong analytical foundation and comfort with data analysis and metrics
- Hypothesis-driven problem solver who understands statistical significance and representative validation datasets
- Bias toward execution, ownership, and delivering results in ambiguous environments
- Technical fluency with data pipelines, model behavior, and ML workflows (coding not required)
- Proficient in SQL
- Early adopter of vibe-coding tools and an AI-native mindset
- Strong communication skills and ability to align Product, Engineering, and GTM teams around quality standards
Preferred Location
- San Francisco (SF) or New York City (NYC) preferred