Staff Software Engineer, AI
Focuses on production-grade AI engineering with LLM APIs, RAG, and MLOps—emphasis is on deploying and operating models in production rather than quick prototyping/vibe coding.
About the Role
As a Staff Software Engineer, AI at BlackLine you will develop and refine the company's fin‑tech AI platform by integrating production-grade LLMs, designing scalable AI system architecture, and collaborating with engineering and product teams to deliver AI solutions from prototype to production.
Job Description
Role
As a Staff Software Engineer, AI at BlackLine you will develop and refine the company’s fin‑tech AI platform, integrating best‑in‑class LLMs into production systems and designing scalable AI system architecture. You will report to the VP of Engineering and work closely with engineering and product teams to deliver production-ready AI solutions.
Key Responsibilities
- Utilize leading LLM APIs (OpenAI, Anthropic, Google) to build production solutions from idea to production.
- Integrate AI solutions into existing production processes and collaborate cross-functionally with product and engineering teams.
- Design and implement scalable AI system architecture including model orchestration, caching strategies, and fallback mechanisms.
- Evaluate and adopt new AI technologies and methodologies to advance the platform (WiseLayer and BlackLine initiatives).
- Implement AI system testing, model evaluation, A/B testing of AI features, and production monitoring.
- Work with data pipelines and ETL/ELT processes to support data-intensive AI workflows.
Requirements
- 4+ years of related experience as a Full Stack Software Engineer or similar role developing, shipping, and testing software in an established enterprise.
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Demonstrated production experience with LLM APIs, including handling rate limits, cost optimization, and performance monitoring.
- Experience deploying RAG (Retrieval-Augmented Generation) frameworks in production applications.
- Experience with AI system testing methodologies, model evaluation, A/B testing, and monitoring model performance in production.
- Experience with data pipelines and ETL/ELT processes.
Preferred Qualifications
- Experience with model deployment and MLOps practices.
- Understanding of data privacy and security best practices for AI.
- Knowledge of AI cost optimization and performance tuning.
- Experience with vector databases and embedding systems.
- Strong backend development experience in Java.
- Strong proficiency in front-end technologies (JavaScript, React).
- Experience in fintech or financial services is a plus.
Compensation
- Salary range: USD 193,000 — USD 242,000 per year.