Senior Data Engineer
Uses AI coding assistants and supports Generative AI/LLM pipelines; mentions enterprise GenAI (beyond simple vibe-coded prototypes).
About the Role
The Senior Data Engineer will design and build scalable data pipelines and models to support analytics, machine learning, and real-time data exchange with enterprise partners. You will own critical components of the data platform, drive CI/CD and monitoring practices, and mentor junior engineers to bridge execution and architecture.
Job Description
Role
The Senior Data Engineer at Bestow designs and builds robust, scalable data pipelines and data models to support reporting, modeling, machine learning, and real-time data exchange with internal teams and enterprise partners. This role balances hands-on execution with architectural ownership, mentorship of junior engineers, and production reliability.
Team
The Data Engineering team works across the company with analytics, data science, and engineering to improve platform integrations, data architecture, and delivery of data science predictions and products.
Key Responsibilities
- Design and build solutions for transferring data between first- and third-party applications and the data warehouse.
- Architect industry-standard data exchange patterns including push delivery, cloud, and event-driven methods (API, gRPC).
- Support partner integrations and recommend improvements for platform configurability.
- Promote shared, defensible design decisions and high collaboration across teams.
- Champion test-first design and high test coverage for pipelines and data models.
- Develop hardened, repeatable CI/CD data models and pipelines for reporting, modeling, and ML.
- Ensure data quality with automated monitoring, alerting, and participate in on-call rotations as needed.
- Leverage GCP services and orchestration tools to deploy data workloads to production.
- Drive and support MLOps and enable Generative AI/LLM pipelines for internal prototyping and product rollout.
Requirements
- 6+ years in data engineering supporting internal and external product use cases.
- 4+ years designing end-to-end data pipelines in cloud frameworks (GCP, AWS, Azure).
- 4+ years of Python experience producing efficient, testable, readable code.
- 2+ years building streaming data ingestion pipelines.
- 1+ year supporting ML or MLOps implementations.
- Advanced SQL expertise with columnar warehouses and performance tuning (BigQuery, Snowflake, Amazon Redshift).
- Deep cloud-native experience (GCP preferred) including Cloud Run, Pub/Sub, BigQuery, containerization (Docker/Kubernetes).
- Expert-level knowledge of Apache Airflow for orchestration, including DAG optimization and custom operators.
- Experience building CI/CD for data processing (examples: Docker, CircleCI, dbt, git).
- Infrastructure-as-code experience (Terraform or Pulumi).
- Experience creating alerts and monitoring for data governance and familiarity with IAM and standard IT security practices.
- Demonstrated experience with AI coding assistants and supporting GenAI/LLM pipelines.
Nice to Have
- Experience building enterprise-grade Generative AI integrations.
- Familiarity with data contracts, data lakes, and API development.
Tech & Tools (examples)
GCP (Cloud Run, Cloud Functions, Vertex AI, App Engine, Cloud Storage, Pub/Sub, IAM), Astronomer, Apache Airflow, Python, BigQuery, Snowflake, Amazon Redshift, Docker, Kubernetes, CircleCI, dbt, git, Terraform, Pulumi, gRPC, APIs, LLMs and AI coding assistants.
Benefits
- Competitive salary and equity
- Flexible remote/hybrid work and work-from-home options
- 100% employer-paid premium option for medical, dental, and vision insurance
- Flexible paid time off and parental leave programs
- Lifestyle stipend
- Remote-friendly with a Dallas Deep Ellum office option
- Employee-led DEI initiatives
Compensation
Compensation Range: $134,500 - $158,500