Senior AI Engineer

Abacus Insights

Senior AI Engineer building scalable GenAI platforms for Abacus Insights, which transforms healthcare data for health plans. Architecting AI systems, LLM pipelines, agentic workflows, and data-processing infrastructure while mentoring engineering teams.

Posted 8/4/2026full-timeRemote • Massachusetts • 🇺🇸 United StatesSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in ML/AI engineering, including model development, deployment, and monitoring, with a strong foundation in software engineering principles. Proficient in building scalable systems and collaborating with cross-functional teams to drive AI innovations and improvements.

Highest-signal resume keywords

ML/AI Engineering ExperiencePython ProficiencyDatabricks TechnologiesGenerative AI TechniquesAgile Methodologies

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Machine LearningArtificial IntelligenceData ProcessingModel Fine-TuningFeature EngineeringSoftware DevelopmentTesting Best PracticesCloud ArchitectureSQLTelemetry

Soft Skills

Analytical AbilitiesProblem-SolvingMentoringCommunicationCollaboration

Tools & Technologies

TensorFlowPyTorchMosaic AI GatewaySnowflakeFHIR

Industry Keywords

AgileScrumGenAIAgentic SystemsHealthcare Data

Tech Stack

Tools & technologies

CloudPythonPyTorchSQLTensorflow

About the role

Key responsibilities & impact

Help shape applied AI areas and intelligence features, deploying state-of-the-art AI models and systems for Abacus products and services.
Develop data collection, fine-tuning, and LLM techniques for specific tasks and domains.
Design and implement ML/AI pipelines for preprocessing, feature engineering, training, tuning, and evaluation.
Build scalable backend systems for company-wide GenAI products with logging, telemetry, and evaluation harnesses.
Partner with AI engineers, data engineers, product teams, and other cross-functional stakeholders.
Drive initiatives across AI and data engineering innovation, development productivity, and benchmarking.
Mentor and coach software and AI developers.
Participate in architectural discussions and influence technical decisions.
Identify process improvements for Agile/Scrum teams.
Balance roadmap delivery with interruptions and client escalations, including incident and configuration management.
Communicate architecture, design, and implementation objectives to leadership and teams.
Represent Abacus in customer-facing technical conversations.

Requirements

What you’ll need

3+ years of ML/AI engineering experience in high-velocity, high-growth companies; relevant ML/AI academic research may also be considered.
6+ years of software development experience at some point in the career.
2+ years of experience with Databricks, Mosaic AI Gateway, and associated Databricks technologies.
Strong experience with language modeling, GenAI, generative and embedding techniques, model architectures, fine-tuning/pre-training datasets, evaluation benchmarks, agents, agentic workflows, RAG, SQL agents, and MCP.
Proficiency in Python, TensorFlow/PyTorch, and scalable ML/AI architecture.
Ability to drive end-to-end model and system development from research and prototyping through deployment and monitoring.
Strong coding and software engineering fundamentals, including testing, code review, and deployment best practices.
Experience designing scalable distributed data-processing systems at the 10s–100s of TBs scale.
Track record of leading software development teams or projects toward production-grade systems supporting real customers.
Excellent knowledge of software design, QA, test automation, and Agile methodologies.
Knowledge of cloud architecture, AI architecture, agentic systems, MPP compute frameworks, security, and MCP/API-based services.
Breadth and depth in software and AI development for technical discussions with internal and external stakeholders.
Understanding of adjacent software-development roles including product management, project management, client delivery, and operations.
Strong analytical and problem-solving abilities and interest in AI-driven user experiences.
Bachelor’s degree or equivalent relevant professional experience.
Snowflake experience, FHIR familiarity, and healthcare-data exposure are desirable but not required.

Benefits

Comp & perks

Unlimited paid time off — recharge when you need it.
Work from anywhere — flexibility to fit your life.
Comprehensive health coverage — multiple plan options to choose from.
Equity for every employee — share in our success.
Growth-focused environment — your development matters here.
Home office setup allowance — one-time support to get you started.
Monthly cell phone allowance — stay connected with ease.
Eligibility for performance bonuses
Equity grants