Senior AI/ML Engineer

Fidelity Investments

Senior AI/ML Engineer building core AI/ML services and solutions at Fidelity. Collaborating with Data Scientists and engineering high-quality, scalable cloud solutions.

Posted 6/18/2026full-timeBoston • Massachusetts, New Jersey, North Carolina • 🇺🇸 United StatesSenior💰 $107,000 - $216,000 per yearWebsite

Tech Stack

Tools & technologies

KubernetesNoSQLPythonSQL

About the role

Key responsibilities & impact

Build the core AI/ML services running in Kubernetes and locally in 'Playground' mode
Design clean abstractions over vector databases and multistep Search/Information Retrieval pipelines
Own automated real-time data ingestion for RAG: connectors, streaming pipelines, chunking/embedding strategies, parallel processing, retrieval metrics, resilience and restartability while guaranteeing ACID integrity of processed data and elimination of redundant document processing.
Ship developer-friendly APIs/SDKs, CLIs, and templates that make it trivial to develop agents, tools, and information retrieval pipelines at enterprise scale.
Instrument everything: distributed tracing for services and agentic/tool sessions, retrieval quality metrics, performance metrics, resource usage and failure forensics.
Turn rapid prototypes into resilient systems—pragmatic designs that are simple to use, which scale in hardware efficient manner, and above all as simple as possible.
Read and distill open-source frameworks, keep what’s valuable, replace the bloated with lean, well engineered Python modules.

Requirements

What you’ll need

Strong Python service engineering: sound OOP, clear interfaces, thorough tests, and an obsession with readability and maintainability.
Real-world performance tuning across services and data stores: concurrency, async I/O, queues, caching, SQL/NoSQL indexing, pagination, and backpressure.
Experience building event-driven systems and/or real-time pipelines for ingestion and inference.
Mastery of debugging complex, distributed behavior—reproducible experiments, simulations, and evidence-driven conclusions.
Comfort reading open-source code and producing simplified alternatives to minimize code legacy and cognitive load.
Effective use of developer-assist tools to amplify output while keeping quality high and code bloat at minimum.
Produce services metrics that help us understand parallelism services can support in stable fashion, ensuring efficient hardware utilization.
Familiarity with key Data Science, Machine Learning, or AI libraries is a bonus, but not mandatory, as long as the candidate can demonstrate the ability to quickly learn new concepts and paradigms.

Benefits

Comp & perks

comprehensive health care coverage and emotional well-being support
market-leading retirement
generous paid time off
parental leave
charitable giving employee match program
educational assistance including student loan repayment, tuition reimbursement, and learning resources to develop your career

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonOOPreal-time data ingestionevent-driven systemsperformance tuningSQLNoSQLdistributed tracingdebuggingdata processing

Soft Skills

readabilitymaintainabilityproblem-solvingattention to detaileffective communicationadaptabilitycollaborationcritical thinkingcreativitytime management