Principal Engineer – Python API Development

skillventory - A Leading Talent Research Firm

Principal Engineer tackling complex technical challenges in delivering machine learning at Fidelity. Designing and evolving platform capabilities while mentoring engineers and collaborating with data scientists.

Posted 4/29/2026full-timeJersey City • New Jersey, Texas • 🇺🇸 United StatesLead💰 $107,000 - $216,000 per yearWebsite

Tech Stack

Tools & technologies

AWSAzureCloudDistributed SystemsGoogle Cloud PlatformGroovyJavaLinuxPythonTerraform

About the role

Key responsibilities & impact

tackle the most complex technical challenges involved in delivering machine learning at enterprise scale
design, build, and evolve reliable, secure, and cost‑efficient platform capabilities
improve shared services, CI/CD workflows, and infrastructure patterns
technical investigation of performance and scalability issues
analyze system and application metrics
optimize GPU utilization, throughput, and resource efficiency across ML workloads
mentor junior and senior engineers
partner with Data Scientists to package, scale, and operationalize models
advance model/data observability
drive systemic fixes and evolve standards to prevent recurrence
introduce reusable frameworks, paved paths, and CI/CD templates

Requirements

What you’ll need

Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a closely related engineering discipline
8+ years (typically 10+) building and operating production platforms and services at scale
Deep software engineering expertise in Python and distributed systems
Linux fluency and scripting are required
Familiarity with Java or Groovy is a plus
Knowledge or experience with GenAI Gateways or LiteLLM a big plus
Cloud platform leadership (AWS) —hands‑on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS
Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities
Exposure to Azure or GCP is beneficial
DevOps and CI/CD at scale
Infrastructure as Code (CloudFormation, Terraform/OpenTofu)
platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post‑mortems)
Cross‑org technical leadership
Set platform strategy and standards for ML packaging, deployment, serving, and observability

Benefits

Comp & perks

comprehensive health care coverage and emotional well-being support
market-leading retirement
generous paid time off and parental leave
charitable giving employee match program
educational assistance including student loan repayment, tuition reimbursement, and learning resources to develop your career

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Pythondistributed systemsLinuxscriptingGenAI GatewaysLiteLLMAWSSageMakerCloudFormationTerraform

Soft Skills

mentoringcross-organizational leadershiptechnical investigationsystemic problem solvingcollaboration