Principal Engineer
SAE International
Staff Software Engineer
DataRobot
full-time
Posted on:
Location Type: Remote
Location: Remote • Massachusetts • 🇺🇸 United States
Visit company websiteJob Level
Lead
Tech Stack
AWSAzureCloudDistributed SystemsDockerGoGoogle Cloud PlatformJavaPython
About the role
- Architect, build, and lead backend services that scale to handle large workloads, high concurrency, and low latency requirements.
- Design and implement autoscaling strategies (horizontal/vertical), dynamic resource allocation, and load balancing to ensure responsive, cost-efficient service.
- Improve end-to-end request pipelines, optimizing for latency, throughput, reliability, and correctness.
- Instrument, monitor, and profile systems in production; identify bottlenecks, troubleshoot performance issues, and proactively tune services.
- Collaborate with ML/AI teams to ensure models’ serving pipelines uphold accuracy, consistency, and performance under load.
- Drive best practices in systems reliability, observability, error handling, capacity planning, resilience, and failover.
- Mentor and coach other engineers; provide technical leadership and influence across teams.
- Contribute to defining architecture, coding standards, performance benchmarks, and technical roadmap items related to scalability and performance.
Requirements
- 7+ years of backend engineering experience building scalable, high-performance distributed systems / services.
- Strong experience with performance optimization: e.g. profiling, latency tuning, concurrency, caching strategies.
- Deep experience with autoscaling, resource management, load balancing, throughput/latency SLAs.
- Solid programming skills in one or more backend languages (e.g. Python, Java, Go, C++, or equivalent).
- Strong understanding of observability and monitoring: metrics, tracing, logging; and instrumentation of services.
- Ability to solve ambiguous challenges and influence technical direction across teams, balancing performance, accuracy, and cost.
- Experience operating across multiple cloud providers (AWS, GCP, Azure) and/or hybrid environments.
- Nice to Have: Experience with AI/ML model deployment, serving, inference, and production integration.
- Experience with Gen AI / serving LLMs, embeddings, etc.
- Exposure to on-prem delivery models or regulated environments.
- Experience with Docker and building containerized applications.
Benefits
- Medical, Dental & Vision Insurance
- Flexible Time Off Program
- Paid Holidays
- Paid Parental Leave
- Global Employee Assistance Program (EAP) and more!
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
backend engineeringperformance optimizationautoscalingresource managementload balancingprogramming in Pythonprogramming in Javaprogramming in Goprogramming in C++monitoring and observability
Soft skills
technical leadershipmentoringproblem-solvinginfluencing technical directioncollaboration
Similar jobs on JobTailor
Software Engineer
Patterson Companies, Inc.
Cloud
Senior Engineer – Aerodynamics
GE Aerospace
Principal Software Engineer – Contact Center AI
The Home Depot
AngularCloudJavaJavaScriptjQueryLinuxNode.jsNoSQLPythonReactRubyRuby on Rails+3 more
Senior Full Stack Developer
Monster
AzureJenkinsKubernetes.NETReactSQL