Staff Software Engineer, Machine Learning
Discord
PythonPyTorchTensorflow
Senior Machine Learning Engineer
Informa
full-time
Posted on:
Location Type: Remote
Location: Remote • New York • 🇺🇸 United States
Visit company websiteSalary
💰 $110,000 - $140,000 per year
Job Level
Senior
Tech Stack
AWSJenkinsLinuxPythonShell ScriptingSparkSQLYarn
About the role
- Manage and support ML and AI model lifecycle using Databricks and MLflow: training, tracking, packaging, deployment, monitoring, agentic AI safety and generative AI guardrails.
- Automate and optimize model deployment pipelines for batch and real-time use cases.
- Collaborate with data scientists to productionize models, ensuring scalability, reproducibility, and reliability.
- Implement CI/CD pipelines for ML and AI workflows, including testing, version control, and rollback strategies.
- Monitor deployed models for performance drift, data quality, and SLA adherence.
- Support governance and compliance requirements: model registry usage, auditability, reproducibility).
- Troubleshoot and resolve issues related to model training, deployment, and integration with downstream systems.
- Provide operational support for Databricks Workflows, Jobs, and Delta Lake integration.
- Document processes, automation frameworks, and operational runbooks.
- Bring best practices to bear on the team’s products and educate the team members.
Requirements
- Strong hands-on experience with Databricks (Workflows, Delta Lake, MLflow)
- Proficiency with MLflow for experiment tracking, model registry, and deployments
- Experience deploying models to Databricks Model Serving, REST APIs, or external endpoints
- Familiarity with Python, Spark, and SQL for data and ML workflows
- Solid understanding of CI/CD tools (e.g., Databricks Asset Bundles, Jenkins, etc.)
- Competency with shell scripting in a Linux environment nice to have
- Exposure to contemporary big data and AI stacks and technologies. Typical examples include things such as Yarn, AWS, Spark, Databricks, distributed computing, chatGPT, Claude, Copilot. but this is not an exclusive list.
- Some experience with real-time processing nice to have
- Solid understanding of data structures and algorithms
- Some experience with production support
- Experience with 3rd party marketing clouds (such as Salesforce) nice to have
- Self–discipline and willingness to learn
- Solid verbal and written communication skills
- Team player and ability to work well with others in an intellectually challenging environment.
Benefits
- Competitive benefits, including a range of Financial, Health and Lifestyle benefits to choose from
- Flexible working options, including home working, flexible hours and part time options, depending on the role requirements – please ask!
- Competitive annual leave, floating holidays, volunteering days and a day off for your birthday!
- Learning and development tools to assist with your career development
- Work with industry leading Subject Matter Experts and specialist products
- Regular social events and networking opportunities
- Collaborative, supportive culture, including an active DE&I program
- Employee Assistance Program which provides expert third-party advice on wellbeing, relationships, legal and financial matters, as well as access to counselling services
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ML lifecycle managementmodel deploymentCI/CD pipelinesPythonSparkSQLshell scriptingdata structuresalgorithmsreal-time processing
Soft skills
self-disciplinewillingness to learnverbal communicationwritten communicationteam playercollaborationproblem-solvingeducational skillsoperational supportbest practices implementation
