
Senior Data Engineer
Clarity (formerly Anecdote)
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇬🇧 United Kingdom
Visit company websiteJob Level
Senior
Tech Stack
AWSCloudDockerETLGoogle Cloud PlatformKubernetesPythonSQL
About the role
- Integrate and Scale: Extend, scale, monitor, and manage our ever-growing pile of 100s of integrations. Ensure they are reliable and responsive.
- Own the Integrations: Implement new connections and be the master and owner of these integrations.
- Optimize AI Pipelines: Ensure our AI pipeline works like clockwork. Improve and support its complex infrastructure.
- ML Experience: Practical experience with ML, including classification, clustering, time series forecasting, and anomaly detection. You need to know the concept and be handly with the most common libraries.
- Model Hosting and Monitoring: Host and monitor NLP models and LLM for real-time and batch inference.
- Develop Monitoring Systems: Create and support robust models for monitoring.
- Support and Innovate: Assist with a long tail of super important tasks, bringing innovative solutions to the table.
Requirements
- Python Proficiency: Strong Python skills with experience in building and monitoring production services or APIs. Experience with third-party APIs is essential.
- Data Pipelining: Experience with SQL, ETL, data modeling. Experienced with the lifecycle of building ML solutions.
- Speak AI language: Understand the fundamentals of ML/AI and communicate effectively with AI and Data Scientists.
- Infra: Deep Knowledge of Docker, Git, cloud networking, and cloud security for services and infrastructure. Experience with Kubernetes (K8S) is a plus.
- Cloud Expertise: Familiarity with AI infrastructure on AWS and GCP, including Sagemaker, Vertex, Triton, and GPU computing.
- Bonus Points: Experience with Airbyte is a significant advantage.
Benefits
- Fully Remote: Freedom to work from anywhere in the world with flexible core working hours.
- In-person Meetups and Regular Team-building Remote Events: Enjoy in-person meetups and monthly game sessions for team bonding.
- Generous Vacation: Benefit from our comprehensive vacation policy.
- Growth Opportunities: Access continuous professional development and growth support.
- Dynamic Culture: Be part of a vibrant, inclusive, and energetic company culture.
- Stock Options: Participate in our stock options program in this early-stage, fast-growing startup.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonMachine LearningNLPETLSQLData ModelingDockerKubernetesCloud SecurityAI Pipelines
Soft skills
CommunicationProblem SolvingInnovationCollaboration