FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAWSAzureCloudETLMongoDBNoSQLPostgres
About the role
Key responsibilities & impact- Architect for RAG: You’ll design and scale the pipelines for Retrieval-Augmented Generation (RAG), transforming massive volumes of unstructured IT logs and documentation into optimized Vector Embeddings.
- Scale vector infrastructure: You will be responsible for the health and performance of our vector databases (e.g., Pinecone, Milvus, or Weaviate), ensuring sub-second retrieval speeds for agentic reasoning loops.
- Engineer semantic layers: Move beyond simple ETL to build knowledge graphs and semantic layers that provide agents with the necessary context to navigate complex infrastructure puzzles.
- Automate data excellence: Using a keen eye for detail, you’ll build automated data guardrails to detect noise, bias, or PII (Personally Identifiable Information) before it reaches the model, ensuring our AI remains safe and impactful.
- Solve meaningful challenges: Serve as the bridge between raw, messy data sources and deep technical AI work, identifying and resolving quality issues at the source.
- Progress to production: With a well-defined methodology and software engineering prowess, you will build, deploy, and maintain the CI/CD pipelines for our data infrastructure, ensuring that our context window remains fresh and reliable.
Requirements
What you’ll need- Expertise in data mining, data storage and Extract-Transform-Load (ETL) processes
- Experience in data pipelines development and tooling, e.g., Glue, Databricks, Synapse, or Dataproc
- Experience with both relational and NoSQL databases, PostgreSQL, DB2, MongoDB
- Excellent problem-solving, analytical, and critical thinking skills
- Ability to manage multiple projects simultaneously, while maintaining a high level of attention to detail
- Ability to communicate with both technical and non-technical colleagues, to derive and translate technical requirements from business needs
- Professional certification, e.g. Open Certified Technical Specialist with Data Engineering Specialization
- Cloud platform certification, e.g. AWS Certified Data Analytics – Specialty, Elastic Certified Engineer, Google Cloud Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate
- Understanding of social coding and Integrated Development Environments, e.g. GitHub and Visual Studio
- Degree in a scientific discipline, such as Computer Science, Software Engineering, or Information Technology
Benefits
Comp & perks- Flexible working arrangements
- Professional development opportunities
- Well-being programs
- Dynamic hybrid-friendly culture
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Data Pipelines DevelopmentVector EmbeddingsKnowledge GraphsAutomated Data GuardrailsRelational DatabasesNoSQL DatabasesPostgreSQLMongoDBData Quality ManagementData Analysis
Soft Skills
Problem-SolvingAnalytical ThinkingAttention to DetailProject ManagementCommunication Skills
Certifications
Open Certified Technical Specialist with Data Engineering SpecializationAWS Certified Data Analytics – SpecialtyElastic Certified EngineerGoogle Cloud Professional Data EngineerMicrosoft Certified: Azure Data Engineer Associate
