FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and scaling data pipelines for Retrieval-Augmented Generation (RAG) while ensuring data quality and performance through automated processes and CI/CD methodologies. Proficient in both relational and NoSQL databases, with a strong ability to communicate technical requirements effectively across teams.
Highest-signal resume keywords
Data MiningData StorageETL ProcessesCI/CD PipelinesCloud Platform Certification
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipelines DevelopmentVector EmbeddingsKnowledge GraphsAutomated Data GuardrailsRelational DatabasesNoSQL DatabasesPostgreSQLMongoDBData Quality ManagementData Analysis
Soft Skills
Problem-SolvingAnalytical ThinkingAttention to DetailProject ManagementCommunication Skills
Tools & Technologies
PineconeMilvusWeaviateGlueDatabricksSynapseDataprocGitHubVisual Studio
Certifications & Qualifications
Open Certified Technical Specialist with Data Engineering SpecializationAWS Certified Data Analytics – SpecialtyElastic Certified EngineerGoogle Cloud Professional Data EngineerMicrosoft Certified: Azure Data Engineer Associate
Industry Keywords
Retrieval-Augmented GenerationVector DatabasesSemantic LayersData ExcellenceIT LogsAI SafetyData InfrastructureScientific DisciplineComputer ScienceSoftware Engineering
Tech Stack
Tools & technologiesAWSAzureCloudETLMongoDBNoSQLPostgres
About the role
Key responsibilities & impact- Architect for RAG: You’ll design and scale the pipelines for Retrieval-Augmented Generation (RAG), transforming massive volumes of unstructured IT logs and documentation into optimized Vector Embeddings.
- Scale vector infrastructure: You will be responsible for the health and performance of our vector databases (e.g., Pinecone, Milvus, or Weaviate), ensuring sub-second retrieval speeds for agentic reasoning loops.
- Engineer semantic layers: Move beyond simple ETL to build knowledge graphs and semantic layers that provide agents with the necessary context to navigate complex infrastructure puzzles.
- Automate data excellence: Using a keen eye for detail, you’ll build automated data guardrails to detect noise, bias, or PII (Personally Identifiable Information) before it reaches the model, ensuring our AI remains safe and impactful.
- Solve meaningful challenges: Serve as the bridge between raw, messy data sources and deep technical AI work, identifying and resolving quality issues at the source.
- Progress to production: With a well-defined methodology and software engineering prowess, you will build, deploy, and maintain the CI/CD pipelines for our data infrastructure, ensuring that our context window remains fresh and reliable.
Requirements
What you’ll need- Expertise in data mining, data storage and Extract-Transform-Load (ETL) processes
- Experience in data pipelines development and tooling, e.g., Glue, Databricks, Synapse, or Dataproc
- Experience with both relational and NoSQL databases, PostgreSQL, DB2, MongoDB
- Excellent problem-solving, analytical, and critical thinking skills
- Ability to manage multiple projects simultaneously, while maintaining a high level of attention to detail
- Ability to communicate with both technical and non-technical colleagues, to derive and translate technical requirements from business needs
- Professional certification, e.g. Open Certified Technical Specialist with Data Engineering Specialization
- Cloud platform certification, e.g. AWS Certified Data Analytics – Specialty, Elastic Certified Engineer, Google Cloud Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate
- Understanding of social coding and Integrated Development Environments, e.g. GitHub and Visual Studio
- Degree in a scientific discipline, such as Computer Science, Software Engineering, or Information Technology
Benefits
Comp & perks- Flexible working arrangements
- Professional development opportunities
- Well-being programs
- Dynamic hybrid-friendly culture
