Senior Data & AI Engineer – Microsoft Fabric, RAG
Boost IT
full-time
Posted on:
Location Type: Remote
Location: Portugal
Visit company websiteExplore more
Job Level
About the role
- Build and maintain Microsoft Fabric pipelines to ingest, process, and structure data within Fabric workspaces
- Ingest structured and unstructured data using Fabric Shortcuts (ADLS, SharePoint, manuals, procedures, and technical documents)
- Prepare, chunk, and vectorize unstructured content for downstream AI use cases
- Store, manage, and query embeddings using Azure AI Search (vector and hybrid search)
- Design, implement, and continuously improve RAG pipelines for operational AI agents
- Apply prompt engineering best practices to improve accuracy, reliability, and relevance of AI outputs
- Collaborate with data, AI, and product stakeholders to ensure solutions meet production and operational requirements
- Monitor, troubleshoot, and optimize AI pipelines for performance, scalability, and reliability
Requirements
- Strong hands-on experience with Microsoft Fabric (Pipelines, Lakehouse, OneLake, Shortcuts)
- Proven experience building LLM-based RAG systems in production environments
- Practical experience with Azure AI Search, including vector and hybrid search
- Solid understanding of embeddings, document retrieval, and prompt engineering
- Strong programming skills in Python and/or SQL
- Experience designing and maintaining data pipelines and AI systems in real-world environments
- Fluent in English (written and spoken)
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Microsoft FabricPipelinesLakehouseOneLakeShortcutsAzure AI SearchPythonSQLembeddingsprompt engineering
Soft Skills
collaborationtroubleshootingoptimizationcommunication