
Lead Data Engineer
Valtech
full-time
Posted on:
Location Type: Remote
Location: Canada
Visit company websiteExplore more
Salary
💰 CA$115,000 - CA$165,000 per year
Job Level
About the role
- Design and own the end‑to‑end medallion data architecture within Microsoft Fabric, including Bronze/Silver/Gold standards, modeling patterns, and governance frameworks.
- Define and drive architectural standards, patterns, and best practices across ingestion, transformation, data modeling, lineage, quality, and orchestration.
- Partner as a peer with the Director of Data & Analytics to shape long-term platform strategy, roadmap, and technical decision-making.
- Anticipate downstream implications of architectural choices, proactively guiding decisions that ensure long-term reliability, scalability, and maintainability.
- Architect and build highly available, distributed, fault‑tolerant data pipelines supporting batch and real‑time workloads.
- Lead the migration and integration of multiple disparate data sources into the new Fabric-based enterprise platform.
- Define data modeling approaches for enterprise‑scale structured, semi‑structured, and unstructured datasets.
- Establish end‑to‑end standards for ingestion → processing → serving layers.
- Tune and optimize distributed processing across large datasets and high-volume pipelines.
- Develop complex transformations and scalable pipelines using SQL, Python, dbt, and Fabric-native tools.
- Implement automation across the Fabric ecosystem leveraging REST APIs, Data Factory, pipelines, and workflow orchestration.
- Guide and mentor engineering teams on advanced data architecture concepts, distributed systems, metadata management, and platform hygiene.
- Conduct root cause analysis on platform issues, driving permanent solutions rather than short-term fixes.
- Act as a senior technical authority in design reviews, architectural discussions, and cross‑functional planning.
- Collaborate with analytics, product, and business stakeholders to understand requirements and translate them into architectural solutions.
- Communicate complex technical concepts clearly to both technical and non‑technical audiences.
Requirements
- 8+ years of experience in data engineering, data architecture, or platform engineering.
- Experience building or migrating enterprise data platforms on Microsoft Fabric.
- Deep expertise with SQL, Python, and distributed data processing.
- Significant experience designing enterprise data architectures and medallion/lakehouse patterns.
- Strong knowledge of modern data platforms — Databricks, Azure Synapse, Microsoft Fabric, Delta Lake, or similar.
- Hands-on experience with cloud-native data engineering (Fabric preferred).
- Expertise building and optimizing large‑scale ETL/ELT pipelines across raw → refined → curated zones.
- Experience with automation and integration using REST APIs.
- Strong analytical thinking, system design skills, and the ability to foresee downstream technical consequences.
- Excellent communication skills and ability to engage as a peer with senior leadership.
- Upper-Intermediate English skills.
Benefits
- 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data architecturedata modelingSQLPythondbtdata pipelinesETLELTREST APIscloud-native data engineering
Soft Skills
analytical thinkingsystem designcommunicationmentoringcollaborationleadership