Senior Data Engineer

Blue Orange Digital

Senior Data Engineer designing and building data ingestion and transformation pipelines for a consultancy specializing in data solutions. Collaborating on enterprise-level projects with a focus on Microsoft technologies.

Posted 5/28/2026full-time🇺🇸 United StatesSenior💰 $6,200 - $8,500 per monthWebsite

Tech Stack

Tools & technologies

AzureERPPySparkSQL

About the role

Key responsibilities & impact

Design and implement Bronze-layer ingestion pipelines from regional ERP systems, CTRM instances (including Irely), and SAP S/4HANA source feeds into OneLake using Microsoft Fabric Data Factory.
Build Silver-layer transformation logic in Fabric notebooks using PySpark and SQL against Delta Lake tables, covering data cleansing, standardization, deduplication, and business rule application.
Develop Gold-layer data product tables serving Trader P&L, Global Position, VaR risk metrics, and Financial Consolidation reporting domains.
Implement and maintain the OneLake medallion architecture following BOD design standards and engagement coding conventions.
Perform schema design, data modeling, and query performance optimization across Fabric Lakehouse and Warehouse layers.
Collaborate with the Analytics/Power BI Specialist to publish clean, analytics-ready Gold-layer outputs aligned to semantic model requirements.
Participate in code reviews, enforce development standards, and contribute to CI/CD pipeline configuration for the Fabric workspace.
Work with client-side Fabric/Azure data engineers as a technical peer—aligning on ingestion patterns, shared schemas, and pipeline governance.

Requirements

What you’ll need

7+ years of data engineering experience with a strong portfolio of end-to-end pipeline implementations.
Hands-on proficiency with Microsoft Fabric (OneLake, Lakehouse, Notebooks, Data Factory, Warehouse)—the full core stack for this engagement.
Strong SQL and PySpark skills with production-level experience building and maintaining Delta Lake pipelines.
Experience building multi-hop pipelines across Bronze/Silver/Gold medallion architectures.
Familiarity with ERP or CTRM source system integration (SAP S/4HANA or similar strongly preferred).
Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent experience).

Benefits

Comp & perks

Health insurance
Professional development opportunities

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data engineeringpipeline implementationSQLPySparkdata cleansingdata modelingquery performance optimizationschema designCI/CD pipeline configurationdata transformation