L2 Data Engineer

DeepSource GmbH

L2 Data Engineer responsible for building high-performance data pipelines and cloud-native solutions for advanced analytics. Collaborating with architects and stakeholders in a remote environment.

Posted 5/26/2026full-timeRemote • 🇪🇬 EgyptMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

AzureCloudETLPandasPySparkPythonSparkSQLTerraform

About the role

Key responsibilities & impact

Design, develop, and optimize enterprise-scale data pipelines and ETL/ELT workflows using Azure and Databricks technologies.
Architect and implement scalable data ingestion, transformation, and orchestration processes using Azure Data Factory, Databricks, and Azure Synapse Analytics.
Develop high-performance data transformation frameworks using PySpark, Python, and Spark SQL for large-scale distributed data processing.
Optimize SQL queries, Spark jobs, and data workflows to improve performance, scalability, and cost efficiency.
Lead data migration initiatives, including SQL Server migrations and modernization of legacy data platforms.
Implement and maintain Delta Lake architecture, incremental data loading strategies, and enterprise data lake best practices.
Collaborate with architects and cross-functional teams to design robust and scalable data models aligned with business and governance standards.
Monitor and troubleshoot production pipelines, perform root-cause analysis, and implement preventive measures for recurring issues.
Support CI/CD implementation and infrastructure automation for data engineering workflows.
Mentor junior engineers and contribute to engineering standards, reusable frameworks, and technical best practices.
Create and maintain technical documentation including architecture diagrams, pipeline documentation, and operational runbooks.
Evaluate and recommend modern data engineering tools, frameworks, and optimization strategies.

Requirements

What you’ll need

5+ years of professional experience in Data Engineering or related roles.
Strong expertise in Python for enterprise data processing, transformation, and automation.
Advanced hands-on experience with Pandas, PySpark, and Spark SQL for large-scale distributed processing.
Strong experience with Databricks, including cluster management, notebook development, workflow orchestration, Delta Lake, and performance optimization.
Extensive experience building and managing enterprise data pipelines using Azure Data Factory.
Strong working knowledge of Azure Synapse Analytics, particularly Spark pool integration and enterprise data warehousing concepts.
Advanced SQL skills including query optimization, performance tuning, indexing strategies, and troubleshooting.
Strong understanding of data lake architecture, Delta Lake, incremental processing, partitioning, and lakehouse concepts.
Experience implementing data governance, security, access controls, and monitoring within cloud data platforms.
Experience handling production support, troubleshooting, and optimization of enterprise data platforms.
**NICE TO HAVE**
Experience with Terraform for Azure infrastructure provisioning and Infrastructure-as-Code (IaC).
Experience implementing CI/CD pipelines for data engineering deployments.
Exposure to Lakehouse Federation, Delta Sharing, and modern data sharing architectures.
Experience with streaming and near real-time data processing solutions.
Knowledge of DevOps practices and cloud cost optimization strategies.
**CERTIFICATION REQUIREMENT**
Candidates are expected to hold or be actively working toward the Databricks Certified Data Engineer Professional certification. This certification validates advanced expertise across the following domains:
Advanced ETL and ELT development using Spark SQL and PySpark
Enterprise-grade pipeline orchestration and optimization
Data modeling and scalable lakehouse architecture
Performance tuning and distributed data processing optimization
Advanced data governance and security implementation
Production-grade data engineering practices within the Databricks ecosystem

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account DeepSource GmbH Website LinkedIn All Job Openings 1 - 10 employees DeepSource stands as a trusted partner for businesses seeking cutting-edge AI services in computer vision, natural language processing, and predictive analytics. With a particular focus on Arabic NLP and ChatGPT bot development, DeepSource is dedicated to empowering companies with groundbreaking solutions that streamline operations, optimize workflows, and enhance user experiences. Our commitment to excellence is evident in our approach to addressing a wide range of AI needs, from hiring top talent and managing end-to-end AI projects to providing tailored consulting and comprehensive training programs. DeepSource's team of experts is equipped with extensive knowledge and experience in various AI technologies, which enables them to develop and deploy advanced solutions across multiple industries. Our adaptive strategies and innovative methodologies allow businesses to stay competitive in today's rapidly evolving digital landscape. L2 Data Engineer 🔥 0 minutes ago 🇪🇬 Egypt – Remote ⏰ Full Time 🟡 Mid-level 🟠 Senior 🚰 Data Engineer Azure Cloud ETL Pandas PySpark Python Spark SQL Terraform Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Design, develop, and optimize enterprise-scale data pipelines and ETL/ELT workflows using Azure and Databricks technologies.
Architect and implement scalable data ingestion, transformation, and orchestration processes using Azure Data Factory, Databricks, and Azure Synapse Analytics.
Develop high-performance data transformation frameworks using PySpark, Python, and Spark SQL for large-scale distributed data processing.
Optimize SQL queries, Spark jobs, and data workflows to improve performance, scalability, and cost efficiency.
Lead data migration initiatives, including SQL Server migrations and modernization of legacy data platforms.
Implement and maintain Delta Lake architecture, incremental data loading strategies, and enterprise data lake best practices.
Collaborate with architects and cross-functional teams to design robust and scalable data models aligned with business and governance standards.
Monitor and troubleshoot production pipelines, perform root-cause analysis, and implement preventive measures for recurring issues.
Support CI/CD implementation and infrastructure automation for data engineering workflows.
Mentor junior engineers and contribute to engineering standards, reusable frameworks, and technical best practices.
Create and maintain technical documentation including architecture diagrams, pipeline documentation, and operational runbooks.
Evaluate and recommend modern data engineering tools, frameworks, and optimization strategies. 🎯 Requirements
5+ years of professional experience in Data Engineering or related roles.
Strong expertise in Python for enterprise data processing, transformation, and automation.
Advanced hands-on experience with Pandas, PySpark, and Spark SQL for large-scale distributed processing.
Strong experience with Databricks, including cluster management, notebook development, workflow orchestration, Delta Lake, and performance optimization.
Extensive experience building and managing enterprise data pipelines using Azure Data Factory.
Strong working knowledge of Azure Synapse Analytics, particularly Spark pool integration and enterprise data warehousing concepts.
Advanced SQL skills including query optimization, performance tuning, indexing strategies, and troubleshooting.
Strong understanding of data lake architecture, Delta Lake, incremental processing, partitioning, and lakehouse concepts.
Experience implementing data governance, security, access controls, and monitoring within cloud data platforms.
Experience handling production support, troubleshooting, and optimization of enterprise data platforms.
**NICE TO HAVE**
Experience with Terraform for Azure infrastructure provisioning and Infrastructure-as-Code (IaC).
Experience implementing CI/CD pipelines for data engineering deployments.
Exposure to Lakehouse Federation, Delta Sharing, and modern data sharing architectures.
Experience with streaming and near real-time data processing solutions.
Knowledge of DevOps practices and cloud cost optimization strategies.
**CERTIFICATION REQUIREMENT**
Candidates are expected to hold or be actively working toward the Databricks Certified Data Engineer Professional certification. This certification validates advanced expertise across the following domains:
Advanced ETL and ELT development using Spark SQL and PySpark
Enterprise-grade pipeline orchestration and optimization
Data modeling and scalable lakehouse architecture
Performance tuning and distributed data processing optimization
Advanced data governance and security implementation
Production-grade data engineering practices within the Databricks ecosystem Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Data Architect 🕒 May 11 Remofirst 11 - 50 👥 HR Tech 📋 Compliance ☁️ SaaS Website LinkedIn All Job Openings Data Architect defining data models and standards for global HR platform. Collaborating with international teams to ensure data quality and consistency in a remote setup. 🇪🇬 Egypt – Remote ⏰ Full Time 🟡 Mid-level 🟠 Senior 🚰 Data Engineer AWS Cloud ETL NoSQL Python SQL Senior Data Warehouse Consultant 🕒 March 31 Robusta Studio 51 - 200 Website LinkedIn All Job Openings Data Warehouse Senior Consultant overseeing Data Warehouse implementations using Microsoft Fabric. Collaborating with vendors and stakeholders to ensure data integrity and quality in a dynamic environment. 🇪🇬 Egypt – Remote ⏰ Full Time 🟠 Senior 🚰 Data Engineer 🗣️🇸🇦 Arabic Required ERP ETL Senior Data Engineer 🕒 November 12, 2025 Unifonic 501 - 1000 🤖 Artificial Intelligence ☁️ SaaS 📡 Telecommunications Website LinkedIn All Job Openings Senior Data Engineer at Unifonic developing data-driven solutions and building the future enterprise Data Lake. Collaborating with the engineering team to enhance data capabilities. 🇪🇬 Egypt – Remote 💰 $125M Series B on 2021-09 ⏰ Full Time 🟠 Senior 🚰 Data Engineer Apache ETL Greenplum Java Kafka Python Scala Spark SQL View More Data Engineer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonPySparkSpark SQLSQLETLELTdata transformationdata ingestiondata orchestrationdata governance

Soft Skills

leadershipcollaborationmentoringtroubleshootingroot-cause analysiscommunicationdocumentation

Certifications

Databricks Certified Data Engineer Professional