⋮IWConnect

Senior Data Engineer

⋮IWConnect

full-time

Posted on:

Location Type: Hybrid

Location: Bitola • North Macedonia

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowAWSAzureCloudETLGoogle Cloud PlatformGrafanaKafkaPrometheusPySparkPythonSparkSQLTerraformUnityVault

About the role

  • Drive end-to-end data‐platform projects, from requirement workshops to production hand-over, using Databricks, Microsoft Fabric, Snowflake, and associated cloud services.
  • Build and optimize ETL/ELT pipelines (batch, micro-batch, and true real-time) with Python/PySpark, dbt, Airflow, Kafka/Flink, and cloud-native tools.
  • Automate deployment of data stacks via Git-based CI/CD, observability, and cost-controls at every stage.
  • Implement data-governance controls (GDPR-compliant PII handling, lineage, quality tests) using Unity Catalog, Purview, or Fabric’s governance layer.
  • Mentor mid-level engineers, codify best practices, and contribute to architecture standards and run books.
  • Troubleshoot production workloads, continually improve performance, document models, dictionaries, and run books for stakeholders.

Requirements

  • 5+ years in data engineering, with at least 3 years in a cloud environment (AWS, Azure, or GCP).
  • Expert knowledge of data-warehouse modeling concepts (star/snowflake, Data Vault, lakehouse).
  • Hands-on experience with Databricks (Spark/Delta Live Tables), Microsoft Fabric (OneLake, Data Pipelines), or Snowflake, including performance tuning and cost optimization.
  • Proven track record building both batch and streaming pipelines.
  • Strong Python and SQL.
  • Solid grasp of CI/CD (GitHub Actions, Azure DevOps, or similar) and Infrastructure-as-Code (Terraform or CloudFormation).
  • Familiarity with DataOps, observability (Great Expectations, Monte Carlo, Prometheus/Grafana), and security best practices.
  • Certifications in any major cloud or Databricks/Snowflake platforms.
  • Experience designing data pipelines that power GenAI solutions.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
PythonSQLETLELTData Warehouse ModelingDataOpsInfrastructure-as-CodePerformance TuningCost OptimizationStreaming Pipelines
Soft skills
MentoringTroubleshootingDocumentationBest Practices
Certifications
Cloud CertificationsDatabricks CertificationSnowflake Certification