Cookie Information

Senior Data Engineer

Cookie Information

full-time

Posted on:

Location Type: Hybrid

Location: Matosinhos • 🇵🇹 Portugal

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AWSAzureCloudETLGoogle Cloud PlatformPySparkPythonSparkSQL

About the role

  • Design end-to-end Lakehouse architectures (Bronze/Silver/Gold) using Databricks and Delta Lake.
  • Define reference architectures for batch, streaming, and near-real-time workloads.
  • Ensure scalability, security, cost optimization, and high availability across environments.
  • Build and optimize ETL/ELT pipelines using Spark (PySpark / SQL).
  • Implement ingestion from APIs, event streams, files, databases, and message brokers.
  • Define data quality rules, validation frameworks, and monitoring.
  • Integrate Databricks with cloud services (Azure, AWS and GCP).
  • Enable model curated datasets for BI, analytics, and ML use cases.
  • Act as technical lead for data engineering teams.

Requirements

  • Expert knowledge of Microsoft’s BI stack, namely Azure SQL Database/Azure Synapse, Azure Analysis Services, ADF, Databricks, DevOps.
  • Expertise with Delta Lakes, PowerBI, and Python preferred.
  • Capable of systematically and rationally analyzing the root cause of problems.
  • Experienced with Agile methodology, and the promotion & facilitation of respective technical deliveries.
  • Self-starter, takes responsibility for driving his/her portfolio of tasks and projects.
  • Bachelor’s or Master’s degree in Computer Sciences
  • 6-10 years of experience in BI projects, preferably in the Logistics industry.
  • Proficient Level of English (spoken and written).
Benefits
  • Permanent contract (with basic salary in 14 installments per year)
  • Private medical care
  • English courses - financial or co-financed by company
  • Food allowance (EUR 10.20, per working day)
  • Work schedule 35h/week
  • Hybrid and flexible work (3 days in a week at the office)
  • Comprehensive onboarding program
  • Buddy
  • Good access to public transports

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
Lakehouse architectureDatabricksDelta LakeETLELTSparkPySparkSQLdata quality rulesAgile methodology
Soft skills
analytical skillsself-starterresponsibilityleadershipproblem-solving