HumanIT Digital Consulting

Senior Data Engineer – Azure, Databricks, PySpark

HumanIT Digital Consulting

full-time

Posted on:

Location Type: Hybrid

Location: Porto • Portugal

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AzureCloudETLPySparkPythonSparkSQL

About the role

  • Join a leading data-driven organization in a modern cloud environment
  • Design and deliver robust data solutions supporting critical business decisions
  • Develop and optimize a modern data lakehouse architecture
  • Work with complex data pipelines and multiple data sources
  • Ensure performance and reliability across the platform
  • Emphasize DevOps practices, CI/CD pipelines using Azure DevOps
  • Adopt Microsoft Fabric capabilities

Requirements

  • Proven experience as a Senior Data Engineer in production environments
  • Strong expertise in ETL/ELT pipeline development
  • Hands-on experience with Azure Data Factory v2, Azure Synapse Analytics, and Azure Databricks (Spark 3.x)
  • Solid experience processing large datasets using Python (3.x) and PySpark
  • Advanced knowledge of SQL (T-SQL or ANSI SQL)
  • Strong understanding of data modeling techniques (relational and dimensional)
  • Experience implementing CI/CD pipelines using Azure DevOps
  • Familiarity with data lake / lakehouse architectures
  • Ability to gather business requirements and translate them into scalable technical solutions
  • Experience working across the full data lifecycle (design, development, deployment, maintenance)
  • Fluent in English (mandatory)
Benefits
  • Flexible work arrangements
  • Professional development
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
ETLELTAzure Data FactoryAzure Synapse AnalyticsAzure DatabricksPythonPySparkSQLdata modelingCI/CD
Soft Skills
communicationbusiness requirements gatheringproblem-solvingscalability